WO2024001257A1 - Display device and processing method for display device - Google Patents

Display device and processing method for display device Download PDF

Info

Publication number
WO2024001257A1
WO2024001257A1 PCT/CN2023/078668 CN2023078668W WO2024001257A1 WO 2024001257 A1 WO2024001257 A1 WO 2024001257A1 CN 2023078668 W CN2023078668 W CN 2023078668W WO 2024001257 A1 WO2024001257 A1 WO 2024001257A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
display
screen
page
screen projection
Prior art date
Application number
PCT/CN2023/078668
Other languages
French (fr)
Chinese (zh)
Inventor
汪静娴
韩征
片兆峰
段雨
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202210746808.9A external-priority patent/CN115150645A/en
Priority claimed from CN202210803145.XA external-priority patent/CN117411651A/en
Priority claimed from CN202210977484.XA external-priority patent/CN115454367A/en
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2024001257A1 publication Critical patent/WO2024001257A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals

Definitions

  • the present disclosure relates to the technical field of intelligent display devices, and in particular, to a display device and a processing method for the display device.
  • a display device refers to a terminal device that can output a specific display screen, which can be a smart TV, a mobile terminal, a smart advertising screen, a projector and other terminal devices.
  • a smart TV Take smart TVs as an example.
  • Smart TVs are based on Internet application technology, have open operating systems and chips, have an open application platform, can realize two-way human-computer interaction functions, and integrate multiple functions such as audio-visual, entertainment, and data. Products are used to meet the diverse and personalized needs of users.
  • Wireless screen projection also known as wireless screen sharing, flying screen, and screen sharing, refers to displaying the screen projection data provided by one terminal device on another terminal device in real time through the screen projection protocol.
  • the screen projection data can be media data and real-time operations. Screen etc.
  • users use the wireless screen mirroring function on a terminal device, they can learn and set screen mirroring information related to the terminal device by viewing the screen mirroring function page of the terminal device. However, the terminal device will display a black screen before displaying the screen projection function page, causing the user to blindly wait for the screen projection function page to be displayed, reducing the user's user experience.
  • the present disclosure provides a display device, including: a display configured to display a screen projection function page that contains screen projection information of the display device; a controller configured to: respond to a user input Instructions for displaying the screen projection function page are obtained, and the device identification is used to verify the permission of the display device to use the screen projection function; if the device identification is not obtained, or according to the obtained device identification If the identification verifies that the display device does not have the permission to use the screen projection function, the screen projection function will not be started, and the display will be controlled to be in a black screen state, and a prompt message will be displayed; after the display device is verified according to the obtained device identification After having the permission to use the screen projection function, the screen projection function is started, and after the screen projection function is started, the display is controlled to display the screen projection function page.
  • the present disclosure provides a processing method for a display device.
  • the method includes: in response to an instruction input by a user to display the screen projection function page, obtain a device identification, and the device identification is used to verify the display.
  • the device has permission to use the screen projection function; if the device identification is not obtained, or it is verified based on the obtained device identification that the display device does not have the permission to use the screen projection function, the screen projection function will not be started and all controls will be controlled.
  • the display is in a black screen state and displays a prompt message; after verifying that the display device has the permission to use the screen projection function based on the obtained device identification, the screen projection function is started, and the display is controlled after the screen projection function is started.
  • the screen projection function page is displayed.
  • Figure 1 is a usage scenario of a display device according to some embodiments.
  • Figure 2 is a configuration diagram of a display device according to some embodiments.
  • Figure 3 is a configuration block diagram of a control device according to some embodiments.
  • Figure 4 is an operating system configuration diagram of a display device according to some embodiments.
  • Figure 5 is a schematic diagram of a signal source menu according to some embodiments.
  • Figure 6 is a schematic diagram of a screen casting function page according to some embodiments.
  • Figure 7 is a schematic flowchart showing a black screen state during the process of displaying the screen projection function page according to some embodiments
  • Figure 8 is a flowchart of a processing method for a display device according to some embodiments.
  • Figure 9 is a schematic flowchart of displaying prompt information when the screen is in a black screen state during the process of displaying the screen projection function page according to some embodiments;
  • Figure 10 is a schematic flowchart of displaying prompt information when the screen is in a black screen state during the process of displaying the screen projection function page according to some embodiments;
  • Figure 11 is a schematic flowchart of updating device identification according to some embodiments.
  • Figure 12 is a schematic diagram of a first query page according to some embodiments.
  • Figure 13 is a schematic diagram of a waiting page according to some embodiments.
  • Figure 14 is a schematic diagram of a re-download page according to some embodiments.
  • Figure 15 is a schematic diagram of an update failure page according to some embodiments.
  • Figure 16 is a schematic diagram of the underlying architecture for implementing the wireless screen projection function according to some embodiments.
  • Figure 17 is a schematic flowchart of activating the screen casting function and displaying the screen casting function page according to some embodiments
  • Figure 18 is a communication diagram activating the screen casting function and displaying the screen casting function page according to some embodiments.
  • Figure 19 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments.
  • Figure 20 is a communication diagram activating the screen casting function and displaying the screen casting function page according to some embodiments
  • Figure 21 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments
  • Figure 22 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments
  • Figure 23 is a schematic diagram of a display device displaying a signal source page according to some embodiments.
  • Figure 24 is a schematic diagram of a display device displaying a screen projection information page according to some embodiments.
  • Figure 25 is a schematic flowchart of a display device control method according to some embodiments.
  • Figure 26 is a schematic flowchart of a display device control method according to some embodiments.
  • Figure 27 is a schematic flowchart of a display device control method according to some embodiments.
  • Figure 28 is a schematic diagram of an interface jump of a display device according to some embodiments.
  • Figure 29 is a schematic diagram of an interface jump of a display device according to some embodiments.
  • Figure 30 is a schematic diagram of an interface jump of a display device according to some embodiments.
  • Figure 31 is an interactive flow chart of a business voucher writing method according to some embodiments.
  • Figure 32 is an interactive flow chart of a business voucher writing method according to some embodiments.
  • Figure 33 is an interactive flow chart of a business voucher writing method according to some embodiments.
  • Figure 34 is an interactive flow chart of a business voucher writing method according to some embodiments.
  • Figure 35 is an interactive flow chart of a business voucher writing method according to some embodiments.
  • Figure 36 is a step flow chart of a business voucher writing method according to some embodiments.
  • Figure 37 is a step flow chart of a business voucher writing method according to some embodiments.
  • the display device provided by the embodiment of the present disclosure can have a variety of implementation forms, for example, it can be a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc., or it can be Mobile phones, tablets, smart watches and other devices with displays.
  • Figures 1 and 2 illustrate a specific implementation of the display device of the present disclosure.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1 , the user can operate the display device 200 through the mobile terminal 300 or the control device 100 .
  • FIG. 3 is a configuration block diagram of the control device 100.
  • the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, and the display is controlled through wireless or wired methods.
  • Equipment 200 The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
  • a mobile terminal 300 (such as a mobile phone, tablet, computer, laptop, etc.) may also be used to control the display device 200 .
  • the display device 200 is controlled using an application program running on the mobile terminal 300 .
  • FIG. 3 shows a configuration block diagram of the display device 200 according to an exemplary embodiment.
  • the display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.
  • the display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the screen projection device through the communicator 220 .
  • the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. wait.
  • the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
  • the controller 250 includes a central processing unit (CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory), ROM (Read -Only Memory), at least one of the first to nth interfaces for input/output, communication bus (Bus), etc.
  • the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from the controller 250 and displaying video content, image content, and menu control interfaces. components and user control UI interface.
  • the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.
  • the user may input user commands in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the operating system of the display device 200 is divided into four layers. From top to bottom, they are the Applications layer (referred to as the "Application layer”) and the Application Framework layer. (referred to as “framework layer”), Android runtime (Android runtime) and system library layer (referred to as “system runtime library layer”), and kernel layer.
  • the application layer can be the window program, system setting program or clock program that comes with the operating system; they can also be developed by third-party developers.
  • the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer is equivalent to a processing center, which decides the actions for the applications in the application layer.
  • the application can access the resources in the system runtime layer and obtain system services during execution, and call the corresponding driver in the kernel layer to drive the corresponding module to use the corresponding resources to perform the corresponding services.
  • the display device 200 can establish a connection with a terminal device through a screen projection protocol, and display the screen projection data provided by the terminal device.
  • the terminal device can be a mobile phone, a tablet computer, a computer, a laptop, etc.
  • the display device 200 and the mobile terminal 300 establish a connection through the screen projection protocol, and the mobile terminal 300 transmits the screen data to the display device 200, so that the display device 200 displays the screen displayed by the mobile terminal 300 in real time.
  • the screen casting function page of the display device 200 contains the screen casting information of the display device 200. The user can cast the screen by browsing On the function page, you can learn the screen projection information of the display device 200 and set the screen projection function of the display device 200 .
  • the entrance to the screen projection function page can be set in the function menu of the display device 200, such as the Setting (Setting) menu, the signal source (Input) menu, etc.
  • the user can control the display device 200 to display the function menu by inputting an instruction to display the function menu where the entrance to the screen projection function page is by manipulating the control device 100 , and then the user selects the entrance to the screen projection function page by manipulating the control device 100 to control the display device. 200 displays the screen projection function page.
  • the control device 100 as a remote controller and the entrance to the screen projection function page being set in the signal source menu as an example, the process of displaying the screen projection function page will be described.
  • the user sends an instruction to display the signal source menu to the display device 200 by controlling the remote control.
  • the remote control is provided with a signal source button.
  • the user sends an instruction to the display device 200 by pressing the signal source button, and the display device 200 receives the instruction.
  • the display device 200 displays the signal source menu in response to the instruction.
  • the signal source menu includes multiple signal source options, such as TV (TV), wireless playback (AirPlay), high-definition multimedia (High Definition Multimedia Interface, HDMI), etc.
  • wireless playback is the entrance to the screen projection function page.
  • the user moves the focus to the wireless playback option by controlling the remote control, and presses the "Confirm” button on the remote control to send an instruction to display the screen projection function page to the display device 200.
  • the display device 200 displays Screencast function page.
  • the screen casting function page includes screen casting information of the display device 200 and options for setting the screen casting function of the display device 200. Take the screen casting function page shown in Figure 6 as an example for explanation.
  • the screen casting function page includes the current access of the display device 200. Wi-Fi network, display the terminal device to which the device 200 is connected, set the function options of wireless screen casting and smart home platform (AirPlay and HomeKit Settings), and screen casting options, such as wireless screen casting option 601 and airdrop 602.
  • the screencasting function page also includes some related instructions to instruct the user to perform related operations.
  • the display device 200 is currently connected to Wi-Fi1 and chooses to connect to device A in the living room.
  • the user can reselect the Wi-Fi network to be accessed and the terminal device to be connected by setting the functions of wireless screen projection and smart home platform, and select the screen projection method between the display device 200 and the terminal device by selecting the screen projection option. .
  • the basis that the display device 200 can display the screen casting function page is that the display device 200 has the permission to use the screen casting function. That is to say, the display device 200 can only display the screen casting function page if it has the permission to use the screen casting function. If the display device 200 has the permission to use the screen casting function, If 200 does not have the permission to use the screen mirroring function, it cannot display the screen mirroring function page. At this time, the display device 200 will be in a black screen state. Taking the signal source menu shown in Figure 5 (the same as 1 in Figure 7) as an example, the user controls the remote control to input instructions based on the wireless screen projection option. If the display device 200 does not have the permission to use the screen projection function, the screen will be in a black state.
  • the black screen state means that no page is displayed.
  • the display device 200 does not have the permission to use the screen projection function and displays a black screen state
  • the user cannot know the reason for the black screen state and cannot determine a method to solve the black screen.
  • the user can only choose to wait blindly for the display device 200 to display the screen projection function page. In fact, the display device 200 will not display the screen projection function page subsequently, causing the user to wait ineffectively.
  • the display device 200 Even if the user chooses to exit the screen mirroring function page and re-enters the screen mirroring function page by re-selecting the wireless screen mirroring option, the display device 200 will still be in a black screen state because the display device 200 still does not have the permission to use the screen mirroring function.
  • the display device 200 can display the screen projection function page according to the process shown in Figure 8. The specific steps are as follows:
  • the display device 200 acquires the device identifier in response to an instruction input by the user indicating that the screen projection function page is displayed.
  • the device identifier uniquely corresponds to the display device 200 and can be called the key of the display device 200.
  • the device identifier is used to verify whether the display device 200 has the permission to use the screen projection function.
  • the device identification may be the device identity (Identity, ID) of the display device 200, etc.
  • the manufacturer of the display device 200 will burn and pre-program the method of obtaining the device identification (such as a storage address, etc.) into the display device 200.
  • the display device 200 will At runtime, if the device identity needs to be used, the device identity is obtained through the Internet according to the prefabricated acquisition method.
  • the screen casting function belongs to the enhanced experience (Enhanced Experience) function of the display device 200.
  • the display device 200 Before using the screen casting function, the display device 200 needs to verify whether the display device 200 has the permission to use the screen casting function.
  • the permission can include the system of the display device 200. Whether the version supports the screen casting function, whether the device identity of the display device 200 is trustworthy to support the screen casting function, etc. Only when the display device 200 passes the verification, the screen projection function can be used to ensure the effectiveness, safety, etc. of using the screen projection function.
  • the display device 200 After receiving an instruction input by the user instructing to display the screen projection function page, the display device 200 responds to the instruction and obtains the device identification to verify whether it has permission to use the screen projection function.
  • the display device 200 does not obtain the device identification, or verifies that it does not have the permission to use the screen projection function based on the obtained device identification, the display device 200 does not start the screen projection function, displays a black screen state, and displays a prompt message.
  • the display device 200 does not obtain the device identification, it can directly determine that it does not have the right to use the screen projection function.
  • the display device 200 After the display device 200 obtains the device identification, it needs to further verify whether the display device 200 has the permission to use the screen projection function based on the obtained device identification.
  • the display device 200 calculates the verification value corresponding to the device identification according to a preset verification algorithm. If the verification value is consistent with the verification value preset for the use authority of the screen projection function, the verification is passed, that is, the display device 200 has the use authority of the screen projection function. If the verification value is different from the verification value preset for the use permission of the screen projection function, the verification fails, that is, the display device 200 does not have the use permission of the screen projection function.
  • the display device 200 determines the usage rights corresponding to the device identification according to the preset mapping relationship. If the usage permission corresponding to the device identification is allowed, the verification is passed, that is, it is shown that the device 200 has the usage permission for the screen projection function. If the usage permission corresponding to the device identification is prohibited, the verification fails, that is, the display device 200 does not have the usage permission for the screen projection function.
  • the display device 200 can determine that the reason for not having the permission to use the screen projection function is that there is a problem with the device identification (not obtained, or failed to pass verification), and the display device 200 displays a prompt message to prompt the user to have a black screen.
  • the reason for the status is a problem with the device identification.
  • the prompt information may include information that prompts a problem with the device identity, such as text and icons, and may also include shortcut options for viewing information related to the device identity.
  • the user controls the remote control to project the screen wirelessly.
  • the screen will be black and a prompt message will be displayed, as shown in 2 in Figure 9 .
  • the prompt information includes "Please check the device identification" and icon 901. By reading this prompt information, users can quickly understand that the reason for the black screen state is a problem with the device identification.
  • the black screen problem can be solved by checking the device identification, thereby preventing the user from blindly waiting for the page to load.
  • the displayed prompt information also includes shortcut option 1001.
  • Shortcut option 1001 is the entrance to the signal source menu, as shown in 2 in Figure 10. From this, the user can not only quickly understand that the cause of the black screen state is a problem with the device identification, but can also solve the black screen problem by checking the device identification, and can directly return to the signal source menu by selecting shortcut option 1001 to enter from the signal source menu. View relevant information about device identification on the home page, thereby improving user convenience.
  • the display device 200 displays prompt information, which can be implemented through a native application in the operating system, such as a notification (Notification) application.
  • the display device 200 verifies the permission to use the screen mirroring function by monitoring the startup notification of the screen mirroring function, and when the verification fails, directly calls the notification application to display the notification, and the content of the notification is the prompt information. Therefore, there is no need to additionally configure a third-party application dedicated to displaying prompt information in the display device 200 .
  • the user After browsing the prompt information, the user can check the device identification based on the prompt information and obtain a new device identification so that the display device 200 has the permission to use the screen projection function, thereby solving the black screen problem.
  • the display device 200 is configured to proactively provide the user with a solution path when there is a problem with the device identification.
  • the display device 200 also displays a first portal, which is used to enter a related page provided by the display device 200 to resolve invalid device identification.
  • the first entrance may be an independent entrance.
  • the first entrance may be the information window where the prompt information is located, such as the information window 902 of 2 in Figure 9, and the information window 1002 of 2 in Figure 10.
  • the display device 200 can solve the problem of device identification according to the process shown in Figure 11. The specific steps are as follows:
  • the display device 200 displays the first query page in response to the entry instruction input by the user based on the first portal.
  • the control device 100 takes the page 2 in Figure 9 as an example.
  • the user moves the focus to the information window 902 by manipulating the remote control, and inputs an entry command to the display device 200 by pressing the "confirm" button on the remote control.
  • the display device 200 displays the first inquiry page in response to the entry instruction.
  • the first inquiry page is used to ask the user whether to obtain the device identification again, that is, whether the display device 200 needs to solve the problem of the device identification. Reference may be made to the first inquiry page shown in Figure 12.
  • the first inquiry page includes prompt text to prompt the user for an upcoming operation, such as "update device identification", that is, to prompt the user that the device identification is about to be updated.
  • the first query page also includes operation options, such as update option 1201 and cancel option 1202 .
  • the update option 1201 is used for the user to input an instruction instructing the display device 200 to perform the operation shown in the prompt text, such as updating the device identification.
  • the cancel option 1202 is used for user input to instruct the display device 200 to terminate the task related to resolving the device identification problem.
  • the display device 200 responds to the instruction input by the user to re-obtain the device identification, obtains the device identification, and displays the waiting page.
  • the user moves the focus to the update option 1201 by controlling the remote control, and presses the "confirm" button of the remote control to input an instruction to the display device 200 to re-obtain the device identity. instruction.
  • the display device 200 reacquires the device identification.
  • the display device 200 calls a reset (Reset) interface to re-obtain the device identity.
  • the process of the display device 200 re-acquiring the device identification is similar to step S801 and will not be described again here.
  • the display device 200 When the display device 200 reacquires the device identification, it displays a waiting page.
  • the waiting page includes waiting prompt information to prompt the user that the display device 200 is reacquiring the device identity.
  • the waiting prompt information may include text information, icons, etc.
  • the waiting page includes text information "Updating device identification, please wait” and a countdown icon 1301.
  • the countdown icon 1301 can visually display the remaining time required for the display device 200 to obtain the device identification, and/or the progress of the display device 200 in obtaining the device identification.
  • the countdown icon 1301 includes a duration value, a progress icon, or both a duration value and a progress icon. Among them, the duration value is used to represent the remaining time for the display device 200 to obtain the device identification.
  • the duration value adopts a countdown display method.
  • the initial duration value of the duration value is the total time for the display device 200 to obtain the device identification.
  • the progress icon is used to represent the progress of the display device 200 in obtaining the device identification.
  • the progress of the display device 200 in obtaining the device identification matches the total time for obtaining the device identification. That is, the longer the total time for obtaining the device identification, the longer the progress of obtaining the device identification. The slower it is; conversely, the shorter the total time to obtain the device identification is, the faster the progress of obtaining the device identification is.
  • the progress icon includes two parts.
  • One part corresponds to the complete progress icon, indicating the total progress of the display device 200 in obtaining the device identification.
  • the total time to complete the total progress is equal to the total time in which the display device 200 obtains the device identification.
  • the other part represents The display device 200 has completed the progress of obtaining the device identification, and the difference between the two parts is the progress of the display device 200 obtaining the device identification that has not yet been completed.
  • the total time for the display device 200 to obtain the device identification may be a preset fixed value, or it may be a dynamic value calculated in real time by the display device 200 based on the current network environment and the like.
  • the display device 200 determines the total time for obtaining the device identification, it can start timing through the timer (Time) function.
  • the time value displayed in the countdown icon 1301 is the difference between the total time and the time measured by the timer.
  • the progress icon in the countdown icon 1301 can display the completed progress according to N (N>0) time units of the timer.
  • the progress icon displays the completed progress according to 1 time unit of the timer.
  • the timer Every time the device adds 1 duration unit the progress icon increases to show the completed progress corresponding to 1 duration unit.
  • the progress icon displays the completed progress according to the 3 time units of the timer. At this time, every time the timer increases by 3 time units, the progress icon increases and displays the completed progress corresponding to the 3 time units.
  • the timing unit of the timer is 1 second
  • the current time duration is 3 seconds
  • the progress icon is a ring as an example.
  • the display device 200 displays a countdown icon 1301, in which the duration value is 9s, that is, the remaining time for the display device 200 to obtain the device identification is 9s.
  • the white part in the progress icon represents the completed progress, and the area of the white part is four quarters of the ring. one, indicating that the display device 200 has completed obtaining the device One quarter of the total progress identified.
  • the display device 200 After reacquiring the device identification, the display device 200 needs to verify again whether it has the permission to use the screen casting function.
  • the process of re-verifying whether the display device 200 has the permission to use the screen casting function is similar to step S802 and will not be described again here.
  • the display device 200 may be configured to only provide the user with a service of re-obtaining the device identity once. That is, if the display device 200 still does not pass the verification after re-acquiring the device identity, it still does not have the screen casting function. If the user has the right to use the device, the user will no longer be provided with the service of re-obtaining the device identity. Therefore, reducing the number of times of re-obtaining the device identification can effectively avoid the time-consuming process of repeatedly obtaining the device identification, thereby reducing the impact on the user experience.
  • the display device 200 may be configured to provide the user with a service of re-obtaining the device identity multiple times. That is, after the display device 200 re-obtains the device identity, if the verification still fails, the display device 200 will continue to provide the user with the service of re-acquiring the device identity. Obtain the service of device identification, and after receiving the instruction input by the user to obtain the device identification again, obtain the device identification again until the upper limit of the number of times of re-obtaining the device identification is reached, and the display device 200 no longer provides the user with the method of re-obtaining the device identification. Serve. Therefore, the success rate of obtaining a valid device identity can be improved by re-obtaining the device identity multiple times, thereby improving the user experience.
  • a re-download page is displayed.
  • the re-download page shown in FIG. Identity which prompts the user that the device identification is about to be updated.
  • the re-download page also includes operation options, such as a Retry option 1401 and a Cancel option 1402 .
  • the try again option 1401 is used for user input to instruct the display device 200 to obtain the device identification again.
  • the cancel option 1402 is used for user input to instruct the display device 200 to terminate the task related to resolving the device identification problem.
  • the user controls the remote controller to move the focus to the try again option 1401, and presses the "confirm" button of the remote controller to input an instruction to the display device 200 to obtain the device identification again.
  • the process in which the display device 200 obtains the device identification again in response to the instruction is similar to step S1102 and will not be described again here.
  • the upper limit of the number of times the display device 200 can re-obtain the device identity is 5 times.
  • the number of times the display device 200 obtains the device identity is equal to 5 times, and after obtaining the device identity for the fifth time, the verification is still not passed, and the display device 200 is no longer Users are provided with the service of re-obtaining device identification.
  • the display device 200 still fails to obtain the device identification after reacquiring the device identification at least once, or if it is verified that it does not have the permission to use the screen projection function based on the obtained device identification, the update failure page will be displayed.
  • the update failure page includes an update failure prompt to remind the user that the device identification update failed, and the service of obtaining the device identification is no longer provided this time.
  • the update failure prompt includes a specified number and an operation prompt.
  • the designated number uniquely corresponds to the device identification
  • the operation prompt is used to prompt the user to feed back the designated number to the third-party terminal or server to update the device identification through the third-party terminal or server.
  • the designated number can all be the same type of characters, such as all numbers, or all letters, etc.
  • the designated number can also be a combination of multiple characters, such as a combination of numbers and letters, a combination of numbers and symbols, etc.
  • a third-party terminal or server can configure the display The manufacturer, operation and maintenance, etc. of the device 200 have the authority to obtain the corresponding relationship between the specified number and the device identification, and have the authority to view the device identification update record, so that the device identification update failure record can be analyzed based on the device representation update record of the device 200. reason.
  • the user can contact the third-party terminal or server by himself and inform the third-party terminal or server of the specified number in the update failure prompt.
  • the display device 200 is configured to also display a confirmation (OK) option on the update failure page.
  • the confirmation option is an entry point for the user to enter an instruction instructing the display device 200 to contact a third-party terminal or server to update the device identification.
  • the display device 200 sends the specified number to the third-party terminal or server in a preset communication method.
  • the pre-stored communication methods can be set by the manufacturer or the user.
  • the pre-stored communication methods can include email, cloud account, text message, etc.
  • the update failure page includes the update failure prompt "Update failed. Please inform the after-sales service or manufacturer of the designated number No. 1 ⁇ 0.”, and confirmation option 1501.
  • the description takes the control device 100 as a remote controller and the pre-stored communication method as email as an example.
  • the user moves the focus to the confirmation option 1501 by controlling the remote control, and inputs instructions to the display device 200 by pressing the "confirm" button of the remote control.
  • the display device 200 sends the specified number by email to the mailbox of the pre-stored third-party terminal or server.
  • the display device 200 responds to the instruction input by the user based on the confirmation option, closes the update failure page, and displays a menu including the entrance to the screen projection function page, such as displaying the signal source menu shown in FIG. 5 , or displaying other user interfaces, such as the display device 200 main page, etc.
  • S803 After verifying the usage rights of the screen casting function according to the obtained device identification, the display device 200 starts the screen casting function, and displays the screen casting function page after the screen casting function is started.
  • the display device 200 passes the verification based on the obtained device identification when responding to the instruction input by the user to display the screen projection function page, that is, the display device 200 has the permission to use the screen projection function, or the display device 200 performs the function on one or more occasions. After re-obtaining the device identification for the first time, if the device identification passed the verification last time, that is, the display device 200 has the permission to use the screen casting function, the screen casting function is started, and after the screen casting function is started, the screen casting function page is displayed.
  • the realization of the screencasting function depends on the entrance of the screencasting function page located at the application layer, the screencasting service and screencasting application package located at the system framework layer, and the projection function located at the system runtime layer. Cooperation between screen processes. Take the screen projection function as the wireless screen projection shown in Figure 5 as an example. As shown in Figure 16, the entrance to the screen projection function page is the wireless screen projection in the signal source menu in Figure 5. The user can use this entrance to interact with the display. The device 200 interacts to use the screen casting function.
  • the screen mirroring application package is a wireless screen mirroring application (AirPlay Apk), which is used to connect the properties of the whole machine and obtain the machine parameters related to the wireless screen mirroring function, such as volume, etc.
  • the screen mirroring process is the wireless screen mirroring process (AirPlay Daemon), which is a resident local (Native) daemon that can communicate with the kernel layer to drive hardware devices, such as driving the monitor to display the screen mirroring function page.
  • the screen casting service is the wireless screen casting service (AirPlay Lunch Service).
  • the wireless screen casting service can provide an interface for the screen casting application, query the relevant permission information of the wireless screen casting application, manage the life cycle of the wireless screen casting application, and communicate with the wireless Screencasting process To communicate etc.
  • the user inputs an instruction to the display device 200 based on the entrance of the screen projection function page.
  • This process is similar to the above process of the user inputting instructions based on the entrance of the screen projection function page, and will not be described again here.
  • the portal transmits the instruction to the screen mirroring service in the form of a message.
  • the screen mirroring service queries the permission information related to the screen mirroring application, that is, it queries whether it has permission to use the screen mirroring function.
  • the screen mirroring service queries the permissions.
  • the information process is similar to steps S801-S802 and will not be described again here.
  • the screen mirroring service queries that it has the permission to use the screen mirroring function, it controls the startup of the screen mirroring application, which starts the life cycle of the screen mirroring application.
  • a startup completion notification is sent to the screen mirroring service, so that the screen mirroring service controls the loading of the package file of the screen mirroring application, obtains the page data of the screen mirroring function page, and communicates with the screen mirroring process. , to send a startup message and the page data of the projection function page to the projection process, so that the projection process drives the display to display the projection function page based on the page data of the projection function page.
  • the screen casting service inquires about the permission to use the screen casting function, and ends when the monitor displays the screen casting function page.
  • the monitor is in a black screen state at this stage. It can be seen that if the communication duration in this stage is longer, the black screen duration in the black screen state will also be longer. If the communication duration in this stage is shorter, the black screen duration in the black screen state will also be shorter. A black screen for a long time will reduce the user experience. In order to solve the problem of the black screen being too long at this stage, the communication time at this stage needs to be shortened.
  • the screen mirroring service can only perform subsequent steps after receiving the startup completion message sent by the screen mirroring application, that is, it can display the screen mirroring function page on the monitor.
  • the screen casting application is configured to send a startup completion notification to the screen casting service in the form of background broadcast by default.
  • all other applications in the operating system use background broadcast to send notifications to the corresponding services.
  • Each background broadcast is concentrated in a stack (Stack), and the system framework layer of the operating system will follow this The order in which background broadcasts are received in the stack is passed to the corresponding service in turn.
  • the startup completion notification sent by the screen mirroring application is the 7th background broadcast in the stack
  • the system framework layer needs to process the screen mirroring application after processing the 1-6 background broadcasts in the stack.
  • the notification of completion of startup is sent to the screen mirroring service.
  • the display device 200 After the display device 200 is turned on, the display device 200 first starts the operating system. During the startup process of the operating system, each designated application program that is automatically started after starting up begins to load. These designated application programs are all loaded, that is, the operating system starts. complete. After these specified applications are started, they all send startup completion notifications to the system framework layer through background broadcast. If applications other than these specified applications complete startup in response to the user's startup instructions, the background broadcasts sent by them will be ranked after the background broadcasts sent by these specified applications. That is, the system framework layer will only send these specified applications. After the background broadcast is processed, the background broadcast sent by other applications will be processed.
  • the display device 200 receives an instruction to display the screen mirroring function page during the startup process of the operating system, and after the screen mirroring application is started, the background broadcast sent to the screen mirroring service will be at least ranked in the background sent by these designated applications. After the broadcast, the communication duration for the screen projection service to receive the background broadcast sent by the screen projection application will be longer, so the black screen duration of the display device 200 in a black screen state will also be longer.
  • the display device 200 can start the screen projection function according to the process shown in Figure 17 and display the screen projection function page. Specific steps are as follows:
  • the display device 200 obtains the startup status of the operating system through the screen casting service according to the instructions passed at the entrance of the screen casting function page, and sends a startup notification to the screen casting application to start the screen casting application.
  • the startup notification is generated based on the startup status of the operating system.
  • the screen mirroring service can detect whether the operating system has been started by detecting the loading status of each specified application that automatically starts after booting, and whether there is a background broadcast sent by the specified application that automatically starts after booting in the stack. If there are loading and/or unloaded applications that are specified to be automatically started after booting, and there are background broadcasts sent by the specified applications that are automatically started after booting in the stack, etc., the startup status of the operating system is starting. Otherwise, The startup status of the operating system is startup completed.
  • the screen mirroring service sends the obtained startup status of the operating system to the screen mirroring application in the form of a startup notification to start the screen mirroring application.
  • the display device 200 sends a startup completion notification to the screen casting process in the target communication mode corresponding to the startup state of the operating system according to the startup notification through the screen casting application, so that the screen casting process drives the display to display the screen casting function page.
  • the screen mirroring application starts loading according to the received startup notification, and generates a startup completion notification after the loading is completed.
  • the screen mirroring application needs to use the target communication method corresponding to the startup status of the operating system to send the startup completion notification to the screen mirroring process, so that the screen mirroring process can
  • the process drives the display to display the screen projection function page.
  • the startup state of the operating system is starting
  • the target communication method is that the screen casting application transmits a startup completion notification to the screen casting process through the screen casting service, where the screen casting application broadcasts to the screen from the foreground.
  • the screen mirroring service sends a notification that it has been started.
  • the screen mirroring application can send a startup completion notification to the screen mirroring service by broadcasting in the foreground. For example, a screencasting application adds a flag, such as Receiver Foreground, to the broadcast it sends to indicate that the broadcast is a foreground broadcast. Because foreground broadcasts and background broadcasts belong to different stacks, the number of foreground broadcasts is usually small.
  • the response time of the foreground broadcast is shorter than the response time of the background broadcast.
  • the response time of the foreground broadcast is 10s
  • the response time of the background broadcast is 60s. That is, the broadcast needs to be processed within the corresponding response time of each broadcast. , thus, the time for processing the foreground broadcast is relatively short.
  • the startup completion notification sent by the screen casting application can be processed faster, and after waiting for less foreground broadcast processing, it can be delivered to the screen casting service, so that the screen casting service can be used faster is passed to the screen casting process to shorten the communication time between the screen casting application and the screen casting process, thereby shortening the black screen time and effectively improving the user experience.
  • the screen mirroring service can communicate with the screen mirroring process through socket communication via Transmission Control Protocol (TCP).
  • TCP Transmission Control Protocol
  • Step 1801 The wireless projection function page receives instructions
  • Step 1802 The wireless screen projection function page sends the instruction to the wireless screen projection service
  • the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 1801 and 1802;
  • Step 1803 The wireless screen projection service obtains that the startup status of the operating system is starting, and generates a startup notification; the startup notification writes the business credentials into the preset storage location of the display device;
  • Step 1804 The wireless screen mirroring service sends the startup notification to the wireless screen mirroring application
  • Step 1805 The wireless screen projection application is started and a notification of startup completion is generated
  • Step 1806 The wireless screen projection application sends a startup completion notification to the wireless screen projection service in the form of foreground broadcast;
  • Step 1807 The wireless screen projection service delivers the startup completion notification to the wireless screen projection process
  • Step 1808 The wireless projection process drives the display
  • Step 1809 The monitor displays the wireless projection function page.
  • the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service.
  • the wireless screen projection service obtains that the startup status of the operating system is starting.
  • the wireless screen projection service generates a startup based on the startup status of the operating system.
  • the startup notification includes instruction information that instructs the screen mirroring application to use the foreground broadcast, such as Foreground, and sends the startup notification to the wireless screen mirroring application.
  • the wireless screen mirroring application After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of a foreground broadcast.
  • the wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
  • the startup status of the operating system is starting, and the target communication method is that the screen casting application directly sends a startup completion notification to the screen casting process.
  • the screen mirroring application In order to prevent the screen mirroring application from sending the startup completion notification to the screen mirroring service in the form of background broadcast, the screen mirroring application directly establishes communication with the screen mirroring process. Therefore, the screen mirroring application can directly send the startup completion notification to The screen mirroring process does not need to go through the screen mirroring application, which can effectively shorten the communication time between the screen mirroring application and the screen mirroring process, thereby shortening the black screen time and improving the user experience. For example, you can configure a listening interface in the screen mirroring application. After listening to the screen mirroring application being started, you can directly communicate with the screen mirroring process through Socket through TCP.
  • Step 1901 The wireless projection function page receives instructions
  • Step 1902 The wireless screen projection function page sends the instruction to the wireless screen projection service
  • the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 1901 and 1902;
  • Step 1903 The wireless screen projection service obtains the startup status of the operating system as starting, and generates a startup completion notification
  • Step 1904 The wireless screen projection service sends the startup notification to the wireless screen projection application
  • Step 1905 The wireless screen projection application is started and a notification of startup completion is generated
  • Step 1906 The wireless screen projection application establishes communication with the wireless screen projection process and sends a startup completion notification to it;
  • Step 1907 The wireless projection process drives the display
  • Step 1908 The monitor displays the wireless screen projection function page.
  • the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service.
  • the wireless screen projection service obtains that the startup status of the operating system is starting, and sends a startup notification containing the startup notification to the wireless screen projection application. .
  • the wireless screen mirroring application After the wireless screen mirroring application is started, it establishes communication with the wireless screen mirroring process, and directly transmits the startup completion notification to the wireless screen mirroring process, so that the wireless screen mirroring process drives the display to display the wireless screen mirroring function page.
  • the startup state of the operating system is startup completed
  • the target communication method is that the screen casting application transmits a startup completion notification to the screen casting process through the screen casting service, wherein the screen casting application uses a background broadcast to The screen mirroring service sends a notification that it has been started.
  • the operating system If the operating system is started, all the background broadcasts sent by the designated applications that are automatically started at startup have been processed. At this time, the number of background broadcasts in the stack corresponding to the background broadcasts will be reduced, that is, the number of background broadcasts sent by the screen mirroring application will be reduced. The number of background broadcasts processed before broadcasting will be reduced. If the screen mirroring application sends a startup completion notification to the screen mirroring service in the form of background broadcast, the time the screen mirroring service waits for the startup completion notification will be shortened. As a result, the screen mirroring service will The communication time between the application and the screen casting process will also be relatively reduced. Correspondingly, the black screen time will also be shortened, which will not cause strong resentment among users.
  • the priority of foreground broadcast is higher than that of background broadcast, that is, the operating system will process the foreground broadcast first and then the background broadcast. Therefore, the newly generated foreground broadcast will affect the processing process of the existing background broadcast, thus affecting these
  • the background broadcast corresponds to the normal operation of the application. Therefore, in order to ensure the normal operation of the display device 200, when the black screen duration is relatively short, try to avoid using the foreground broadcast method to communicate between the screen casting application and the screen casting service.
  • Step 2001 The wireless projection function page receives instructions
  • Step 2002 The wireless screen projection function page sends the instruction to the wireless screen projection service
  • the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2001 and 2002;
  • Step 2003 The wireless screen mirroring service obtains that the startup status of the operating system is startup completed, and generates a startup notification; the startup notification includes instruction information instructing the screen mirroring application to use background broadcast, such as Background;
  • Step 2004 The wireless screen mirroring service sends the startup notification to the wireless screen mirroring application
  • Step 2005 Start the wireless screen projection application and generate a startup completion notification
  • Step 2006 The wireless screen projection application sends a startup completion notification to the wireless screen projection service in the form of background broadcast;
  • Step 2007 The wireless screen projection service transmits the startup completion notification to the wireless screen projection process
  • Step 2008 The wireless projection process drives the display
  • Step 2009 The monitor displays the wireless projection function page.
  • the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service, and the wireless screen projection service
  • the service obtains that the startup status of the operating system is startup completed.
  • the wireless screen mirroring service generates a startup notification based on the startup status of the operating system.
  • the startup notification includes instruction information instructing the screen mirroring application to use background broadcast, such as Background, and will This startup notification is sent to the wireless screen mirroring application.
  • the wireless screen mirroring application After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of background broadcast.
  • the wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
  • the screen projection service obtains the number of background broadcasts in the stack after obtaining the startup status of the operating system as Startup Complete according to the instructions passed at the entrance of the screen projection function page.
  • the screen casting application needs to use foreground broadcast to send a startup completion notification to the screen casting service. If the number of background broadcasts in the stack is less than the quantity threshold, it means that the number of background broadcasts is small, and the screen mirroring application can use background broadcasts to send a startup completion notification to the screen mirroring service.
  • Step 2101 The wireless projection function page receives instructions
  • Step 2102 The wireless screen projection function page sends the instruction to the wireless screen projection service
  • the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2101 and 2102;
  • Step 2103 The wireless screen projection service obtains that the startup status of the operating system is startup completed
  • Step 2104 The wireless screen projection service determines whether the number of background broadcasts in the stack is greater than the quantity threshold
  • Step 2105 If not, generate a startup notification and send it to the wireless screen projection application; the startup notification includes instruction information instructing the screen projection application to use foreground broadcast, such as Foreground;
  • Step 2106 If so, generate a startup notification and send the startup notification to the wireless screen projection application; the startup notification includes instruction information instructing the screen projection application to use background broadcast, such as Background;
  • Step 2107 Start the wireless screen projection application and generate a startup completion notification
  • Step 2108 The wireless screen projection application broadcasts the startup completion notification to the wireless screen projection service
  • Step 2109 The wireless screen projection service transmits the startup completion notification to the wireless screen projection process
  • Step 2110 Wirelessly project the screen to drive the display
  • Step 2111 The monitor displays the wireless projection function page.
  • the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service.
  • the wireless screen projection service obtains that the startup status of the operating system is startup completed.
  • the wireless screen projection service obtains the stack according to the startup status of the operating system.
  • the number of background broadcasts within Among them, if the number of background broadcasts is greater than or equal to the quantity threshold, a startup notification is generated.
  • the startup notification includes instruction information instructing the screen casting application to use foreground broadcasting, such as Foreground, and the startup notification is sent to the wireless screen casting application. After launching the wireless screen mirroring application, After completion, a notification of completion of startup is sent to the wireless screen projection service through front-end broadcast.
  • a startup notification is generated.
  • the startup notification includes instruction information instructing the screen mirroring application to use background broadcasting, such as Background, and the startup notification is sent to the wireless screen mirroring application.
  • the wireless screen mirroring application After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of background broadcast.
  • the wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
  • the startup status of the operating system is startup completed, and the number of background broadcasts in the stack is greater than or equal to the quantity threshold.
  • the screen casting application can also directly establish communication with the screen casting process to directly notify the startup completion Send to the screen casting process.
  • the startup status of the operating system is startup completed
  • the target communication method is that the screen projection application directly sends a startup completion notification to the screen projection process.
  • Step 2201 The wireless screen projection function page (wireless screen projection shown in Figure 22) receives instructions
  • Step 2202 The wireless screen projection function page sends the instruction to the wireless screen projection service
  • the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2201 and 2202;
  • Step 2203 The wireless screen projection service obtains that the startup status of the operating system is startup completed, and generates a startup notification;
  • Step 2204 The wireless screen mirroring service sends a startup notification including startup to the wireless screen mirroring application
  • Step 2205 Start the wireless screen projection application and generate a startup completion notification
  • Step 2206 The wireless screen mirroring application establishes communication with the wireless screen mirroring process and sends a startup completion notification to it;
  • Step 2207 The wireless projection process drives the display screen
  • Step 2208 The monitor displays the wireless screen projection function page.
  • the entrance to the wireless screen mirroring function page in the above steps passes the instruction to the wireless screen mirroring service.
  • the wireless screen mirroring service obtains that the startup status of the operating system is startup completed, and sends a startup notification including startup to the wireless screen mirroring application. .
  • the user when implementing screencasting based on the airplay function, the user can activate the screencasting function in the display device through the signal source port provided in the display device and display the corresponding screencasting information, and then wait for the user to operate the smart device Establish a connection with the display device for screencasting.
  • the display device does not respond to the return command received on the screencasting information page, which seriously affects the user experience, as shown in Figure 23 and Figure 24 below.
  • the user interface 21 shown in FIG. 23 exemplarily shows the signal source page, where the user interface 21 includes: an area 201 for displaying the signal source page.
  • the area 201 can be all or part of the display area of the entire display, Furthermore, this disclosure does not limit parameters such as the display position, display size, color, text display style, etc. of the area 201.
  • the signal source page can be suspended and displayed above the page originally displayed by the display device and close to the left edge. The brightness, color, transparency and other display parameters of the page originally displayed by the display device can be adjusted to Highlight the source page.
  • the area 201 may include an area 201a and multiple areas 201b.
  • Area 201 is used to display the name of the signal source page. The name can be in any language.
  • the Chinese "signal source” is used.
  • Area 201b is used to display signal sources. Each area 201b corresponds to a signal source.
  • Figure 23 contains 6 signal sources, namely "Home Page”, “Live Broadcast”, “Air Play”, "HDMI1", “HDMI2” and “HDMI3”, the signal source selected by the user can be reflected in different display styles.
  • the text size in the area 201b corresponding to the signal source selected by the user is enlarged and bold, and the area 201b is filled with an obviously different color. .
  • the user can select one of the multiple signal sources displayed on the signal source page as the current signal input source of the display device, and receive the data input by the signal source for analysis and display. For example, if the user selects real-time live broadcast as the current signal source, the display device 200 receives real-time broadcast and television data as signal input to display the radio and television content; for another example, if the user selects air play as the current signal source, the display device 200 can initiate screencasting.
  • the smart device receives and analyzes the screen projection data and displays it.
  • the device may support multiple different airplay protocols for screencasting, for example, Miracast protocol or airplay protocol may be used.
  • different air play protocols have different specifications.
  • the display device 200 when airplay is implemented through the airplay protocol, when the user selects airplay as the current signal source on the signal source page, based on the specifications of the airplay protocol, the display device 200 will be required to jump to the screen casting information page, where the screen casting information page
  • the information page can display the name of the display device, the name of the WiFi currently connected to the display device, etc., and the screen casting information page can also provide other function entrances.
  • After the display device 200 jumps to the screen casting information page it can wait Users operate smart devices to mirror the screen, directly operate the application to mirror the screen, etc.
  • the screen casting information page displays information about the display device and WiFi to be connected to the user, which ensures that the user can select the correct display device and connect to the correct WiFi when operating on the smart device to avoid the problem of screen casting failure. .
  • the display device 200 can jump to the user interface 31 shown in Figure 24 to display the screen projection information page.
  • the user interface 31 includes: area 301 , area 302 , area 303 , entrance 304 and area 305 .
  • area 301 is used to display some introductory instructions for Air Play, for example, "Air Play, share content on your mobile phone, PAD or MAC through a wireless network", and can display related Air Play icons.
  • Area 302 is used to display the name of the WiFi to which the display device is connected.
  • Area 303 is used to display the name of the display device.
  • the entrance 304 is used to enter the air play setting page.
  • the air play setting page can modify the name of the display device, change the WiFi currently connected to the display device, and so on.
  • Area 305 is used to display prompt information related to air play, for example, the text prompt content "Please ensure that your mobile phone, PAD or MAC is connected to the WiFi network connected to this device. If you want to get more information, please visit xxxxxx website”.
  • the display device After entering the screen mirroring information page, the display device will wait for the user to operate the smart device to mirror the screen. In some cases, the user may not want to proceed with the next step of screencasting, and usually the user will operate the control device to return.
  • the current display device implements screen casting based on the AirPlay protocol
  • the user after entering the screen casting information page through the signal source page, the user sends a return instruction to the display device 200 by operating the return button on the mobile terminal 300 or the control device 100.
  • the display device 200 does not respond to the return command on the screen casting information page. This may make the user think that the display device is stuck or there is an error in the screen casting function. This is not in line with the user's usage habits and may also cause the user to use the air play function. The experience is poor.
  • the present disclosure adds corresponding business logic to the display device 200, so that the display device 200 responds to the return instruction of the screen projection information page and jumps to the pre-specified page, which is not only in line with the user's usage habits, but also more convenient.
  • the processing logic can be set flexibly.
  • the return instructions of the screen projection information page can be specified to be uniformly returned to a specified page.
  • the processing logic is simple; or, the active data in the display device before entering the screen projection information page can also be analyzed.
  • Data source objects set different processing logic for different data source objects. This method is also more in line with users' usage habits.
  • the instructions or requests sent by the mobile terminal 300, the control device 200 and the smart device are first transmitted to the kernel layer, and the airplay SDK in the kernel layer parses the received return instructions.
  • the airplay SDK in the kernel layer parses the received return instructions.
  • the playback SDK can process the received instructions or requests internally.
  • the air playback SDK needs to call the relevant components of the upper system library layer to pass the received instructions or requests to the upper system library layer, and then through The relevant components in the system library layer pass the instructions or requests to the target application in the application layer for processing in response to the instructions or requests.
  • FIG 25 is a schematic flowchart of a display device control method according to one or more embodiments of the present disclosure. Please refer to Figure 25. This embodiment includes:
  • the specified airplay protocol is the airplay protocol.
  • the AirPlay SDK receives the return command and analyzes it to determine whether the screen projection information page is currently displayed. If so, step S603 is executed; If not, the AirPlay SDK will respond to the return command. In other words, the return command will be passed upward only when it is determined that the display is currently displaying the screen projection information page, otherwise it will be processed within the air play function.
  • the return command is passed upward mainly to design the AirPlay SDK, the startup service in the system library layer, and the AirPlay application in the application layer.
  • the difference between Figure 26 and Figure 27 is that the processing method after the return command is transmitted to the AirPlay application is different, but the interaction process between the front-end AirPlay SDK, startup service and AirPlay application is the same. . Therefore, here we first introduce the front-end processing flow of return instructions.
  • the return instruction is sent to the AirPlay application in a broadcast manner by calling the AirPlay SDK, so that the AirPlay application responds to the return instruction and controls the display to return to display the pre-specified page.
  • the AirPlay SDK in the kernel layer cannot communicate directly with the application layer and needs to rely on components in the middle layer. Therefore, the AirPlay SDK needs to forward the received return instructions to the system library layer first.
  • the startup service is then called to broadcast the return instruction to send the return instruction to the AirPlay application in the application layer, so that the AirPlay application responds to the return instruction and returns to the pre-specified page.
  • the startup service can monitor socket connections, and the AirPlay SDK can forward the return command to the startup service in the form of a socket.
  • a socket is an abstraction of an endpoint for two-way communication between different application processes in the network.
  • a socket can be understood as one end of process communication.
  • the AirPlay SDK writes the return command into the socket corresponding to the underlying driver, and then sends the return command to the socket corresponding to the startup service through the transmission medium between the AirPlay SDK and the startup service.
  • the startup service starts from itself. Read the return instruction from the corresponding socket.
  • the communication efficiency between data components transmitted through socket is relatively high, which can improve the processing speed of the display device.
  • the AirPlay SDK can also send return instructions to the startup service through other methods.
  • the return instructions can also be transmitted through broadcast or Binder.
  • the broadcast method is simple and easy to implement; the Binder method has better performance and stronger real-time performance.
  • the way the AirPlay SDK transmits return instructions to the startup service can be flexibly set according to needs.
  • the AirPlay application responds to the return instruction to execute the operation of ending the AirPlay application.
  • the activity manager pops the task corresponding to the AirPlay application from the top of the stack and controls the closing of the window corresponding to the AirPlay application. Thereby closing the screen projection information page; further, the corresponding description data is generated for the return instruction through the intent component.
  • the Android system determines that the component to be called is the Android desktop startup component through the description data, and then calls the Android desktop startup component to restart. Start the operating system desktop and display it. This business logic can not only meet the user's usage habits, but also solve the problem of the display device not responding to return instructions on the screen projection information page, and the implementation complexity is relatively simple.
  • Custom parameters can indicate whether the data source object in the startup state before entering the screen projection information page belongs to a signal source supported by the display device or an application installed in the display device. Assume that the custom parameter is launch source.
  • the launch source value corresponding to any signal source is the same.
  • the launch source value corresponding to different applications can be the same or different. This disclosure does not limit this. For example, if the launch source value corresponding to any signal source is the same, the airplay application is relatively certain that the launch source value is equal to the default value, which means that the display device enters airplay under the signal source. It is relatively certain that the launch source value is not equal to the default value.
  • the value indicates that the display device enters airplay under the application; if the launch source is equal to the default value, it is determined that you need to return to the desktop of the Android system; if the launch source is not equal to the default value, you are determined to return to the main page of the application .
  • the present disclosure does not limit the size of the preset value.
  • the preset value can be 1, 0, or other numerical values.
  • the launch source can be updated by the activity manager based on the tasks of each application in the launched state. After receiving the return command, the AirPlay application always needs to obtain the latest launch source value from the activity manager.
  • the operation of ending the AirPlay application is executed.
  • the activity manager pops the task corresponding to the AirPlay application from the top of the stack and controls the closing of the AirPlay application. corresponding window to close the screencasting information page; after that, you can use the activity manager to push the task corresponding to the target application that is to be restored to the startup state to the top of the stack and gain focus, and then restart the corresponding task of the target application. task, and display the window corresponding to the target application, and display the main page provided by the target application in the window.
  • FIGS. 28 to 30 are used to illustrate the changes in the user interface in the display device when the aforementioned two different implementation methods are adopted.
  • the display device responds to the user's operation of the message on the remote control.
  • the command generated by the signal source button displays the signal source page on the desktop of the Android system.
  • the user selects Air Play as the signal source from multiple signal sources, starts the Air Play function, and the display device jumps to the center shown The screen projection information page, and then receives the return command generated by the user operating the return button on the remote control, and the display device returns to the Android system desktop from the screen projection information page.
  • the display device responds to the instructions generated by the user operating the signal source button on the remote control and displays the signal source page on the top of the desktop of the Android system; then, the user selects the signal source page from multiple signal sources.
  • the display device will jump to the screen casting information page, and enter the AirPlay setting page through the AirPlay setting entrance in the screen casting information page; after that, the user can Establish a connection with the display device through screen mirroring or directly operate the cast button on the multimedia content playback page provided by the mobile phone application and display the cast content display page on the display device; in the process of displaying the cast content , the display device receives the return command generated by the user's operation of the return button on the remote control, and the display device first returns from the projection content display page to the projection information page; after that, the display device again receives the return command generated by the user's operation of the return button on the remote control. Return command, the display device will jump from the screen projection information page to the desktop of the Android system.
  • the display device is displaying the main page of application 1 installed in the display device; after that, the display device responds to the instructions generated by the user operating the signal source button on the remote control.
  • the signal source page is displayed on the main interface of Application 1; then, the user selects air play as the signal source from multiple signal sources, starts the air play function, and the display device jumps to the screen casting information page; after that, the user can directly By operating the screen casting button or screen mirroring in the multimedia content playback page provided by the mobile phone application, establish a connection with the display device and display the screen casting content on the display device; during the process of displaying the screen casting content, the display device receives The user operates the return button on the remote control to generate a return instruction, and the display device first returns from the projection content display page to the projection information page; after that, the display device again receives the return instruction generated by the user operating the return button on the remote control, and displays The device will jump from the screencasting information page to the main page of Application
  • the first return command received by the display device is processed internally by the AirPlay SDK, and the second return command is uploaded by the AirPlay SDK to the AirPlay application by starting the service. deal with.
  • the display device can respond to the return instruction for the screen projection information page with a unified strategy or a more flexible and targeted strategy. , control page jumps to meet the user's usage habits, and can improve the user's experience using the air playback function of the display device.
  • the currently commonly used method of writing business credentials is to write the business credentials to the display device in the production environment.
  • writing business credentials to relevant equipment in the production environment causes the production progress to depend on the certification progress of the business credentials. If the display device does not pass the certification of the business party, there will be no It is impossible to obtain business credentials, thereby affecting the production progress of the display device; on the other hand, writing business credentials to related devices in the production environment will also result in that once the business credentials are written into the display device and delivered to the user, the business credentials cannot be changed.
  • the business credentials are abnormal or need to be updated, the business credentials in the display device cannot be rewritten. Therefore, how to safely write business credentials to the display device after the display device is delivered is an urgent problem that needs to be solved.
  • the present disclosure writes the first encryption key to the display device 200 and uploads the business certificate corresponding to the display device 200 and the first decryption key corresponding to the first encryption key to the server 400 .
  • the display device 200 needs to write a business certificate
  • the display device 200 reads the written first encryption key through the controller 250, generates a first device signature based on the first encryption key, and then sends the first device signature to the server 400 through the controller 220.
  • the server 400 authenticates the display device 200 based on the first decryption key and the first device signature. If the display device 200 passes the authentication, the server 400 sends the business voucher corresponding to the display device 200 to the display device 200 .
  • the display device 200 After receiving the business voucher sent by the server 400, the display device 200 saves the business voucher to a preset storage location to complete writing the business voucher. Since the server 400 will only send the service credentials to the display device 200 when it is sure that the display device 200 has passed the authentication, the above embodiment can prevent illegal devices from stealing the service credentials of the display device 200 from the server 400, thereby ensuring the business credentials. security.
  • the implementation of the display device 200 generating the first device signature according to the first encryption key written in the display device 200 may include: the controller 250 of the display device 200 passing the first encryption key pair The first file is encrypted to obtain the first encrypted file; and summary information of the first file is obtained based on a preset algorithm, and the first device signature is generated based on the first encrypted file and the summary information.
  • the implementation of the server 400 to authenticate the display device 200 based on the first device signature may include: the server 400 parses the first device signature to obtain the first encrypted file and the summary information of the first file, based on The first decryption key corresponding to the first encryption key decrypts the first encrypted file to obtain the decrypted data corresponding to the first encrypted file, and then obtains the decrypted data corresponding to the first encrypted file based on the preset algorithm.
  • the controller 250 of the display device 200 in order to ensure the validity of the first encryption key written into the display device 200, after writing the first encryption key into the display device 200, the controller 250 of the display device 200 also A second device signature will be generated based on the first encryption key; the communicator 200 of the display device 200 will also send an authentication request carrying the second device signature to the server 400, and receive the authentication request sent by the server 400. Authentication response; the controller 250 of the display device 200 will also determine that the first encryption key is valid when the authentication response indicates that the display device has passed the authentication. If the display device fails to pass the authentication, it is determined that the first encryption key is invalid.
  • the server 400 authenticates the display device 200 based on the second device signature carried in the authentication request, and returns the authentication result to the display device 200.
  • the first encryption key is written into the display After the device 200 is installed, the validity of the first encryption key will also be verified. Therefore, the disclosed implementation can also avoid the display device 200 being unable to obtain the business certificate from the server 400 due to the invalid first encryption key written to the display device 200. This improves the reliability of writing business credentials to the display device.
  • the second encryption key server 400 is also uploaded to the server, and the display device 200 is also written with a second decryption key corresponding to the second encryption key.
  • the implementation of the server 400 sending the business voucher to the display device 200 may include: the server 400 sends to the display device 200 a second encrypted file that encrypts the business voucher using a second encryption key. After receiving the second encrypted file, the display device 200 obtains the second decryption key written to the display device, and decrypts the second encrypted file using the second decryption key to obtain the business voucher. .
  • one way for the server 400 to obtain the second encrypted file is to upload both the second encryption key and the business voucher to the server 400, and the server 400 encrypts the business voucher according to the second encryption key to obtain the second encrypted file.
  • File; Another implementation method for the server 400 to obtain the second encrypted file may be to directly upload the second encrypted file obtained by encrypting the business voucher with the second encryption key to the server 400 .
  • the communicator 220 of the display device 200 will also write the second decryption key into the display device 200.
  • obtain the third encrypted file obtained by encrypting the preset file based on the second encryption key from the server 400 and the controller 250 of the display device 200 will also use the second decryption key to encrypt the third encrypted file.
  • Perform decryption to obtain decrypted data and compare whether the decrypted data obtained by decrypting the third encrypted file is consistent with the preset file, and if the decrypted data is consistent with the preset file, determine the second decryption The secret key is valid.
  • the disclosed implementation can avoid writing the second decryption key to the display device 200.
  • the display device 200 cannot decrypt the encrypted business voucher due to the invalid decryption key, thereby improving the reliability of writing the business voucher to the display device.
  • the implementation of writing the second decryption key to the display device 200 may include: the memory of the display device 200 receives the written third decryption key based on The encryption key encrypts the fourth encrypted file obtained by encrypting the second decryption key.
  • the display device 200 controls the fourth encrypted file according to the third decryption key preset in the software system of the display device. Decrypt to obtain the second decryption key.
  • the third decryption key is the decryption key corresponding to the third encryption key.
  • the writing-related personnel or equipment can only obtain the fourth encrypted file obtained by encrypting the second decryption key based on the third encryption key, but cannot obtain the decryption Therefore, the above embodiment can prevent the second decryption key from being stolen during the writing process.
  • the display device 200 writes the first encryption key in an implementation manner that may include: the memory of the display device 200 receives the written third encryption-based
  • the display device 200 controls the fifth encrypted file obtained by encrypting the first encryption key with the secret key according to the third decryption key preset in the software system of the display device. decrypt to obtain Get the second decryption key.
  • the third decryption key is the decryption key corresponding to the third encryption key.
  • the writing-related personnel or equipment can only obtain the fifth encrypted file obtained by encrypting the first encryption key based on the third encryption key, but cannot obtain the decryption Therefore, the above embodiment can prevent the first encryption key from being stolen during the writing process.
  • Figure 31 shows a schematic interactive flow diagram of a business credential writing method according to some embodiments in an embodiment of the present disclosure.
  • the business credential writing method according to some embodiments includes the following steps:
  • the display device generates a first device signature according to the first encryption key written in the display device.
  • the first encryption key may be written to the display device in a production environment. That is, the first encryption key is written to the display device in the production environment.
  • the display device needs to obtain the business voucher, it reads the first encryption key written in the production environment and generates the first encryption key based on the first encryption key.
  • a device signature When the display device needs to obtain the business voucher, it reads the first encryption key written in the production environment and generates the first encryption key based on the first encryption key.
  • the first encryption key is used to authenticate the display device in the embodiment of the present disclosure, the first encryption key corresponds to the display device one-to-one, and each display device has a unique first encryption key.
  • the display device sends a certificate acquisition request carrying the signature of the first device to the server.
  • the server receives the certificate acquisition request sent by the display device and carries the signature of the first device.
  • the credential acquisition request is used to request the server to return the business credential corresponding to the display device when it is determined that the display device is authenticated based on the first device signature.
  • the credential acquisition request may be a registration request sent to the server when the display device is used online for the first time. After the server completes the authentication of the display device, it will send the business credentials corresponding to the display device to the display device.
  • the business certificate in the embodiment of the disclosure may be an MFI key, FairPlay Key, etc., which is not limited in the embodiment of the disclosure.
  • the server authenticates the display device according to the first device signature and the first decryption key corresponding to the first encryption key.
  • the first encryption key and the first decryption key have a one-to-one relationship, and each display device has a unique first encryption key.
  • the first encryption key and the first decryption key may be keys in a symmetric encryption algorithm. That is, the first encryption key and the first decryption key are the same.
  • the first encryption key and the first decryption key may be a key pair in an asymmetric encryption algorithm
  • the first encryption key is a public key in an asymmetric encryption algorithm
  • the secret key is the private key in the asymmetric encryption algorithm.
  • step S3103 if the server determines that the display device fails to pass authentication based on the first device signature and the first decryption key corresponding to the first encryption key, the server may determine that the display device does not have Obtain the authority for the business voucher, and therefore refuse to send the business voucher to the display device, and if the server determines the display based on the first device signature and the first decryption key corresponding to the first encryption key If the device authentication passes, the server can determine that the display device has the authority to obtain the business voucher, and therefore executes the following step S3104.
  • the server sends the service voucher to the display device.
  • the display device receives the service voucher sent by the server.
  • the display device writes the business voucher into a preset storage location of the display device.
  • the preset storage location may be a storage location in a trusted execution environment (Trusted execution environment, TEE) of the display device.
  • TEE trusted execution environment
  • Storing business credentials in a storage location in a trusted execution environment can prevent the business credentials from being stolen from the display device when they are written to the display device, thereby further improving the security of the business credentials.
  • the display device and business voucher writing method of some embodiments first generate a first device signature based on the first encryption key written to the display device, and then send a voucher acquisition request carrying the first device signature to the server. , and receive the business voucher sent by the server, and write the business voucher into a preset storage location of the display device.
  • the embodiment of the present disclosure since the embodiment of the present disclosure writes the business voucher to the display device by obtaining the business voucher from the server and writing the business voucher obtained from the server to the preset storage location, the embodiment of the present disclosure can be used in any Write business credentials to the display device at this stage, instead of being limited to writing business credentials to the display device in the production environment.
  • the embodiment of the present disclosure can prevent illegal devices from stealing the business voucher of the display device from the server, thereby ensuring the security of the business voucher.
  • the embodiments of the present disclosure can safely write business credentials to the display device after the display device is delivered, solving the problem of writing business credentials to the display device in the production environment that affects the production progress and cannot be rewritten. The problem.
  • the embodiment of the present disclosure provides another method of writing business credentials.
  • the interactive flow chart of the method of writing business credentials includes the following steps:
  • the display device encrypts the first file according to the first encryption key written in the display device, and obtains the first encrypted file.
  • the first file in the embodiment of the present disclosure can be any file.
  • the display device may randomly generate a text file containing a plurality of characters as the first file.
  • the display device obtains summary information of the first file based on a preset algorithm.
  • the above step S3202 (obtaining summary information of the first file based on a preset algorithm) may include:
  • Hash calculation is performed on the first file based on a hash algorithm, and a hash value obtained by hash calculation on the first file is used as the digest information of the first file.
  • the first file can be hashed based on the SHA256 algorithm (a hash algorithm with a hash value length of 256 bits), and the obtained hash value can be used as the digest information of the first file.
  • the SHA256 algorithm a hash algorithm with a hash value length of 256 bits
  • the display device generates the first device signature according to the first encrypted file and the summary information.
  • the first encrypted file and the summary information may be directly encapsulated into the same data.
  • data packet and the encapsulated data packet is used as the signature of the first device.
  • the display device sends a certificate acquisition request carrying the signature of the first device to the server.
  • the server receives the certificate acquisition request sent by the display device and carries the signature of the first device.
  • the credential acquisition request is used to request the server to return the business credential corresponding to the display device when it is determined that the display device is authenticated based on the first device signature.
  • S3205 The server parses the first device signature to obtain the first encrypted file and the summary information.
  • the server decrypts the first encrypted file using the first decryption key, and obtains the decrypted data corresponding to the first encrypted file.
  • the server obtains the summary information of the decrypted data corresponding to the first encrypted file through the preset algorithm.
  • the algorithm used by the server to obtain the summary information of the decrypted data corresponding to the first encrypted file is consistent with the algorithm used by the display device to obtain the summary information of the first file.
  • S3208 The server compares whether the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file.
  • the display device is a legal display device
  • the encryption key (first encryption key) for generating the first encrypted file and the decryption key (first decryption key) for decrypting the first encrypted file are a key pair
  • the decrypted data obtained by the server is the first file, and because the algorithm used by the display device and the server to obtain summary information is the same, the summary information obtained should also be the same
  • the display device is an illegal device, because the first encrypted data is generated
  • the encryption key of the file (first encryption key) and the decryption key (first decryption key) for decrypting the first encrypted file are not a key pair.
  • the decrypted data obtained by the server will not be the same as the first file, and thus This will cause the obtained summary information of the decrypted data to be different from the summary information of the first file. Therefore, in the embodiment of the present disclosure, it is possible to determine whether the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file. To determine whether the display device has passed the authentication.
  • step S3208 if the summary information of the decrypted data corresponding to the first encrypted file is different from the summary information of the first file, it can be determined that the display device fails to authenticate, and the message is never sent to the display device.
  • Business voucher if the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file, it can be determined that the display device has passed the authentication and the following subsequent steps are performed.
  • S3209 The server sends the service voucher to the display device.
  • the display device receives the service voucher sent by the server.
  • the display device writes the business voucher into a preset storage location of the display device.
  • the first encryption key written to the display device may be invalid because it is not the encryption key corresponding to the first decryption key, resulting in the display device being unable to obtain services from the server. certificate.
  • the business voucher writing method according to some embodiments also performs the writing on the display device. The validity of the first encryption key in the device is verified. Referring to Figure 33, the process of verifying the validity of the first encryption key written in the display device includes the following steps:
  • the display device generates a second device signature based on the first encryption key.
  • the implementation manner in which the display device generates the second device signature based on the first encryption key may be the same as the implementation manner in which the display device generates the second device signature based on the first encryption key.
  • the display device may generate a second device signature based on the first encryption key by encrypting a specified file using the first encryption key to obtain the second device signature.
  • the display device sends an authentication request carrying the signature of the second device to the server.
  • the server receives the authentication request sent by the display device and carries the signature of the second device.
  • the authentication request is used to request the server to authenticate the display device according to the second device signature.
  • the server authenticates the display device according to the second device signature and the first decryption key.
  • the display device generates the second device signature based on the first encryption key in the same manner as the display device generates the second device signature based on the first encryption key.
  • the server The implementation of authenticating the display device based on the first decryption key corresponding to the second device signature and the first encryption key is the same as the implementation of authenticating the display device based on the first device signature and the first encryption key.
  • the implementation of the first decryption key for authenticating the display device is the same.
  • the implementation of the display device generating a second device signature based on the first encryption key may include: encrypting a specified file using the first encryption key to obtain the second device signature, At this time, the server authenticates the display device according to the first decryption key corresponding to the second device signature and the first encryption key.
  • the implementation method may be: through the first decryption key pair. Decrypt the second encrypted file, obtain the decrypted data corresponding to the second encrypted file, and determine whether the authentication of the display device is based on whether the decrypted data corresponding to the second encrypted file is the same as the specified file. pass.
  • the server sends an authentication response to the display device.
  • the display device receives the authentication response sent by the server.
  • the authentication response is used to indicate that the display device has passed the authentication, or the display device has failed to pass the authentication.
  • step S3305 If the authentication response indicates that the display device has passed the authentication, the following step S3305 is executed. If the authentication response indicates that the display device fails the authentication, the following step S3306 is executed.
  • the disclosed implementation can avoid writing the first encryption key to the display device.
  • the display device cannot obtain business credentials from the server due to an invalid key.
  • triggering the verification of the validity of the first encryption key may be: in response to a user operation, starting to execute the process for verifying the validity of the first encryption key shown in Figure 33 .
  • the user enters the hidden entrance of the display device, such as: Settings – Sound – Advanced Advance Settings, and press the remote control button "2022" to open the Outgoing Quality Control (OQC) application, select the target virtual button in the application interface and confirm, then start executing as shown in Figure 33 A process for verifying the validity of the first encryption key.
  • OQC Outgoing Quality Control
  • Methods may include:
  • the server sends the second encrypted file to the display device.
  • the display device receives the second encrypted file sent by the server.
  • the second encrypted file is an encrypted file obtained by encrypting the business voucher based on a second encryption key.
  • the implementation of the server obtaining the second encrypted file may include: the server receives the uploaded business voucher and the second encryption key, and encrypts the business voucher based on the second encryption key, to obtain the second encrypted file.
  • the business voucher and the second encryption key are written to the server, and then the server encrypts the business voucher based on the second encryption key to generate the second encrypted file.
  • the implementation of the server obtaining the second encrypted file may include: the server receiving the uploaded second encrypted file.
  • the second encrypted file is directly written to the server.
  • the implementation of obtaining the second encrypted file by the server includes: the server receives the uploaded business voucher and the second encryption key, and encrypts the business voucher based on the second encryption key to obtain the
  • the second encrypted file is shown as an example, but in the embodiment of the present disclosure, the second encrypted file can also be directly uploaded to the server.
  • writing the second encrypted file to the server can prevent the business voucher from being stolen from the server, thereby further improving the security of the business voucher.
  • the display device obtains the second decryption key written in the display device.
  • the second decryption key is the decryption key corresponding to the second encryption key.
  • the second decryption key may be written to the display device in a production environment.
  • the second encryption key and the second decryption key may be keys in a symmetric encryption algorithm. That is, the first encryption key and the first decryption key are the same.
  • the second encryption key and the second decryption key may be a key pair in an asymmetric encryption algorithm
  • the second encryption key is a public key in an asymmetric encryption algorithm
  • the secret key is the private key in the asymmetric encryption algorithm.
  • the display device decrypts the second encrypted file using the second decryption key to obtain the business voucher.
  • the server sends encrypted business credentials to the display device
  • the above embodiment can avoid business The credentials are stolen during the process of being sent from the server to the display device, further improving the security of the business credentials.
  • the second decryption key written to the display device may be invalid because it is not the decryption key corresponding to the second encryption key, causing the display device to obtain the encrypted data from the server.
  • the business voucher After decrypting the business voucher (second encrypted file), the business voucher cannot be decrypted.
  • the business voucher writing method according to some embodiments also performs the writing on the display device. The validity of the second decryption key in the device is verified. Referring to Figure 35, the process of verifying the validity of the second decryption key written in the display device includes the following steps:
  • the server sends the third encrypted file to the display device.
  • the display device receives the third encrypted file sent by the server.
  • the third encrypted file is an encrypted file obtained by encrypting a preset file based on the second encryption key.
  • the display device decrypts the third encrypted file using the second decryption key, and obtains the decrypted data corresponding to the third encrypted file.
  • the display device compares whether the decrypted data corresponding to the third encrypted file is the same as the preset file.
  • step S3503 if the decrypted data corresponding to the third encrypted file is the same as the default file, the following step S3504 is executed, and if the decrypted data corresponding to the third encrypted file is different from the default file , then execute the following step S3505.
  • the disclosed implementation can avoid writing the second decryption key into the display device.
  • the display device cannot decrypt the encrypted business credentials due to an invalid key.
  • the process of writing the second decryption key to the display device generally involves first issuing the second decryption key to the production system of the display device, and then writing the second decryption key into the display device by the production system of the display device.
  • the second decryption key may be stolen from the production system.
  • the implementation of writing the second decryption key to the display device in the business voucher writing method may include follows these steps:
  • the display device receives the written fourth encrypted file.
  • the fourth encrypted file is an encrypted file obtained by encrypting the second decryption key based on the third encryption key.
  • the display device decrypts the fourth encrypted file according to the third decryption key preset in the software system of the display device to obtain the second decryption key.
  • the third decryption key is the decryption key corresponding to the third encryption key.
  • the third decryption key is configured in the software system of the display device in advance, and the second decryption key issued to the production system of the display device is obtained by encrypting the second decryption key with the third encryption key.
  • the production system of the display device directly writes the fourth encrypted file to the display device, and the display decrypts the fourth encrypted file using the third decryption key to obtain the second decryption key.
  • the third encryption key and the third decryption key may be keys in a symmetric encryption algorithm. That is, the third encryption key is the same as the third decryption key.
  • the third encryption key and the third decryption key may be a key pair in an asymmetric encryption algorithm
  • the third encryption key is a public key in an asymmetric encryption algorithm
  • the secret key is the private key in the asymmetric encryption algorithm.
  • the second decryption key of the production system issued to the display device is a fourth encrypted file obtained by encrypting the second decryption key with the third encryption key, even if the second decryption key is stolen, only the second decryption key can be stolen.
  • the ciphertext of the second decryption key cannot be obtained, but the plaintext of the second decryption key cannot be obtained. Therefore, the above embodiment can prevent the second decryption key from being stolen during the process of writing to the display device, thereby improving the efficiency of the second decryption key. safety.
  • the display device may decrypt the fourth encrypted file using a third decryption key after being written to the fourth encrypted file, and store the obtained second decryption key so that it is needed later. Read directly when using.
  • the display device can decrypt the fourth encrypted file using the third decryption key only when the second decryption key needs to be used, obtain the second decryption key, and delete it after use. Since the display device stores the ciphertext that is also the second decryption key, the embodiment of the present disclosure can also prevent the second decryption key from being stolen in the display device, thereby further improving the security of the second decryption key.
  • the process of writing the first encryption key to the display device generally involves first issuing the first encryption key to the production system of the display device, and then writing the first encryption key to the display device by the production system of the display device.
  • the first encryption key may also be stolen from the production system.
  • the implementation of writing the first encryption key to the display device in the business voucher writing method may include follow these steps:
  • the display device receives the fifth encrypted file written.
  • the fifth encrypted file is an encrypted file obtained by encrypting the first encryption key based on a third encryption key.
  • the display device decrypts the fifth encrypted file according to the third decryption key preset in the software system of the display device to obtain the first encryption key.
  • the third decryption key is the decryption key corresponding to the third encryption key.
  • the third decryption key is configured in the software system of the display device in advance, and the first encryption key of the production system issued to the display device is the first encryption key obtained by encrypting the first encryption key with the third encryption key.
  • Fifth encrypted file the production system of the display device directly writes the fifth encrypted file to the display device, and the display decrypts the fifth encrypted file through the third decryption key to obtain the first encryption key.
  • the first encryption key of the production system issued to the display device is a fifth encrypted file obtained by encrypting the first encryption key with the third encryption key, even if the first encryption key is stolen, only the first encryption key can be stolen. to obtain the ciphertext of the first encryption key, but cannot obtain the plaintext of the first encryption key. Therefore, the above embodiment can avoid the third An encryption key is stolen during the process of writing to the display device, thereby improving the security of the first encryption key.
  • the display device may decrypt the fifth encrypted file using a third decryption key after being written to the fifth encrypted file, and store the obtained first encryption key so that it is needed later. Read directly when using.
  • the display device can decrypt the fifth encrypted file using the third decryption key only when the first encryption key needs to be used, obtain the first encryption key, and delete it after use. Since the display device stores the ciphertext that is also the first encryption key, embodiments of the present disclosure can also prevent the first encryption key from being stolen in the display device, thereby further improving the security of the first encryption key.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Provided in the present disclosure are a display device and a processing method for a display device. The method comprises: after receiving an instruction, which is input by a user and is used for instructing to display a screen-mirroring function page, a display device acquires a device identifier in response to the instruction; if no valid device identifier is acquired, a screen-mirroring function is not enabled, and the display device is enabled in a black screen state, and at this moment, the display device displays prompt information, which is used for prompting a user that there is a problem with the device identifier; and after acquiring a valid device identifier, the display device enables the screen-mirroring function, and displays the screen-mirroring function page after the screen-mirroring function is enabled. Therefore, when a display device is in a black screen state, prompt information can be displayed to prompt a user of the cause of the black screen, thereby preventing the user from waiting in vain for a page to load.

Description

一种显示设备及用于显示设备的处理方法A display device and a processing method for the display device
相关申请的交叉引用Cross-references to related applications
本申请要求在2022年06月28日提交中国专利局、申请号为202210746808.9、要求在2022年07月07日提交中国专利局、申请号为202210803145.X,以及要求在2022年08月15日提交中国专利局、申请号为202210977484.X的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application is required to be submitted to the China Patent Office on June 28, 2022, with the application number 202210746808.9. It is required to be submitted to the China Patent Office on July 7, 2022, with the application number 202210803145.X, and it is required to be submitted on August 15, 2022. Priority is granted to the Chinese Patent Office and Chinese patent application with application number 202210977484.X, the entire content of which is incorporated into this application by reference.
技术领域Technical field
本公开涉及智能显示设备技术领域,尤其涉及一种显示设备及用于显示设备的处理方法。The present disclosure relates to the technical field of intelligent display devices, and in particular, to a display device and a processing method for the display device.
背景技术Background technique
显示设备是指能够输出具体显示画面的终端设备,可以是智能电视、移动终端、智能广告屏、投影仪等终端设备。以智能电视为例,智能电视是基于Internet应用技术,具备开放式操作系统与芯片,拥有开放式应用平台,可实现双向人机交互功能,集影音、娱乐、数据等多种功能于一体的电视产品,用于满足用户多样化和个性化需求。A display device refers to a terminal device that can output a specific display screen, which can be a smart TV, a mobile terminal, a smart advertising screen, a projector and other terminal devices. Take smart TVs as an example. Smart TVs are based on Internet application technology, have open operating systems and chips, have an open application platform, can realize two-way human-computer interaction functions, and integrate multiple functions such as audio-visual, entertainment, and data. Products are used to meet the diverse and personalized needs of users.
无线投屏又叫无线同屏、飞屏、屏幕共享,是指通过投屏协议将一个终端设备提供的投屏数据实时地显示于另一个终端设备上,投屏数据可以是媒体数据和实时操作画面等。用户在终端设备上使用无线投屏功能时,可以通过查看该终端设备的投屏功能页面,以了解和设置与该终端设备相关的投屏信息。但是,终端设备在显示投屏功能页面之前会呈现黑屏状态,导致用户盲目等待显示投屏功能页面,降低用户的使用体验感。Wireless screen projection, also known as wireless screen sharing, flying screen, and screen sharing, refers to displaying the screen projection data provided by one terminal device on another terminal device in real time through the screen projection protocol. The screen projection data can be media data and real-time operations. Screen etc. When users use the wireless screen mirroring function on a terminal device, they can learn and set screen mirroring information related to the terminal device by viewing the screen mirroring function page of the terminal device. However, the terminal device will display a black screen before displaying the screen projection function page, causing the user to blindly wait for the screen projection function page to be displayed, reducing the user's user experience.
发明内容Contents of the invention
本公开提供了一种显示设备,包括:显示器,被配置为显示投屏功能页面,所述投屏功能页面包含所述显示设备的投屏信息;控制器,被配置为:响应于用户输入的指示显示所述投屏功能页面的指令,获取设备标识,所述设备标识用于验证所述显示设备使用投屏功能的权限;若未获取到所述设备标识,或者根据获取到的所述设备标识验证所述显示设备不具有投屏功能的使用权限,则不启动投屏功能,并控制所述显示器呈黑屏状态,并显示提示信息;在根据获取到的所述设备标识验证所述显示设备具有投屏功能的使用权限之后,启动投屏功能,并在投屏功能启动之后控制所述显示器显示所述投屏功能页面。The present disclosure provides a display device, including: a display configured to display a screen projection function page that contains screen projection information of the display device; a controller configured to: respond to a user input Instructions for displaying the screen projection function page are obtained, and the device identification is used to verify the permission of the display device to use the screen projection function; if the device identification is not obtained, or according to the obtained device identification If the identification verifies that the display device does not have the permission to use the screen projection function, the screen projection function will not be started, and the display will be controlled to be in a black screen state, and a prompt message will be displayed; after the display device is verified according to the obtained device identification After having the permission to use the screen projection function, the screen projection function is started, and after the screen projection function is started, the display is controlled to display the screen projection function page.
本公开提供了一种用于显示设备的处理方法,所述方法包括:响应于用户输入的指示显示所述投屏功能页面的指令,获取设备标识,所述设备标识用于验证所述显示 设备使用投屏功能的权限;若未获取到所述设备标识,或者根据获取到的所述设备标识验证所述显示设备不具有投屏功能的使用权限,则不启动投屏功能,并控制所述显示器呈黑屏状态,并显示提示信息;在根据获取到的所述设备标识验证所述显示设备具有投屏功能的使用权限之后,启动投屏功能,并在投屏功能启动之后控制所述显示器显示所述投屏功能页面。The present disclosure provides a processing method for a display device. The method includes: in response to an instruction input by a user to display the screen projection function page, obtain a device identification, and the device identification is used to verify the display. The device has permission to use the screen projection function; if the device identification is not obtained, or it is verified based on the obtained device identification that the display device does not have the permission to use the screen projection function, the screen projection function will not be started and all controls will be controlled. The display is in a black screen state and displays a prompt message; after verifying that the display device has the permission to use the screen projection function based on the obtained device identification, the screen projection function is started, and the display is controlled after the screen projection function is started. The screen projection function page is displayed.
附图说明Description of drawings
图1为根据一些实施例的显示设备的使用场景;Figure 1 is a usage scenario of a display device according to some embodiments;
图2为根据一些实施例的显示设备的配置图;Figure 2 is a configuration diagram of a display device according to some embodiments;
图3为根据一些实施例的控制设备的配置框图;Figure 3 is a configuration block diagram of a control device according to some embodiments;
图4为根据一些实施例的显示设备的操作系统配置图;Figure 4 is an operating system configuration diagram of a display device according to some embodiments;
图5为根据一些实施例的信号源菜单的示意图;Figure 5 is a schematic diagram of a signal source menu according to some embodiments;
图6为根据一些实施例的投屏功能页面的示意图;Figure 6 is a schematic diagram of a screen casting function page according to some embodiments;
图7为根据一些实施例的显示投屏功能页面的过程中呈黑屏状态的流程示意图;Figure 7 is a schematic flowchart showing a black screen state during the process of displaying the screen projection function page according to some embodiments;
图8为根据一些实施例的用于显示设备的处理方法的流程示意图;Figure 8 is a flowchart of a processing method for a display device according to some embodiments;
图9为根据一些实施例的显示投屏功能页面的过程中呈黑屏状态时显示提示信息的流程示意图;Figure 9 is a schematic flowchart of displaying prompt information when the screen is in a black screen state during the process of displaying the screen projection function page according to some embodiments;
图10为根据一些实施例的显示投屏功能页面的过程中呈黑屏状态时显示提示信息的流程示意图;Figure 10 is a schematic flowchart of displaying prompt information when the screen is in a black screen state during the process of displaying the screen projection function page according to some embodiments;
图11为根据一些实施例的更新设备标识的流程示意图;Figure 11 is a schematic flowchart of updating device identification according to some embodiments;
图12为根据一些实施例的第一询问页面的示意图;Figure 12 is a schematic diagram of a first query page according to some embodiments;
图13为根据一些实施例的等待页面的示意图;Figure 13 is a schematic diagram of a waiting page according to some embodiments;
图14为根据一些实施例的重新下载页面的示意图;Figure 14 is a schematic diagram of a re-download page according to some embodiments;
图15为根据一些实施例的更新失败页面的示意图;Figure 15 is a schematic diagram of an update failure page according to some embodiments;
图16为根据一些实施例的实现无线投屏功能的底层架构示意图;Figure 16 is a schematic diagram of the underlying architecture for implementing the wireless screen projection function according to some embodiments;
图17为根据一些实施例的启动投屏功能并显示投屏功能页面的流程示意图;Figure 17 is a schematic flowchart of activating the screen casting function and displaying the screen casting function page according to some embodiments;
图18为根据一些实施例的启动投屏功能并显示投屏功能页面的通信示意图;Figure 18 is a communication diagram activating the screen casting function and displaying the screen casting function page according to some embodiments;
图19为根据一些实施例的启动投屏功能并显示投屏功能页面的通信示意图;Figure 19 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments;
图20为根据一些实施例的启动投屏功能并显示投屏功能页面的通信示意图;Figure 20 is a communication diagram activating the screen casting function and displaying the screen casting function page according to some embodiments;
图21为根据一些实施例的启动投屏功能并显示投屏功能页面的通信示意图;Figure 21 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments;
图22为根据一些实施例的启动投屏功能并显示投屏功能页面的通信示意图;Figure 22 is a communication diagram for activating the screen casting function and displaying the screen casting function page according to some embodiments;
图23为根据一些实施例的显示设备展示信号源页面的示意图;Figure 23 is a schematic diagram of a display device displaying a signal source page according to some embodiments;
图24为根据一些实施例的显示设备展示投屏信息页面的示意图;Figure 24 is a schematic diagram of a display device displaying a screen projection information page according to some embodiments;
图25为根据一些实施例的显示设备控制方法的流程示意图;Figure 25 is a schematic flowchart of a display device control method according to some embodiments;
图26为根据一些实施例的显示设备控制方法的流程示意图;Figure 26 is a schematic flowchart of a display device control method according to some embodiments;
图27为根据一些实施例的显示设备控制方法的流程示意图; Figure 27 is a schematic flowchart of a display device control method according to some embodiments;
图28为根据一些实施例的显示设备的界面跳转示意图;Figure 28 is a schematic diagram of an interface jump of a display device according to some embodiments;
图29为根据一些实施例的显示设备的界面跳转示意图;Figure 29 is a schematic diagram of an interface jump of a display device according to some embodiments;
图30为根据一些实施例的显示设备的界面跳转示意图;Figure 30 is a schematic diagram of an interface jump of a display device according to some embodiments;
图31为根据一些实施例的业务凭证写入方法的交互流程图;Figure 31 is an interactive flow chart of a business voucher writing method according to some embodiments;
图32为根据一些实施例的业务凭证写入方法的交互流程图;Figure 32 is an interactive flow chart of a business voucher writing method according to some embodiments;
图33为根据一些实施例的业务凭证写入方法的交互流程图;Figure 33 is an interactive flow chart of a business voucher writing method according to some embodiments;
图34为根据一些实施例的业务凭证写入方法的交互流程图;Figure 34 is an interactive flow chart of a business voucher writing method according to some embodiments;
图35为根据一些实施例的业务凭证写入方法的交互流程图;Figure 35 is an interactive flow chart of a business voucher writing method according to some embodiments;
图36为根据一些实施例的业务凭证写入方法的步骤流程图;Figure 36 is a step flow chart of a business voucher writing method according to some embodiments;
图37为根据一些实施例的业务凭证写入方法的步骤流程图。Figure 37 is a step flow chart of a business voucher writing method according to some embodiments.
具体实施方式Detailed ways
下面将详细地对实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下实施例中描述的实施方式并不代表与本公开相一致的所有实施方式。仅是与权利要求书中所详述的、本公开的一些方面相一致的系统和方法的示例。An embodiment will be described in detail below, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following examples do not represent all implementations consistent with the present disclosure. are merely examples of systems and methods consistent with some aspects of the disclosure as detailed in the claims.
需要说明的是,本公开中对于术语的简要说明,仅是为了方便理解接下来描述的实施方式,而不是意图限定本公开的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of terms in this disclosure is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of the disclosure. Unless otherwise stated, these terms should be understood according to their ordinary and usual meaning.
本公开中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明。应该理解这样使用的用语在适当情况下可以互换。The terms "first", "second", "third", etc. in the description and claims of this disclosure and the above-mentioned drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit specific Sequential or sequential order unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
本公开实施方式提供的显示设备可以具有多种实施形式,例如,可以是智能电视、激光投影设备、显示器(monitor)、电子白板(electronic bulletin board)、电子桌面(electronic table)等,也可以是手机、平板电脑、智能手表等带有显示屏的设备。图1和图2为本公开的显示设备的一种具体实施方式。The display device provided by the embodiment of the present disclosure can have a variety of implementation forms, for example, it can be a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc., or it can be Mobile phones, tablets, smart watches and other devices with displays. Figures 1 and 2 illustrate a specific implementation of the display device of the present disclosure.
图1为根据实施例中显示设备与控制设备之间操作场景的示意图。如图1所示,用户可通过移动终端300或控制设备100操作显示设备200。FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1 , the user can operate the display device 200 through the mobile terminal 300 or the control device 100 .
图3是控制设备100的配置框图。在一些实施例中,控制设备100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式中的至少一种,通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。FIG. 3 is a configuration block diagram of the control device 100. In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, and the display is controlled through wireless or wired methods. Equipment 200. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.
在一些实施例中,也可以使用移动终端300(如手机、平板电脑、计算机、笔记本电脑等)以控制显示设备200。例如,使用在移动终端300上运行的应用程序控制显示设备200。In some embodiments, a mobile terminal 300 (such as a mobile phone, tablet, computer, laptop, etc.) may also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the mobile terminal 300 .
图3示出了根据示例性实施例中显示设备200的配置框图。 FIG. 3 shows a configuration block diagram of the display device 200 according to an exemplary embodiment.
显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口280中的至少一种。The display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.
在一些实施例中,显示设备200可以通过通信器220与控制设备100或投屏设备建立控制信号和数据信号的发送和接收。在一些实施例中,控制器250和调谐解调器210可以位于不同的分体设备中,即调谐解调器210也可在控制器250所在的主体设备的外置设备中,如外置机顶盒等。在一些实施例中,控制器250,通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。在一些实施例中,控制器250包括中央处理器(Central Processing Unit,CPU),视频处理器,音频处理器,图形处理器(Graphics Processing Unit,GPU),RAM(Random Access Memory),ROM(Read-Only Memory),用于输入/输出的第一接口至第n接口,通信总线(Bus)等中的至少一种。在一些实施例中,显示器260包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件,用于接收源自控制器250输出的图像信号,进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面。在一些实施例中,显示器260可以为液晶显示器、OLED显示器、以及投影显示器,还可以为一种投影装置和投影屏幕。在一些实施例中,用户可在显示器260上显示的图形用户界面(Graphic User Interface,GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the screen projection device through the communicator 220 . In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. wait. In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. In some embodiments, the controller 250 includes a central processing unit (CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory), ROM (Read -Only Memory), at least one of the first to nth interfaces for input/output, communication bus (Bus), etc. In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, for receiving image signals output from the controller 250 and displaying video content, image content, and menu control interfaces. components and user control UI interface. In some embodiments, the display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen. In some embodiments, the user may input user commands in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
参见图4,在一些实施例中,将显示设备200的操作系统分为四层,从上至下分别为应用程序(Applications)层(简称“应用层”),应用程序框架(Application Framework)层(简称“框架层”),安卓运行时(Android runtime)和系统库层(简称“系统运行库层”),以及内核层。在一些实施例中,应用程序层中运行有至少一个应用程序,这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等;也可以是第三方开发者所开发的应用程序。应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心,这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口,可在执行中访问系统运行库层中的资源和取得系统的服务,并调用内核层中相应的驱动,以驱动相应的模块使用相应的资源执行相应的服务。Referring to Figure 4, in some embodiments, the operating system of the display device 200 is divided into four layers. From top to bottom, they are the Applications layer (referred to as the "Application layer") and the Application Framework layer. (referred to as "framework layer"), Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and kernel layer. In some embodiments, at least one application program runs in the application layer. These applications can be the window program, system setting program or clock program that comes with the operating system; they can also be developed by third-party developers. s application. The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides the actions for the applications in the application layer. Through the API interface, the application can access the resources in the system runtime layer and obtain system services during execution, and call the corresponding driver in the kernel layer to drive the corresponding module to use the corresponding resources to perform the corresponding services.
显示设备200可以通过投屏协议与终端设备建立连接,并显示该终端设备提供的投屏数据,该终端设备可以是手机、平板电脑、计算机、笔记本电脑等。以图1所示的场景为例,显示设备200与移动终端300通过投屏协议建立连接,移动终端300将画面数据传输至显示设备200,以令显示设备200实时显示移动终端300所显示的画面。显示设备200的投屏功能页面包含显示设备200的投屏信息,用户通过浏览投屏 功能页面,可以了解显示设备200的投屏信息,并设置显示设备200的投屏功能。The display device 200 can establish a connection with a terminal device through a screen projection protocol, and display the screen projection data provided by the terminal device. The terminal device can be a mobile phone, a tablet computer, a computer, a laptop, etc. Taking the scene shown in Figure 1 as an example, the display device 200 and the mobile terminal 300 establish a connection through the screen projection protocol, and the mobile terminal 300 transmits the screen data to the display device 200, so that the display device 200 displays the screen displayed by the mobile terminal 300 in real time. . The screen casting function page of the display device 200 contains the screen casting information of the display device 200. The user can cast the screen by browsing On the function page, you can learn the screen projection information of the display device 200 and set the screen projection function of the display device 200 .
可以将投屏功能页面的入口设置在显示设备200的功能菜单中,例如设置(Setting)菜单、信号源(Input)菜单等。用户可以通过操控控制设备100输入显示投屏功能页面的入口所在功能菜单的指令,以控制显示设备200显示该功能菜单,然后用户通过操控控制设备100选择投屏功能页面的入口,以控制显示设备200显示投屏功能页面。以控制设备100为遥控器,投屏功能页面的入口设置在信号源菜单中为例,对显示投屏功能页面的过程进行说明。用户通过操控遥控器向显示设备200发送显示信号源菜单的指令,例如,遥控器上设置有信号源按键,用户通过按压该信号源按键以向显示设备200发送指令,显示设备200接收到该指令之后,通过识别键值“信号源”,以判定该指令为指示显示信号源菜单的指令,显示设备200响应于该指令显示信号源菜单。以图5所示的信号源菜单为例,该信号源菜单包括多个信号源选项,如电视(TV)、无线播放(AirPlay)、高清多媒体(High Definition Multimedia Interface,HDMI)等。其中,无线播放是投屏功能页面的入口。用户通过操控遥控器将焦点移动至无线播放的选项上,并通过按压遥控器上的“确认”按键,以向显示设备200发送显示投屏功能页面的指令,显示设备200响应于该指令,显示投屏功能页面。投屏功能页面包含显示设备200的投屏信息以及设置显示设备200投屏功能的选项,以图6所示的投屏功能页面为例进行说明,该投屏功能页面包括显示设备200当前接入的Wi-Fi网络,显示设备200所要连接的终端设备,设置无线投屏和智慧家庭平台(AirPlay and HomeKit Settings)的功能选项,以及投屏选项,如无线投屏选项601和隔空投送602。该投屏功能页面还包括一些相关的指示语,以指示用户进行相关操作。显示设备200当前接入Wi-Fi1,并且选择与客厅内的设备A连接。用户可以通过设置无线投屏和智慧家庭平台的功能,重新选择所要接入的Wi-Fi网络以及所要连接的终端设备,并通过选择投屏选项选择显示设备200与终端设备之间的投屏方式。The entrance to the screen projection function page can be set in the function menu of the display device 200, such as the Setting (Setting) menu, the signal source (Input) menu, etc. The user can control the display device 200 to display the function menu by inputting an instruction to display the function menu where the entrance to the screen projection function page is by manipulating the control device 100 , and then the user selects the entrance to the screen projection function page by manipulating the control device 100 to control the display device. 200 displays the screen projection function page. Taking the control device 100 as a remote controller and the entrance to the screen projection function page being set in the signal source menu as an example, the process of displaying the screen projection function page will be described. The user sends an instruction to display the signal source menu to the display device 200 by controlling the remote control. For example, the remote control is provided with a signal source button. The user sends an instruction to the display device 200 by pressing the signal source button, and the display device 200 receives the instruction. Afterwards, by identifying the key value "signal source" to determine that the instruction is an instruction to display the signal source menu, the display device 200 displays the signal source menu in response to the instruction. Take the signal source menu shown in Figure 5 as an example. The signal source menu includes multiple signal source options, such as TV (TV), wireless playback (AirPlay), high-definition multimedia (High Definition Multimedia Interface, HDMI), etc. Among them, wireless playback is the entrance to the screen projection function page. The user moves the focus to the wireless playback option by controlling the remote control, and presses the "Confirm" button on the remote control to send an instruction to display the screen projection function page to the display device 200. In response to the instruction, the display device 200 displays Screencast function page. The screen casting function page includes screen casting information of the display device 200 and options for setting the screen casting function of the display device 200. Take the screen casting function page shown in Figure 6 as an example for explanation. The screen casting function page includes the current access of the display device 200. Wi-Fi network, display the terminal device to which the device 200 is connected, set the function options of wireless screen casting and smart home platform (AirPlay and HomeKit Settings), and screen casting options, such as wireless screen casting option 601 and airdrop 602. The screencasting function page also includes some related instructions to instruct the user to perform related operations. The display device 200 is currently connected to Wi-Fi1 and chooses to connect to device A in the living room. The user can reselect the Wi-Fi network to be accessed and the terminal device to be connected by setting the functions of wireless screen projection and smart home platform, and select the screen projection method between the display device 200 and the terminal device by selecting the screen projection option. .
显示设备200可以显示投屏功能页面的基础是显示设备200具有投屏功能的使用权限,也就是说,显示设备200只有具有投屏功能的使用权限,才能够显示投屏功能页面,如果显示设备200不具有投屏功能的使用权限,则不能显示投屏功能页面,此时,显示设备200将呈黑屏状态。以图5所示信号源菜单(同图7中①)为例进行说明,用户通过操控遥控器基于无线投屏选项输入指令,显示设备200如果不具有投屏功能的使用权限,则呈黑屏状态,如图7中②所示。在本公开实施例中,黑屏状态是指不显示任何页面。当显示设备200不具有投屏功能的使用权限而呈黑屏状态时,用户并不能获知呈黑屏状态的原因,也无法确定解决黑屏的方法,只能选择盲目等待显示设备200显示投屏功能页面,而事实上,显示设备200后续并不会显示投屏功能页面,导致用户等待无效。即使用户选择退出该投屏功能页面,并通过重新选择无线投屏选项,以重新进入投屏功能页面,由于显示设备200仍然不具有投屏功能的使用权限,显示设备200仍然会呈黑屏状态。The basis that the display device 200 can display the screen casting function page is that the display device 200 has the permission to use the screen casting function. That is to say, the display device 200 can only display the screen casting function page if it has the permission to use the screen casting function. If the display device 200 has the permission to use the screen casting function, If 200 does not have the permission to use the screen mirroring function, it cannot display the screen mirroring function page. At this time, the display device 200 will be in a black screen state. Taking the signal source menu shown in Figure 5 (the same as ① in Figure 7) as an example, the user controls the remote control to input instructions based on the wireless screen projection option. If the display device 200 does not have the permission to use the screen projection function, the screen will be in a black state. , as shown in ② in Figure 7. In the embodiment of the present disclosure, the black screen state means that no page is displayed. When the display device 200 does not have the permission to use the screen projection function and displays a black screen state, the user cannot know the reason for the black screen state and cannot determine a method to solve the black screen. The user can only choose to wait blindly for the display device 200 to display the screen projection function page. In fact, the display device 200 will not display the screen projection function page subsequently, causing the user to wait ineffectively. Even if the user chooses to exit the screen mirroring function page and re-enters the screen mirroring function page by re-selecting the wireless screen mirroring option, the display device 200 will still be in a black screen state because the display device 200 still does not have the permission to use the screen mirroring function.
为了解决上述显示设备200在显示投屏功能页面的过程中,由于无投屏功能的使 用权限而呈黑屏状态的问题,显示设备200可以按照如图8所示的流程显示投屏功能页面,具体步骤如下:In order to solve the problem that when the above display device 200 displays the screen projection function page, due to the lack of screen projection function, To solve the problem of black screen due to permission usage, the display device 200 can display the screen projection function page according to the process shown in Figure 8. The specific steps are as follows:
S801,显示设备200响应于用户输入的指示显示投屏功能页面的指令,获取设备标识。S801: The display device 200 acquires the device identifier in response to an instruction input by the user indicating that the screen projection function page is displayed.
在本公开实施例中,设备标识与显示设备200唯一对应,可以称为显示设备200的key,设备标识用于验证显示设备200是否具有投屏功能的使用权限。设备标识可以是显示设备200的设备身份(Identity,ID)等,通常由显示设备200的生产商将获取设备标识的方式(如存储地址等)烧录预制在显示设备200内,显示设备200在运行时,如果需要使用设备标识,则根据预制的获取方式通过互联网获取设备标识。In the embodiment of the present disclosure, the device identifier uniquely corresponds to the display device 200 and can be called the key of the display device 200. The device identifier is used to verify whether the display device 200 has the permission to use the screen projection function. The device identification may be the device identity (Identity, ID) of the display device 200, etc. Usually, the manufacturer of the display device 200 will burn and pre-program the method of obtaining the device identification (such as a storage address, etc.) into the display device 200. The display device 200 will At runtime, if the device identity needs to be used, the device identity is obtained through the Internet according to the prefabricated acquisition method.
投屏功能属于显示设备200的增强体验(Enhanced Experience)功能,显示设备200在使用投屏功能之前,需要验证显示设备200是否具有投屏功能的使用权限,该使用权限可以包括显示设备200的系统版本是否支持投屏功能、显示设备200的设备身份是否可信以支持投屏功能等。只有在显示设备200通过验证时,才可以使用投屏功能,以保证投屏功能使用的有效性、安全性等。The screen casting function belongs to the enhanced experience (Enhanced Experience) function of the display device 200. Before using the screen casting function, the display device 200 needs to verify whether the display device 200 has the permission to use the screen casting function. The permission can include the system of the display device 200. Whether the version supports the screen casting function, whether the device identity of the display device 200 is trustworthy to support the screen casting function, etc. Only when the display device 200 passes the verification, the screen projection function can be used to ensure the effectiveness, safety, etc. of using the screen projection function.
显示设备200在接收到用户输入的指示显示投屏功能页面的指令之后,响应于该指令,获取设备标识以验证是否具有投屏功能的使用权限。After receiving an instruction input by the user instructing to display the screen projection function page, the display device 200 responds to the instruction and obtains the device identification to verify whether it has permission to use the screen projection function.
S802,显示设备200若未获取到设备标识,或者根据获取到的设备标识验证不具有投屏功能的使用权限,则不启动投屏功能,并呈黑屏状态,以及显示提示信息。S802. If the display device 200 does not obtain the device identification, or verifies that it does not have the permission to use the screen projection function based on the obtained device identification, the display device 200 does not start the screen projection function, displays a black screen state, and displays a prompt message.
显示设备200未获取到设备标识时,可以直接判定不具备投屏功能的使用权限。When the display device 200 does not obtain the device identification, it can directly determine that it does not have the right to use the screen projection function.
显示设备200获取到设备标识之后,需要根据获取到的设备标识进一步验证显示设备200是否具有投屏功能的使用权限。After the display device 200 obtains the device identification, it needs to further verify whether the display device 200 has the permission to use the screen projection function based on the obtained device identification.
例如:显示设备200根据预设的验证算法计算设备标识对应的验证值。其中,如果该验证值与预设具有投屏功能的使用权限的验证值一致,则验证通过,即显示设备200具有投屏功能的使用权限。如果该验证值与预设具有投屏功能的使用权限的验证值不同,则验证不通过,即显示设备200不具有投屏功能的使用权限。For example: the display device 200 calculates the verification value corresponding to the device identification according to a preset verification algorithm. If the verification value is consistent with the verification value preset for the use authority of the screen projection function, the verification is passed, that is, the display device 200 has the use authority of the screen projection function. If the verification value is different from the verification value preset for the use permission of the screen projection function, the verification fails, that is, the display device 200 does not have the use permission of the screen projection function.
又如:显示设备200根据预设的映射关系确定设备标识对应的使用权限。其中,如果该设备标识对应的使用权限是允许使用,则验证通过,即显示设备200具有投屏功能的使用权限。如果该设备标识对应的使用权限是禁止使用,则验证不通过,即显示设备200不具有投屏功能的使用权限。Another example: the display device 200 determines the usage rights corresponding to the device identification according to the preset mapping relationship. If the usage permission corresponding to the device identification is allowed, the verification is passed, that is, it is shown that the device 200 has the usage permission for the screen projection function. If the usage permission corresponding to the device identification is prohibited, the verification fails, that is, the display device 200 does not have the usage permission for the screen projection function.
如果显示设备200不具有投屏功能的使用权限,则不启动投屏功能,并呈黑屏状态。显示设备200基于上述过程可以确定不具有投屏功能的使用权限的原因是设备标识存在问题(未获取到,或者未通过验证),显示设备200显示提示信息,以通过该提示信息提示用户出现黑屏状态的原因是设备标识存在问题。If the display device 200 does not have the permission to use the screen projection function, the screen projection function will not be started and the screen will be in a black state. Based on the above process, the display device 200 can determine that the reason for not having the permission to use the screen projection function is that there is a problem with the device identification (not obtained, or failed to pass verification), and the display device 200 displays a prompt message to prompt the user to have a black screen. The reason for the status is a problem with the device identification.
提示信息可以包括提示设备标识存在问题的信息,如文本和图标,还可以包括用于查看与设备标识相关信息的快捷选项。The prompt information may include information that prompts a problem with the device identity, such as text and icons, and may also include shortcut options for viewing information related to the device identity.
以图5所示信号源菜单(同图9中①)为例,用户通过操控遥控器基于无线投屏 选项输入指令,显示设备200如果不具有投屏功能的使用权限,则呈黑屏状态,并且显示提示信息,如图9中②所示。该提示信息包括“请检查设备标识”以及图标901。用户通过阅读该提示信息,可以快速了解出现黑屏状态的原因是设备标识出现问题,可以通过检查设备标识的方式来解决黑屏的问题,从而避免用户盲目等待页面加载。Taking the signal source menu shown in Figure 5 (same as ① in Figure 9) as an example, the user controls the remote control to project the screen wirelessly. After the option input command, if the display device 200 does not have the permission to use the screen projection function, the screen will be black and a prompt message will be displayed, as shown in ② in Figure 9 . The prompt information includes "Please check the device identification" and icon 901. By reading this prompt information, users can quickly understand that the reason for the black screen state is a problem with the device identification. The black screen problem can be solved by checking the device identification, thereby preventing the user from blindly waiting for the page to load.
以在显示设备200的主页(Home)查看与设备标识相关信息,以图5所示信号源菜单(同图10中①)为例,与图9中②的区别在于,显示设备200如果不具有投屏功能的使用权限,所显示的提示信息还包括快捷选项1001,快捷选项1001为显示信号源菜单的入口,如图10中②所示。由此,用户不仅能够快速了解出现黑屏状态的原因是设备标识出现问题,可以通过检查设备标识的方式来解决黑屏问题,并且可以通过选择快捷选项1001直接返回信号源菜单,以从信号源菜单进入主页查看设备标识的相关信息,从而提高用户的操作便捷度。Take the information related to the device identification on the homepage (Home) of the display device 200, and take the signal source menu shown in Figure 5 (the same as ① in Figure 10) as an example. The difference from ② in Figure 9 is that if the display device 200 does not have Regarding the permission to use the screen projection function, the displayed prompt information also includes shortcut option 1001. Shortcut option 1001 is the entrance to the signal source menu, as shown in ② in Figure 10. From this, the user can not only quickly understand that the cause of the black screen state is a problem with the device identification, but can also solve the black screen problem by checking the device identification, and can directly return to the signal source menu by selecting shortcut option 1001 to enter from the signal source menu. View relevant information about device identification on the home page, thereby improving user convenience.
显示设备200显示提示信息,可以通过操作系统中的原生应用实现,如通过通知(Notification)应用实现。显示设备200通过监听投屏功能的启动通知验证投屏功能的使用权限,并在验证未通过时,直接调用通知应用以显示通知,通知的内容即为提示信息。由此,显示设备200中无需额外配置专用于显示提示信息的第三方应用。The display device 200 displays prompt information, which can be implemented through a native application in the operating system, such as a notification (Notification) application. The display device 200 verifies the permission to use the screen mirroring function by monitoring the startup notification of the screen mirroring function, and when the verification fails, directly calls the notification application to display the notification, and the content of the notification is the prompt information. Therefore, there is no need to additionally configure a third-party application dedicated to displaying prompt information in the display device 200 .
用户在浏览提示信息之后,可以基于该提示信息自行检查设备标识,并获取新的设备标识以令显示设备200具有投屏功能的使用权限,从而解决黑屏的问题。After browsing the prompt information, the user can check the device identification based on the prompt information and obtain a new device identification so that the display device 200 has the permission to use the screen projection function, thereby solving the black screen problem.
为了便于用户操作,以及防止用户不知道如何获取新的设备标识时无法解决黑屏的情况,显示设备200被配置为,在设备标识存在问题时,主动为用户提供解决路径。显示设备200还显示第一入口,该第一入口用于进入显示设备200提供的解决设备标识无效的相关页面。In order to facilitate user operations and prevent users from being unable to solve the black screen situation when they do not know how to obtain a new device identification, the display device 200 is configured to proactively provide the user with a solution path when there is a problem with the device identification. The display device 200 also displays a first portal, which is used to enter a related page provided by the display device 200 to resolve invalid device identification.
在一些实施例中,第一入口可以是一个独立入口。在一些实施例中,第一入口可以是提示信息所在的信息窗,如图9中②的信息窗902,又如图10中②的信息窗1002。In some embodiments, the first entrance may be an independent entrance. In some embodiments, the first entrance may be the information window where the prompt information is located, such as the information window 902 of ② in Figure 9, and the information window 1002 of ② in Figure 10.
显示设备200可以按照图11所示的流程解决设备标识存在问题的情况,具体步骤如下:The display device 200 can solve the problem of device identification according to the process shown in Figure 11. The specific steps are as follows:
S1101,显示设备200响应于用户基于第一入口输入的进入指令,显示第一询问页面。S1101. The display device 200 displays the first query page in response to the entry instruction input by the user based on the first portal.
以控制设备100为遥控器,以图9中②的页面为例。用户通过操控遥控器将焦点移动至信息窗902上,并通过按压遥控器上的“确认”按键,以向显示设备200输入进入指令。显示设备200响应于该进入指令,显示第一询问页面。第一询问页面用于询问用户是否再次获取设备标识,即是否需要由显示设备200解决设备标识有问题的情况。可以参考图12所示的第一询问页面,该第一询问页面包括提示文本,以提示用户即将要进行的操作,如“更新设备标识”,即提示用户即将要更新设备标识。该第一询问页面还包括操作选项,如更新选项1201和取消选项1202。其中,更新选项1201用于用户输入指示显示设备200执行提示文本中所示操作的指令,如更新设备标识。取消选项1202用于用户输入指示显示设备200终止解决设备标识有问题的相关任务。 Taking the control device 100 as a remote controller, take the page ② in Figure 9 as an example. The user moves the focus to the information window 902 by manipulating the remote control, and inputs an entry command to the display device 200 by pressing the "confirm" button on the remote control. The display device 200 displays the first inquiry page in response to the entry instruction. The first inquiry page is used to ask the user whether to obtain the device identification again, that is, whether the display device 200 needs to solve the problem of the device identification. Reference may be made to the first inquiry page shown in Figure 12. The first inquiry page includes prompt text to prompt the user for an upcoming operation, such as "update device identification", that is, to prompt the user that the device identification is about to be updated. The first query page also includes operation options, such as update option 1201 and cancel option 1202 . Among them, the update option 1201 is used for the user to input an instruction instructing the display device 200 to perform the operation shown in the prompt text, such as updating the device identification. The cancel option 1202 is used for user input to instruct the display device 200 to terminate the task related to resolving the device identification problem.
S1102,显示设备200响应于用户输入的指示重新获取设备标识的指令,获取设备标识,并显示等待页面。S1102. The display device 200 responds to the instruction input by the user to re-obtain the device identification, obtains the device identification, and displays the waiting page.
以图12所示的第一询问页面为例,用户通过操控遥控器将焦点移动至更新选项1201上,并通过按压遥控器的“确认”按键,以向显示设备200输入指示重新获取设备标识的指令。显示设备200响应于该指令,重新获取设备标识。例如:显示设备200调用重置(Reset)接口,以重新获取设备标识。显示设备200重新获取设备标识的过程与步骤S801类似,此处不再赘述。Taking the first inquiry page shown in FIG. 12 as an example, the user moves the focus to the update option 1201 by controlling the remote control, and presses the "confirm" button of the remote control to input an instruction to the display device 200 to re-obtain the device identity. instruction. In response to the instruction, the display device 200 reacquires the device identification. For example: the display device 200 calls a reset (Reset) interface to re-obtain the device identity. The process of the display device 200 re-acquiring the device identification is similar to step S801 and will not be described again here.
显示设备200在重新获取设备标识时,显示等待页面。该等待页面包括等待提示信息,以提示用户显示设备200正在重新获取设备标识。该等待提示信息可以包括文本信息、图标等。以图13所示的等待页面为例,该等待页面包括文本信息“正在更新设备标识,请等待”,以及倒计时图标1301。倒计时图标1301可以直观地展示显示设备200获取设备标识所需的剩余时长,和/或显示设备200获取设备标识的进度。倒计时图标1301包括时长数值、进度图标、或者同时包含时长数值和进度图标。其中,时长数值用于表示显示设备200获取到设备标识的剩余时长,时长数值采用倒计时的显示方式,时长数值的初始时长数值为显示设备200获取到设备标识的总时长,当时长数值为0时,表示显示设备200此次获取设备标识的任务执行完毕。进度图示用于表示显示设备200获取设备标识的进度,显示设备200获取设备标识的进度与获取到设备标识的总时长相匹配,即获取到设备标识的总时长越长,获取设备标识的进度越慢;反之,获取到设备标识的总时长越短,获取设备标识的进度越快。进度图示包括两部分,一部分对应于完整的进度图示,表示显示设备200获取设备标识的总进度,完成该总进度的总时长与显示设备200获取到设备标识的总时长相等,另一部分表示显示设备200获取设备标识已经完成的进度,该两部分的差异部分即为显示设备200获取设备标识还未完成的进度。When the display device 200 reacquires the device identification, it displays a waiting page. The waiting page includes waiting prompt information to prompt the user that the display device 200 is reacquiring the device identity. The waiting prompt information may include text information, icons, etc. Taking the waiting page shown in Figure 13 as an example, the waiting page includes text information "Updating device identification, please wait" and a countdown icon 1301. The countdown icon 1301 can visually display the remaining time required for the display device 200 to obtain the device identification, and/or the progress of the display device 200 in obtaining the device identification. The countdown icon 1301 includes a duration value, a progress icon, or both a duration value and a progress icon. Among them, the duration value is used to represent the remaining time for the display device 200 to obtain the device identification. The duration value adopts a countdown display method. The initial duration value of the duration value is the total time for the display device 200 to obtain the device identification. When the duration value is 0 , indicating that the display device 200 has completed the task of obtaining the device identity this time. The progress icon is used to represent the progress of the display device 200 in obtaining the device identification. The progress of the display device 200 in obtaining the device identification matches the total time for obtaining the device identification. That is, the longer the total time for obtaining the device identification, the longer the progress of obtaining the device identification. The slower it is; conversely, the shorter the total time to obtain the device identification is, the faster the progress of obtaining the device identification is. The progress icon includes two parts. One part corresponds to the complete progress icon, indicating the total progress of the display device 200 in obtaining the device identification. The total time to complete the total progress is equal to the total time in which the display device 200 obtains the device identification. The other part represents The display device 200 has completed the progress of obtaining the device identification, and the difference between the two parts is the progress of the display device 200 obtaining the device identification that has not yet been completed.
显示设备200获取设备标识的总时长可以是一个预设的固定值,也可以是显示设备200基于当前网络环境等实时计算的一个动态值。显示设备200确定获取设备标识的总时长之后,可以通过计时器(Time)功能开始计时,倒计时图标1301中显示的时长数值是总时长与计时器所计时长的差值。倒计时图标1301中进度图示可以按照计时器的N(N>0)个时长单元显示已完成的进度,例如,进度图示按照计时器的1个时长单元显示已完成的进度,此时,计时器每增加1个时长单元,进度图示增加显示1个时长单元对应的已完成的进度。又如,进度图示按照计时器的3个时长单元显示已完成的进度,此时,计时器每增加3个时长单元,进度图示增加显示3个时长单元对应的已完成的进度。The total time for the display device 200 to obtain the device identification may be a preset fixed value, or it may be a dynamic value calculated in real time by the display device 200 based on the current network environment and the like. After the display device 200 determines the total time for obtaining the device identification, it can start timing through the timer (Time) function. The time value displayed in the countdown icon 1301 is the difference between the total time and the time measured by the timer. The progress icon in the countdown icon 1301 can display the completed progress according to N (N>0) time units of the timer. For example, the progress icon displays the completed progress according to 1 time unit of the timer. At this time, the timer Every time the device adds 1 duration unit, the progress icon increases to show the completed progress corresponding to 1 duration unit. For another example, the progress icon displays the completed progress according to the 3 time units of the timer. At this time, every time the timer increases by 3 time units, the progress icon increases and displays the completed progress corresponding to the 3 time units.
以获取设备标识的总时长为12s,以计时器的计时单元为1s,且当前所计时长为3s,以进度图示为一个圆环为例。显示设备200显示倒计时图标1301,其中,时长数值为9s,即显示设备200获取到设备标识的剩余时长是9s,进度图示中白色部分表示已完成进度,白色部分的面积为圆环的四分之一,表示显示设备200已完成获取设备 标识的总进度的四分之一。Assume that the total time to obtain the device identification is 12 seconds, the timing unit of the timer is 1 second, and the current time duration is 3 seconds, and the progress icon is a ring as an example. The display device 200 displays a countdown icon 1301, in which the duration value is 9s, that is, the remaining time for the display device 200 to obtain the device identification is 9s. The white part in the progress icon represents the completed progress, and the area of the white part is four quarters of the ring. one, indicating that the display device 200 has completed obtaining the device One quarter of the total progress identified.
显示设备200在重新获取设备标识之后,需要再次验证是否具有投屏功能的使用权限,其中,显示设备200再次验证是否具有投屏功能的使用权限的过程与步骤S802类似,此处不再赘述。After reacquiring the device identification, the display device 200 needs to verify again whether it has the permission to use the screen casting function. The process of re-verifying whether the display device 200 has the permission to use the screen casting function is similar to step S802 and will not be described again here.
在一些实施例中,显示设备200可以被配置为,仅为用户提供一次重新获取设备标识的服务,即显示设备200在重新获取设备标识之后,如果仍未通过验证,即仍不具有投屏功能的使用权限,则不再为用户提供重新获取设备标识的服务。由此,减少重新获取设备标识的次数,可以有效避免重复获取设备标识的过程所耗费的时间,以降低对用户体验感的影响。In some embodiments, the display device 200 may be configured to only provide the user with a service of re-obtaining the device identity once. That is, if the display device 200 still does not pass the verification after re-acquiring the device identity, it still does not have the screen casting function. If the user has the right to use the device, the user will no longer be provided with the service of re-obtaining the device identity. Therefore, reducing the number of times of re-obtaining the device identification can effectively avoid the time-consuming process of repeatedly obtaining the device identification, thereby reducing the impact on the user experience.
在一些实施例中,显示设备200可以被配置为,为用户提供多次重新获取设备标识的服务,即显示设备200在重新获取设备标识之后,如果仍未通过验证,则会继续为用户提供重新获取设备标识的服务,并在接收到用户输入的指示再次获取设备标识的指令之后,再次获取设备标识,直至达到重新获取设备标识的次数上限,显示设备200不再为用户提供重新获取设备标识的服务。由此,可以通过多次重新获取设备标识的方式,提高获取到有效设备标识的成功率,以提高用户的体验感。示例地,显示设备200如果仍未通过验证,则显示重新下载页面,可以参考图14所示的重新下载页面,该重新下载页面包含提示文本,以提示用户即将要进行的操作,如“更新设备标识”,即提示用户即将要更新设备标识。该重新下载页面还包括操作选项,如再次尝试(Retry)选项1401和取消选项1402。其中,再次尝试选项1401用于用户输入指示显示设备200再次获取设备标识。取消选项1402用于用户输入指示显示设备200终止解决设备标识有问题的相关任务。以控制设备100为遥控器为例进行说明,用户通过操控遥控器将焦点移动至再次尝试选项1401上,并通过按压遥控器的“确认”按键,以向显示设备200输入再次获取设备标识的指示。显示设备200响应于该指示再次获取设备标识的过程与步骤S1102类似,此处不再赘述。假设显示设备200重新获取设备标识的次数上限为5次,当显示设备200统计获取设备标识的次数等于5次,且在第5次获取设备标识之后,仍未通过验证,显示设备200不再为用户提供重新获取设备标识的服务。In some embodiments, the display device 200 may be configured to provide the user with a service of re-obtaining the device identity multiple times. That is, after the display device 200 re-obtains the device identity, if the verification still fails, the display device 200 will continue to provide the user with the service of re-acquiring the device identity. Obtain the service of device identification, and after receiving the instruction input by the user to obtain the device identification again, obtain the device identification again until the upper limit of the number of times of re-obtaining the device identification is reached, and the display device 200 no longer provides the user with the method of re-obtaining the device identification. Serve. Therefore, the success rate of obtaining a valid device identity can be improved by re-obtaining the device identity multiple times, thereby improving the user experience. For example, if the display device 200 still fails to pass the verification, a re-download page is displayed. Refer to the re-download page shown in FIG. Identity", which prompts the user that the device identification is about to be updated. The re-download page also includes operation options, such as a Retry option 1401 and a Cancel option 1402 . Among them, the try again option 1401 is used for user input to instruct the display device 200 to obtain the device identification again. The cancel option 1402 is used for user input to instruct the display device 200 to terminate the task related to resolving the device identification problem. Taking the control device 100 as a remote controller as an example for illustration, the user controls the remote controller to move the focus to the try again option 1401, and presses the "confirm" button of the remote controller to input an instruction to the display device 200 to obtain the device identification again. . The process in which the display device 200 obtains the device identification again in response to the instruction is similar to step S1102 and will not be described again here. Assume that the upper limit of the number of times the display device 200 can re-obtain the device identity is 5 times. When the number of times the display device 200 obtains the device identity is equal to 5 times, and after obtaining the device identity for the fifth time, the verification is still not passed, and the display device 200 is no longer Users are provided with the service of re-obtaining device identification.
若显示设备200在至少一次重新获取设备标识之后,仍未获取到所述设备标识,或者根据获取到的设备标识验证不具有投屏功能的使用权限,则显示更新失败页面。If the display device 200 still fails to obtain the device identification after reacquiring the device identification at least once, or if it is verified that it does not have the permission to use the screen projection function based on the obtained device identification, the update failure page will be displayed.
更新失败页面包括更新失败提示,以提示用户设备标识更新失败,且本次不再提供获取设备标识的服务。The update failure page includes an update failure prompt to remind the user that the device identification update failed, and the service of obtaining the device identification is no longer provided this time.
在一些实施例中,为了便于用户在显示设备200不再提供获取设备标识的服务时,仍可以解决设备标识有问题导致的黑屏问题,更新失败提示包括指定编号和操作提示。其中,指定编号与设备标识唯一对应,操作提示用于提示用户向第三方终端或服务器反馈该指定编号,以通过第三方终端或服务器更新设备标识。该指定编号可以全部为同一种字符,如全部为数字、或者全部为字母等,该指定编号也可以为多种字符的组合,如数字与字母的组合,数字与符号的组合等。第三方终端或服务器可以为显示设 备200的生产商、运维等,具有获取指定编号与设备标识对应关系的权限,并且具有查看设备标识更新记录的权限,从而可以基于显示设备200的设备表示更新记录,分析设备标识更新失败的原因。In some embodiments, in order to facilitate the user to still solve the black screen problem caused by a problem with the device identification when the display device 200 no longer provides the service of obtaining the device identification, the update failure prompt includes a specified number and an operation prompt. Among them, the designated number uniquely corresponds to the device identification, and the operation prompt is used to prompt the user to feed back the designated number to the third-party terminal or server to update the device identification through the third-party terminal or server. The designated number can all be the same type of characters, such as all numbers, or all letters, etc. The designated number can also be a combination of multiple characters, such as a combination of numbers and letters, a combination of numbers and symbols, etc. A third-party terminal or server can configure the display The manufacturer, operation and maintenance, etc. of the device 200 have the authority to obtain the corresponding relationship between the specified number and the device identification, and have the authority to view the device identification update record, so that the device identification update failure record can be analyzed based on the device representation update record of the device 200. reason.
在一些实施例中,用户可以自行联系第三方终端或服务器,并告知第三方终端或服务器更新失败提示中的指定编号。在一些实施例中,为了避免用户的额外操作,显示设备200被配置为,在更新失败页面上还显示确认(OK)选项。该确认选项为用户输入指示显示设备200联系第三方终端或服务器更新设备标识的指令的入口。显示设备200响应于该指令,以预设的通信方式将指定编号发送至第三方终端或服务器。其中,预存的通信方式可以由生产商设定,也可以由用户设定,预存的通信方式可以包括邮件、云账号、短信等。In some embodiments, the user can contact the third-party terminal or server by himself and inform the third-party terminal or server of the specified number in the update failure prompt. In some embodiments, in order to avoid additional operations by the user, the display device 200 is configured to also display a confirmation (OK) option on the update failure page. The confirmation option is an entry point for the user to enter an instruction instructing the display device 200 to contact a third-party terminal or server to update the device identification. In response to the instruction, the display device 200 sends the specified number to the third-party terminal or server in a preset communication method. Among them, the pre-stored communication methods can be set by the manufacturer or the user. The pre-stored communication methods can include email, cloud account, text message, etc.
可以参考图15所示的更新失败页面,该更新失败页面包括更新失败提示“更新失败。请将指定编号No.1××××0告知售后或者生产商。”,以及确认选项1501。以控制设备100为遥控器,预存的通信方式为邮件为例进行说明。用户通过操控遥控器将焦点移动至确认选项1501上,并通过按压遥控器的“确认”按键,以向显示设备200输入指令。显示设备200响应于该指令,以邮件的方式向预存的第三方终端或服务器的邮箱发送指定编号。You can refer to the update failure page shown in Figure 15. The update failure page includes the update failure prompt "Update failed. Please inform the after-sales service or manufacturer of the designated number No. 1××××0.", and confirmation option 1501. The description takes the control device 100 as a remote controller and the pre-stored communication method as email as an example. The user moves the focus to the confirmation option 1501 by controlling the remote control, and inputs instructions to the display device 200 by pressing the "confirm" button of the remote control. In response to the instruction, the display device 200 sends the specified number by email to the mailbox of the pre-stored third-party terminal or server.
显示设备200响应于用户基于确认选项输入的指令,关闭更新失败页面,并显示包含投屏功能页面入口的菜单,例如显示图5所示的信号源菜单,或者显示其它用户界面,例如显示设备200的主页面等。The display device 200 responds to the instruction input by the user based on the confirmation option, closes the update failure page, and displays a menu including the entrance to the screen projection function page, such as displaying the signal source menu shown in FIG. 5 , or displaying other user interfaces, such as the display device 200 main page, etc.
S803,显示设备200在根据获取到的设备标识验证具有投屏功能的使用权限之后,启动投屏功能,并在投屏功能启动之后显示投屏功能页面。S803: After verifying the usage rights of the screen casting function according to the obtained device identification, the display device 200 starts the screen casting function, and displays the screen casting function page after the screen casting function is started.
显示设备200如果在响应于用户输入的显示投屏功能页面的指令时,根据所获取到的设备标识通过验证,即显示设备200具有投屏功能的使用权限,或者,显示设备200在一次或者多次重新获取设备标识之后,根据最后一次获取到的设备标识通过验证,即显示设备200具有投屏功能的使用权限,则启动投屏功能,并在投屏功能启动之后,显示投屏功能页面。If the display device 200 passes the verification based on the obtained device identification when responding to the instruction input by the user to display the screen projection function page, that is, the display device 200 has the permission to use the screen projection function, or the display device 200 performs the function on one or more occasions. After re-obtaining the device identification for the first time, if the device identification passed the verification last time, that is, the display device 200 has the permission to use the screen casting function, the screen casting function is started, and after the screen casting function is started, the screen casting function page is displayed.
结合图4所示的操作系统,投屏功能的实现依赖于位于应用层的投屏功能页面的入口、位于系统框架层的投屏服务和投屏应用程序包、以及位于系统运行库层的投屏进程之间的配合。以投屏功能为图5所示的无线投屏为例进行说明,如图16所示,投屏功能页面的入口为图5的信号源菜单中的无线投屏,用户可以通过该入口与显示设备200进行交互,以使用投屏功能。投屏应用程序包为无线投屏应用程序(AirPlay Apk),用于对接整机的属性,获取与无线投屏功能相关的整机参数,如音量等。投屏进程为无线投屏进程(AirPlay Daemon),是常驻的本地(Native)守护进程,可以与内核层通信,以驱动硬件设备,例如驱动显示器显示投屏功能页面。投屏服务为无线投屏服务(AirPlay Lunch Service),无线投屏服务可以为投屏应用程序提供接口,查询无线投屏应用程序的相关权限信息,管理无线投屏应用程序的生命周期,与无线投屏进程 进行通信等。Combined with the operating system shown in Figure 4, the realization of the screencasting function depends on the entrance of the screencasting function page located at the application layer, the screencasting service and screencasting application package located at the system framework layer, and the projection function located at the system runtime layer. Cooperation between screen processes. Take the screen projection function as the wireless screen projection shown in Figure 5 as an example. As shown in Figure 16, the entrance to the screen projection function page is the wireless screen projection in the signal source menu in Figure 5. The user can use this entrance to interact with the display. The device 200 interacts to use the screen casting function. The screen mirroring application package is a wireless screen mirroring application (AirPlay Apk), which is used to connect the properties of the whole machine and obtain the machine parameters related to the wireless screen mirroring function, such as volume, etc. The screen mirroring process is the wireless screen mirroring process (AirPlay Daemon), which is a resident local (Native) daemon that can communicate with the kernel layer to drive hardware devices, such as driving the monitor to display the screen mirroring function page. The screen casting service is the wireless screen casting service (AirPlay Lunch Service). The wireless screen casting service can provide an interface for the screen casting application, query the relevant permission information of the wireless screen casting application, manage the life cycle of the wireless screen casting application, and communicate with the wireless Screencasting process To communicate etc.
用户基于投屏功能页面的入口向显示设备200输入指令,该过程与上文中用户基于投屏功能页面的入口输入指令的过程类似,此处不再赘述。该入口接收到指令之后,将该指令以消息的形式传递至投屏服务,投屏服务查询与投屏应用程序的相关权限信息,即查询是否具有投屏功能的使用权限,投屏服务查询权限信息的过程与步骤S801-S802类似,此处不再赘述。在投屏服务查询到具有使用投屏功能的使用权限时,控制投屏应用程序启动,即开始投屏应用程序的生命周期。投屏应用程序启动完毕之后,向投屏服务发送启动完毕的通知,以令投屏服务控制加载投屏应用程序的包文件,以获得投屏功能页面的页面数据,并与投屏进程进行通信,以向投屏进程发送启动消息和投屏功能页面的页面数据等,令投屏进程根据投屏功能页面的页面数据驱动显示器显示投屏功能页面。The user inputs an instruction to the display device 200 based on the entrance of the screen projection function page. This process is similar to the above process of the user inputting instructions based on the entrance of the screen projection function page, and will not be described again here. After receiving the instruction, the portal transmits the instruction to the screen mirroring service in the form of a message. The screen mirroring service queries the permission information related to the screen mirroring application, that is, it queries whether it has permission to use the screen mirroring function. The screen mirroring service queries the permissions. The information process is similar to steps S801-S802 and will not be described again here. When the screen mirroring service queries that it has the permission to use the screen mirroring function, it controls the startup of the screen mirroring application, which starts the life cycle of the screen mirroring application. After the screen mirroring application is started, a startup completion notification is sent to the screen mirroring service, so that the screen mirroring service controls the loading of the package file of the screen mirroring application, obtains the page data of the screen mirroring function page, and communicates with the screen mirroring process. , to send a startup message and the page data of the projection function page to the projection process, so that the projection process drives the display to display the projection function page based on the page data of the projection function page.
在上述过程中,从投屏服务查询到具有使用投屏功能的使用权限开始,到显示器显示投屏功能页面结束,显示器在该阶段呈黑屏状态。可见,如果该阶段的通信时长较长,则呈黑屏状态的黑屏时长也较长,如果该阶段的通信时长较短,则呈黑屏状态的黑屏时长也较短。而长时间呈黑屏状态,会降低用户的体验感,为了解决在该阶段黑屏时长过长的问题,需要缩短该阶段的通信时长。In the above process, it starts from the time when the screen casting service inquires about the permission to use the screen casting function, and ends when the monitor displays the screen casting function page. The monitor is in a black screen state at this stage. It can be seen that if the communication duration in this stage is longer, the black screen duration in the black screen state will also be longer. If the communication duration in this stage is shorter, the black screen duration in the black screen state will also be shorter. A black screen for a long time will reduce the user experience. In order to solve the problem of the black screen being too long at this stage, the communication time at this stage needs to be shortened.
投屏服务只有在收到投屏应用程序发送的启动完毕之后,才能够执行后续步骤,即才能够在显示器上显示投屏功能页面。在显示设备200中,投屏应用程序被配置为默认以后台广播的方式向投屏服务发送启动完毕的通知。其中,操作系统中除具有指定要求的应用程序,其余应用程序均采用后台广播的方式向相应的服务发送通知,各后台广播集中在一个栈(Stack)中,操作系统的系统框架层会按照该栈中各后台广播的接收顺序,依次每一个后台广播传递至对应的服务。例如:投屏应用程序发送的启动完毕的通知为所在栈中的第7个后台广播,则系统框架层需要在将该栈中的第1-6个后台广播处理完毕之后,处理投屏应用程序发送的启动完毕的通知,即将该启动完毕的通知传递至投屏服务。The screen mirroring service can only perform subsequent steps after receiving the startup completion message sent by the screen mirroring application, that is, it can display the screen mirroring function page on the monitor. In the display device 200, the screen casting application is configured to send a startup completion notification to the screen casting service in the form of background broadcast by default. Among them, except for applications with specified requirements, all other applications in the operating system use background broadcast to send notifications to the corresponding services. Each background broadcast is concentrated in a stack (Stack), and the system framework layer of the operating system will follow this The order in which background broadcasts are received in the stack is passed to the corresponding service in turn. For example: the startup completion notification sent by the screen mirroring application is the 7th background broadcast in the stack, then the system framework layer needs to process the screen mirroring application after processing the 1-6 background broadcasts in the stack. The notification of completion of startup is sent to the screen mirroring service.
在显示设备200开机之后,显示设备200首先启动操作系统,在操作系统的启动过程中,各指定的开机后自动启动的应用程序开始进行加载,这些指定的应用程序全部加载完毕,即操作系统启动完毕。这些指定的应用程序在启动完毕之后,均通过后台广播的方式向系统框架层发送启动完毕的通知。这些指定的应用程序以外的应用程序如果响应于用户的启动指令完成启动,其发送的后台广播将排在这些指定的应用程序发送的后台广播之后,即系统框架层只有将这些指定的应用程序发送的后台广播处理完毕之后,才会处理其它应用程序发送的后台广播。显示设备200如果在操作系统的启动过程中接收到指示显示投屏功能页面的指令,投屏应用程序启动完毕之后,向投屏服务发送的后台广播,至少排在这些指定的应用程序发送的后台广播之后,投屏服务接收到投屏应用程序发送的后台广播的通信时长将较长,那么,显示设备200呈黑屏状态的黑屏时长也将较长。 After the display device 200 is turned on, the display device 200 first starts the operating system. During the startup process of the operating system, each designated application program that is automatically started after starting up begins to load. These designated application programs are all loaded, that is, the operating system starts. complete. After these specified applications are started, they all send startup completion notifications to the system framework layer through background broadcast. If applications other than these specified applications complete startup in response to the user's startup instructions, the background broadcasts sent by them will be ranked after the background broadcasts sent by these specified applications. That is, the system framework layer will only send these specified applications. After the background broadcast is processed, the background broadcast sent by other applications will be processed. If the display device 200 receives an instruction to display the screen mirroring function page during the startup process of the operating system, and after the screen mirroring application is started, the background broadcast sent to the screen mirroring service will be at least ranked in the background sent by these designated applications. After the broadcast, the communication duration for the screen projection service to receive the background broadcast sent by the screen projection application will be longer, so the black screen duration of the display device 200 in a black screen state will also be longer.
为了解决显示设备200在操作系统的启动过程中,在显示投屏功能页面之前黑屏时长较长的问题,显示设备200可以按照图17所示的流程启动投屏功能,并显示投屏功能页面,具体步骤如下:In order to solve the problem that the display device 200 has a long black screen before the screen projection function page is displayed during the startup process of the operating system, the display device 200 can start the screen projection function according to the process shown in Figure 17 and display the screen projection function page. Specific steps are as follows:
S1701,显示设备200通过投屏服务根据投屏功能页面的入口传递的指令,获取操作系统的启动状态,并向投屏应用程序发送启动通知,以启动投屏应用程序。其中,启动通知根据操作系统的启动状态生成。S1701. The display device 200 obtains the startup status of the operating system through the screen casting service according to the instructions passed at the entrance of the screen casting function page, and sends a startup notification to the screen casting application to start the screen casting application. Among them, the startup notification is generated based on the startup status of the operating system.
投屏服务可以通过检测各指定的开机后自动启动的应用程序的加载状态、栈中是否存在指定的开机后自动启动的应用程序发送的后台广播等方式,检测操作系统是否启动完毕。如果存在正在加载和/或未加载的指定的开机后自动启动的应用程序、栈中存在指定的开机后自动启动的应用程序发送的后台广播等,则操作系统的启动状态为正在启动,反之,操作系统的启动状态为启动完毕。投屏服务将获取到的操作系统的启动状态以启动通知的方式发送至投屏应用程序,以启动投屏应用程。The screen mirroring service can detect whether the operating system has been started by detecting the loading status of each specified application that automatically starts after booting, and whether there is a background broadcast sent by the specified application that automatically starts after booting in the stack. If there are loading and/or unloaded applications that are specified to be automatically started after booting, and there are background broadcasts sent by the specified applications that are automatically started after booting in the stack, etc., the startup status of the operating system is starting. Otherwise, The startup status of the operating system is startup completed. The screen mirroring service sends the obtained startup status of the operating system to the screen mirroring application in the form of a startup notification to start the screen mirroring application.
S1702,显示设备200通过投屏应用程序根据启动通知,以与操作系统的启动状态对应的目标通信模式向投屏进程发送启动完毕的通知,以令投屏进程驱动显示器显示投屏功能页面。S1702: The display device 200 sends a startup completion notification to the screen casting process in the target communication mode corresponding to the startup state of the operating system according to the startup notification through the screen casting application, so that the screen casting process drives the display to display the screen casting function page.
投屏应用程序根据接收到的启动通知开始加载,并在加载完毕之后生成启动完毕的通知。为了缩短投屏应用程序向投屏进程发送启动完毕的通知的通信时长,投屏应用程序需要采用与操作系统的启动状态对应的目标通信方式向投屏进行发送启动完毕的通知,以令投屏进程驱动显示器显示投屏功能页面。The screen mirroring application starts loading according to the received startup notification, and generates a startup completion notification after the loading is completed. In order to shorten the communication time for the screen mirroring application to send the startup completion notification to the screen mirroring process, the screen mirroring application needs to use the target communication method corresponding to the startup status of the operating system to send the startup completion notification to the screen mirroring process, so that the screen mirroring process can The process drives the display to display the screen projection function page.
在一种实现方式中,操作系统的启动状态为正在启动,目标通信方式为投屏应用程序通过投屏服务向投屏进程传递启动完毕的通知,其中,投屏应用程序以前台广播的方式向投屏服务发送启动完毕的通知。In one implementation, the startup state of the operating system is starting, and the target communication method is that the screen casting application transmits a startup completion notification to the screen casting process through the screen casting service, where the screen casting application broadcasts to the screen from the foreground. The screen mirroring service sends a notification that it has been started.
由上文可知,如果操作系统正在启动,则投屏应用程序发送的后台广播需要在指定应用程序发送的后台广播处理完毕之后,才能够传递至投屏服务,由此,需要等待较长的时间。在操作系统启动时,投屏应用程序可以以前台广播的方式向投屏服务发送启动完毕的通知。例如,投屏应用程序在发送的广播中添加标志(Flag),如Receiver Foreground,以表示该广播为前台广播。由于前台广播与后台广播分属不同的栈,且前台广播的数量通常较少。同时,前台广播的响应时间短于后台广播的响应时间,通常,前台广播的响应时间为10s,后台广播的响应时间为60s,即需要在每个广播对应的响应时间之内将该广播处理完毕,由此,处理前台广播的时长相对较短。由此,投屏应用程序发送的启动完毕的通知,可以被较快地处理完毕,并在等待较少的前台广播处理完毕之后,就可以被传递至投屏服务,从而通过投屏服务较快的传递至投屏进程,以缩短投屏应用程序与投屏进程之间的通信时长,从而缩短黑屏时长,以有效提高用户的使用体验。投屏服务可以通过传输控制协议(Transmission Control Protocol,TCP)与投屏进程进行套接字(Socket)通信。As can be seen from the above, if the operating system is starting, the background broadcast sent by the screen mirroring application needs to be processed after the background broadcast sent by the specified application is processed before it can be delivered to the screen mirroring service. Therefore, it will take a long time to wait. . When the operating system starts, the screen mirroring application can send a startup completion notification to the screen mirroring service by broadcasting in the foreground. For example, a screencasting application adds a flag, such as Receiver Foreground, to the broadcast it sends to indicate that the broadcast is a foreground broadcast. Because foreground broadcasts and background broadcasts belong to different stacks, the number of foreground broadcasts is usually small. At the same time, the response time of the foreground broadcast is shorter than the response time of the background broadcast. Usually, the response time of the foreground broadcast is 10s, and the response time of the background broadcast is 60s. That is, the broadcast needs to be processed within the corresponding response time of each broadcast. , thus, the time for processing the foreground broadcast is relatively short. As a result, the startup completion notification sent by the screen casting application can be processed faster, and after waiting for less foreground broadcast processing, it can be delivered to the screen casting service, so that the screen casting service can be used faster is passed to the screen casting process to shorten the communication time between the screen casting application and the screen casting process, thereby shortening the black screen time and effectively improving the user experience. The screen mirroring service can communicate with the screen mirroring process through socket communication via Transmission Control Protocol (TCP).
以无线投屏功能为例进行说明,如图18所示,包括下述步骤: Take the wireless screen projection function as an example, as shown in Figure 18, including the following steps:
步骤1801:无线投屏功能页面接收指令;Step 1801: The wireless projection function page receives instructions;
步骤1802:无线投屏功能页面将指令发送至无线投屏服务;Step 1802: The wireless screen projection function page sends the instruction to the wireless screen projection service;
实施时,客户预先通过无线投屏功能页面下发指令,无线投屏功能页面通过执行上述步骤1801和1802将指令发送至无线投屏服务;During implementation, the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 1801 and 1802;
步骤1803:无线投屏服务获取操作系统的启动状态为正在启动,生成启动通知;该启动通知将所述业务凭证写入所述显示设备的预设存储位置;Step 1803: The wireless screen projection service obtains that the startup status of the operating system is starting, and generates a startup notification; the startup notification writes the business credentials into the preset storage location of the display device;
步骤1804:无线投屏服务将启动通知发送至无线投屏应用程序;Step 1804: The wireless screen mirroring service sends the startup notification to the wireless screen mirroring application;
步骤1805:无线投屏应用程序启动,并生成启动完毕的通知;Step 1805: The wireless screen projection application is started and a notification of startup completion is generated;
步骤1806:无线投屏应用以前台广播的方式向无线投屏服务发送启动完毕的通知;Step 1806: The wireless screen projection application sends a startup completion notification to the wireless screen projection service in the form of foreground broadcast;
步骤1807:无线投屏服务将该启动完毕的通知传递至无线投屏进程;Step 1807: The wireless screen projection service delivers the startup completion notification to the wireless screen projection process;
步骤1808:无线投屏进程驱动显示器;Step 1808: The wireless projection process drives the display;
步骤1809:显示器显示无线投屏功能页面。Step 1809: The monitor displays the wireless projection function page.
上述步骤中,无线投屏功能页面的入口将指令传递至无线投屏服务,无线投屏服务获取到操作系统的启动状态为正在启动,无线投屏服务根据操作系统正在启动的启动状态,生成启动通知,该启动通知包括指示投屏应用程序采用前台广播的指示信息,如Foreground,并将该启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完毕之后,以前台广播的方式向无线投屏服务发送启动完毕的通知。无线投屏服务将该启动完毕的通知传递至无线投屏进程,以令无线投屏进程驱动显示器显示无线投屏功能页面。In the above steps, the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service. The wireless screen projection service obtains that the startup status of the operating system is starting. The wireless screen projection service generates a startup based on the startup status of the operating system. Notification, the startup notification includes instruction information that instructs the screen mirroring application to use the foreground broadcast, such as Foreground, and sends the startup notification to the wireless screen mirroring application. After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of a foreground broadcast. The wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
在一种实现方式中,操作系统的启动状态为正在启动,目标通信方式为投屏应用程序直接向投屏进程发送启动完毕的通知。In one implementation, the startup status of the operating system is starting, and the target communication method is that the screen casting application directly sends a startup completion notification to the screen casting process.
为了避免投屏应用程序以后台广播的方式向投屏服务发送启动完毕的通知,投屏应用程序与投屏进程之前直接建立通信,由此,投屏应用程序可以直接将启动完毕的通知发送至投屏进程,而无需经过投屏应用程序,从而可以有效缩短投屏应用程序与投屏进程之间的通信时长,以缩短黑屏时长,提高用户的使用体验。例如:可以在投屏应用程序中配置监听接口,在监听到投屏应用程序启动完毕之后,直接与投屏进程通过TCP进行Socket通信。In order to prevent the screen mirroring application from sending the startup completion notification to the screen mirroring service in the form of background broadcast, the screen mirroring application directly establishes communication with the screen mirroring process. Therefore, the screen mirroring application can directly send the startup completion notification to The screen mirroring process does not need to go through the screen mirroring application, which can effectively shorten the communication time between the screen mirroring application and the screen mirroring process, thereby shortening the black screen time and improving the user experience. For example, you can configure a listening interface in the screen mirroring application. After listening to the screen mirroring application being started, you can directly communicate with the screen mirroring process through Socket through TCP.
以无线投屏功能为例进行说明,如图19所示,包括下述步骤:Take the wireless screen projection function as an example, as shown in Figure 19, including the following steps:
步骤1901:无线投屏功能页面接收指令;Step 1901: The wireless projection function page receives instructions;
步骤1902:无线投屏功能页面将指令发送至无线投屏服务;Step 1902: The wireless screen projection function page sends the instruction to the wireless screen projection service;
实施时,客户预先通过无线投屏功能页面下发指令,无线投屏功能页面通过执行上述步骤1901和1902将指令发送至无线投屏服务;During implementation, the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 1901 and 1902;
步骤1903:无线投屏服务获取操作系统的启动状态为正在启动,并生成启动完毕的通知;Step 1903: The wireless screen projection service obtains the startup status of the operating system as starting, and generates a startup completion notification;
步骤1904:无线投屏服务将启动通知发送至无线投屏应用程序;Step 1904: The wireless screen projection service sends the startup notification to the wireless screen projection application;
步骤1905:无线投屏应用程序启动,并生成启动完毕的通知; Step 1905: The wireless screen projection application is started and a notification of startup completion is generated;
步骤1906:无线投屏应用向无线投屏进程建立通信,并向其发送启动完毕的通知;Step 1906: The wireless screen projection application establishes communication with the wireless screen projection process and sends a startup completion notification to it;
步骤1907:无线投屏进程驱动显示器;Step 1907: The wireless projection process drives the display;
步骤1908:显示器显示无线投屏功能页面。Step 1908: The monitor displays the wireless screen projection function page.
上述步骤中,无线投屏功能页面的入口将指令传递至无线投屏服务,无线投屏服务获取到操作系统的启动状态为正在启动,并将包含正在启动的启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完毕之后,与无线投屏进程建立通信,并直接将启动完毕的通知传递至无线投屏进程,以令无线投屏进程驱动显示器显示无线投屏功能页面。In the above steps, the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service. The wireless screen projection service obtains that the startup status of the operating system is starting, and sends a startup notification containing the startup notification to the wireless screen projection application. . After the wireless screen mirroring application is started, it establishes communication with the wireless screen mirroring process, and directly transmits the startup completion notification to the wireless screen mirroring process, so that the wireless screen mirroring process drives the display to display the wireless screen mirroring function page.
在一种实现方式中,操作系统的启动状态为启动完毕,目标通信方式为投屏应用程序通过投屏服务向投屏进程传递启动完毕的通知,其中,投屏应用程序以后台广播的方式向投屏服务发送启动完毕的通知。In one implementation, the startup state of the operating system is startup completed, and the target communication method is that the screen casting application transmits a startup completion notification to the screen casting process through the screen casting service, wherein the screen casting application uses a background broadcast to The screen mirroring service sends a notification that it has been started.
如果操作系统启动完毕,则各指定的开机自动启动的应用程序发送的后台广播均已处理完毕,此时,后台广播对应的栈内后台广播的数量将减少,即在投屏应用程序发送的后台广播之前处理的后台广播的数量将减少,如果投屏应用程序以后台广播的方式向投屏服务发送启动完毕的通知,投屏服务等待该启动完毕的通知的时长将缩短,由此,投屏应用程序与投屏进程之间的通信时长也将相对减少,相应的,黑屏时长也将缩短,不会引起用户较强的反感,可以无需改变投屏应用程序的广播方式,即仍然以默认的后台广播的方式发送启动完毕的通知。而且,前台广播的优先级高于后台广播,即操作系统会优先处理前台广播,再处理后台广播,由此,新生成的前台广播会对本来存在的后台广播的处理过程造成影响,从而影响这些后台广播对应的应用程序的正常运行。由此,为了保证显示设备200的正常运行,在黑屏时长相对较短时,尽量避免使用前台广播的方式进行投屏应用程序与投屏服务之间的通信。If the operating system is started, all the background broadcasts sent by the designated applications that are automatically started at startup have been processed. At this time, the number of background broadcasts in the stack corresponding to the background broadcasts will be reduced, that is, the number of background broadcasts sent by the screen mirroring application will be reduced. The number of background broadcasts processed before broadcasting will be reduced. If the screen mirroring application sends a startup completion notification to the screen mirroring service in the form of background broadcast, the time the screen mirroring service waits for the startup completion notification will be shortened. As a result, the screen mirroring service will The communication time between the application and the screen casting process will also be relatively reduced. Correspondingly, the black screen time will also be shortened, which will not cause strong resentment among users. There is no need to change the broadcast method of the screen casting application, that is, it will still use the default Send notification of startup completion through background broadcast. Moreover, the priority of foreground broadcast is higher than that of background broadcast, that is, the operating system will process the foreground broadcast first and then the background broadcast. Therefore, the newly generated foreground broadcast will affect the processing process of the existing background broadcast, thus affecting these The background broadcast corresponds to the normal operation of the application. Therefore, in order to ensure the normal operation of the display device 200, when the black screen duration is relatively short, try to avoid using the foreground broadcast method to communicate between the screen casting application and the screen casting service.
以无线投屏功能为例进行说明,如图20所示,包括下述步骤:Take the wireless screen projection function as an example, as shown in Figure 20, including the following steps:
步骤2001:无线投屏功能页面接收指令;Step 2001: The wireless projection function page receives instructions;
步骤2002:无线投屏功能页面将指令发送至无线投屏服务;Step 2002: The wireless screen projection function page sends the instruction to the wireless screen projection service;
实施时,客户预先通过无线投屏功能页面下发指令,无线投屏功能页面通过执行上述步骤2001和2002将指令发送至无线投屏服务;During implementation, the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2001 and 2002;
步骤2003:无线投屏服务获取操作系统的启动状态为启动完毕,并生成启动通知;该启动通知包括指示投屏应用程序采用后台广播的指示信息,如Background;Step 2003: The wireless screen mirroring service obtains that the startup status of the operating system is startup completed, and generates a startup notification; the startup notification includes instruction information instructing the screen mirroring application to use background broadcast, such as Background;
步骤2004:无线投屏服务将启动通知发送至无线投屏应用程序;Step 2004: The wireless screen mirroring service sends the startup notification to the wireless screen mirroring application;
步骤2005:无线投屏应用程序启动,并生成启动完毕的通知;Step 2005: Start the wireless screen projection application and generate a startup completion notification;
步骤2006:无线投屏应用以后台广播的方式向无线投屏服务发送启动完毕的通知;Step 2006: The wireless screen projection application sends a startup completion notification to the wireless screen projection service in the form of background broadcast;
步骤2007:无线投屏服务将该启动完毕的通知传递至无线投屏进程;Step 2007: The wireless screen projection service transmits the startup completion notification to the wireless screen projection process;
步骤2008:无线投屏进程驱动显示器;Step 2008: The wireless projection process drives the display;
步骤2009:显示器显示无线投屏功能页面。Step 2009: The monitor displays the wireless projection function page.
上述步骤中,无线投屏功能页面的入口将指令传递至无线投屏服务,无线投屏服 务获取到操作系统的启动状态为启动完毕,无线投屏服务根据操作系统启动完毕的启动状态,生成启动通知,该启动通知包括指示投屏应用程序采用后台广播的指示信息,如Background,并将该启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完毕之后,以后台广播的方式向无线投屏服务发送启动完毕的通知。无线投屏服务将该启动完毕的通知传递至无线投屏进程,以令无线投屏进程驱动显示器显示无线投屏功能页面。In the above steps, the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service, and the wireless screen projection service The service obtains that the startup status of the operating system is startup completed. The wireless screen mirroring service generates a startup notification based on the startup status of the operating system. The startup notification includes instruction information instructing the screen mirroring application to use background broadcast, such as Background, and will This startup notification is sent to the wireless screen mirroring application. After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of background broadcast. The wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
在一些实施例中,操作系统启动完毕之后,仍然存在较多的后台广播,此时,如果投屏应用程序如果仍以后台广播的方式向投屏服务发送启动完毕的通知,则仍然会存在较长的等待时长,导致投屏应用程序与投屏服务之间的通信时长较长,令黑屏时长较长。为了解决上述问题,投屏服务根据投屏功能页面的入口传递的指令,在获取到操作系统的启动状态为启动完毕之后,还获取栈内后台广播的数量。其中,如果栈内后台广播的数量大于或者等于数量阈值,则说明后台广播的数量仍然较多,投屏应用程序需要采用前台广播的方式向投屏服务发送启动完毕的通知。如果栈内后台广播的数量小于数量阈值,则说明后台广播的数量较少,投屏应用程序可以采用后台广播的方式向投屏服务发送启动完毕的通知。In some embodiments, after the operating system is started, there are still many background broadcasts. At this time, if the screen casting application still sends a startup completion notification to the screen casting service in the form of background broadcast, there will still be many background broadcasts. A long waiting time results in a longer communication time between the screen mirroring application and the screen mirroring service, resulting in a longer black screen time. In order to solve the above problem, the screen projection service obtains the number of background broadcasts in the stack after obtaining the startup status of the operating system as Startup Complete according to the instructions passed at the entrance of the screen projection function page. Among them, if the number of background broadcasts in the stack is greater than or equal to the quantity threshold, it means that the number of background broadcasts is still large, and the screen casting application needs to use foreground broadcast to send a startup completion notification to the screen casting service. If the number of background broadcasts in the stack is less than the quantity threshold, it means that the number of background broadcasts is small, and the screen mirroring application can use background broadcasts to send a startup completion notification to the screen mirroring service.
以无线投屏功能为例进行说明,如图21所示,包括下述步骤:Take the wireless screen projection function as an example, as shown in Figure 21, including the following steps:
步骤2101:无线投屏功能页面接收指令;Step 2101: The wireless projection function page receives instructions;
步骤2102:无线投屏功能页面将指令发送至无线投屏服务;Step 2102: The wireless screen projection function page sends the instruction to the wireless screen projection service;
实施时,客户预先通过无线投屏功能页面下发指令,无线投屏功能页面通过执行上述步骤2101和2102将指令发送至无线投屏服务;During implementation, the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2101 and 2102;
步骤2103:无线投屏服务获取到操作系统的启动状态为启动完毕;Step 2103: The wireless screen projection service obtains that the startup status of the operating system is startup completed;
步骤2104:无线投屏服务判断栈内后台广播的数量是否大于数量阈值;Step 2104: The wireless screen projection service determines whether the number of background broadcasts in the stack is greater than the quantity threshold;
步骤2105:若否,则生成启动通知,并发送至无线投屏应用程序;该启动通知包括指示投屏应用程序采用前台广播的指示信息,如Foreground;Step 2105: If not, generate a startup notification and send it to the wireless screen projection application; the startup notification includes instruction information instructing the screen projection application to use foreground broadcast, such as Foreground;
步骤2106:若是,则生成启动通知,并将该启动通知发送至无线投屏应用程序;该启动通知包括指示投屏应用程序采用后台广播的指示信息,如Background;Step 2106: If so, generate a startup notification and send the startup notification to the wireless screen projection application; the startup notification includes instruction information instructing the screen projection application to use background broadcast, such as Background;
步骤2107:无线投屏应用程序启动,并生成启动完毕的通知;Step 2107: Start the wireless screen projection application and generate a startup completion notification;
步骤2108:无线投屏应用程序将启动完毕的通知广播至无线投屏服务;Step 2108: The wireless screen projection application broadcasts the startup completion notification to the wireless screen projection service;
步骤2109:无线投屏服务将该启动完毕的通知传递至无线投屏进程;Step 2109: The wireless screen projection service transmits the startup completion notification to the wireless screen projection process;
步骤2110:无线投屏进行驱动显示器;Step 2110: Wirelessly project the screen to drive the display;
步骤2111:显示器显示无线投屏功能页面。Step 2111: The monitor displays the wireless projection function page.
上述步骤中,无线投屏功能页面的入口将指令传递至无线投屏服务,无线投屏服务获取到操作系统的启动状态为启动完毕,无线投屏服务根据操作系统启动完毕的启动状态,获取栈内后台广播的数量。其中,若后台广播的数量大于或者等于数量阈值,则生成启动通知,该启动通知包括指示投屏应用程序采用前台广播的指示信息,如Foreground,并将该启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完 毕之后,以前台广播的方式向无线投屏服务发送启动完毕的通知。若后台广播的数量小于数量阈值,则生成启动通知,该启动通知包括指示投屏应用程序采用后台广播的指示信息,如Background,并将该启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完毕之后,以后台广播的方式向无线投屏服务发送启动完毕的通知。无线投屏服务将该启动完毕的通知传递至无线投屏进程,以令无线投屏进程驱动显示器显示无线投屏功能页面。In the above steps, the entrance of the wireless screen projection function page passes the instruction to the wireless screen projection service. The wireless screen projection service obtains that the startup status of the operating system is startup completed. The wireless screen projection service obtains the stack according to the startup status of the operating system. The number of background broadcasts within. Among them, if the number of background broadcasts is greater than or equal to the quantity threshold, a startup notification is generated. The startup notification includes instruction information instructing the screen casting application to use foreground broadcasting, such as Foreground, and the startup notification is sent to the wireless screen casting application. After launching the wireless screen mirroring application, After completion, a notification of completion of startup is sent to the wireless screen projection service through front-end broadcast. If the number of background broadcasts is less than the quantity threshold, a startup notification is generated. The startup notification includes instruction information instructing the screen mirroring application to use background broadcasting, such as Background, and the startup notification is sent to the wireless screen mirroring application. After the wireless screen mirroring application is started, it sends a startup completion notification to the wireless screen mirroring service in the form of background broadcast. The wireless screen projection service transmits the activation completion notification to the wireless screen projection process, so that the wireless screen projection process drives the display to display the wireless screen projection function page.
在一些实施例中,操作系统的启动状态为启动完毕,且栈内的后台广播的数量大于或者等于数量阈值,投屏应用程序还可以直接与投屏进程建立通信,以直接将启动完毕的通知发送至投屏进程。In some embodiments, the startup status of the operating system is startup completed, and the number of background broadcasts in the stack is greater than or equal to the quantity threshold. The screen casting application can also directly establish communication with the screen casting process to directly notify the startup completion Send to the screen casting process.
在一种实现方式中,操作系统的启动状态为启动完毕,目标通信方式为投屏应用程序直接向投屏进程发送启动完毕的通知。In one implementation, the startup status of the operating system is startup completed, and the target communication method is that the screen projection application directly sends a startup completion notification to the screen projection process.
以无线投屏功能为例进行说明,如图22所示,包括下述步骤:Take the wireless screen projection function as an example, as shown in Figure 22, including the following steps:
步骤2201:无线投屏功能页面(图22中示出的无线投屏)接收指令;Step 2201: The wireless screen projection function page (wireless screen projection shown in Figure 22) receives instructions;
步骤2202:无线投屏功能页面将指令发送至无线投屏服务;Step 2202: The wireless screen projection function page sends the instruction to the wireless screen projection service;
实施时,客户预先通过无线投屏功能页面下发指令,无线投屏功能页面通过执行上述步骤2201和2202将指令发送至无线投屏服务;During implementation, the customer issues instructions in advance through the wireless screen projection function page, and the wireless screen projection function page sends the instructions to the wireless screen projection service by executing the above steps 2201 and 2202;
步骤2203:无线投屏服务获取到操作系统的启动状态为启动完毕,生成启动通知;Step 2203: The wireless screen projection service obtains that the startup status of the operating system is startup completed, and generates a startup notification;
步骤2204:无线投屏服务将包含正在启动的启动通知发送至无线投屏应用程序;Step 2204: The wireless screen mirroring service sends a startup notification including startup to the wireless screen mirroring application;
步骤2205:无线投屏应用程序启动,并生成启动完毕的通知;Step 2205: Start the wireless screen projection application and generate a startup completion notification;
步骤2206:无线投屏应用程序向无线投屏进程建立通信,并向其发送启动完毕的通知;Step 2206: The wireless screen mirroring application establishes communication with the wireless screen mirroring process and sends a startup completion notification to it;
步骤2207:无线投屏进程驱动显示屏;Step 2207: The wireless projection process drives the display screen;
步骤2208:显示器显示无线投屏功能页面。Step 2208: The monitor displays the wireless screen projection function page.
上述步骤中的无线投屏功能页面的入口将指令传递至无线投屏服务,无线投屏服务获取到操作系统的启动状态为启动完毕,并将包含正在启动的启动通知发送至无线投屏应用程序。无线投屏应用程序在启动完毕之后,可以参考上文中操作系统的启动状态为正在启动,投屏应用程序与投屏进程直接通信的过程,此处不再赘述。由此,通过投屏应用程序与投屏进程之间的直接通信,可以进一步缩短投屏应用程序与投屏进程之间的通信时长,从而有效缩短黑屏时长。The entrance to the wireless screen mirroring function page in the above steps passes the instruction to the wireless screen mirroring service. The wireless screen mirroring service obtains that the startup status of the operating system is startup completed, and sends a startup notification including startup to the wireless screen mirroring application. . After the wireless screen mirroring application is started, you can refer to the startup status of the operating system as starting and the process of direct communication between the screen mirroring application and the screen mirroring process as mentioned above, which will not be described again here. Therefore, through direct communication between the screen casting application and the screen casting process, the communication time between the screen casting application and the screen casting process can be further shortened, thereby effectively shortening the black screen time.
此外,在基于隔控播放功能(airplay)实现投屏时,用户可以通过显示设备中提供的信号源口启动显示设备中的投屏功能并展示相应的投屏信息,进而可以等待用户操作智能设备与显示设备建立连接进行投屏,然而,目前存在显示设备在展示投屏信息页面中对于接收到的返回指令无响应的现象,这严重影响用户体验,具体如下述图23和图24所示。In addition, when implementing screencasting based on the airplay function, the user can activate the screencasting function in the display device through the signal source port provided in the display device and display the corresponding screencasting information, and then wait for the user to operate the smart device Establish a connection with the display device for screencasting. However, there is currently a phenomenon that the display device does not respond to the return command received on the screencasting information page, which seriously affects the user experience, as shown in Figure 23 and Figure 24 below.
图23所示的用户界面21示例性示出了信号源页面,其中,用户界面21包括:区域201,用于展示信号源页面。区域201可以为整个显示器的全部或者部分显示区域, 且本公开对于区域201显示位置、显示尺寸、颜色、文字的显示样式等等参数均不做限定。如图23所示,信号源页面可以悬浮显示在显示设备原先所展示的页面之上并且靠近左侧边缘,显示设备原先所展示的页面的亮度、色彩、透明度等等显示参数可以进行调整,以突出信号源页面。The user interface 21 shown in FIG. 23 exemplarily shows the signal source page, where the user interface 21 includes: an area 201 for displaying the signal source page. The area 201 can be all or part of the display area of the entire display, Furthermore, this disclosure does not limit parameters such as the display position, display size, color, text display style, etc. of the area 201. As shown in Figure 23, the signal source page can be suspended and displayed above the page originally displayed by the display device and close to the left edge. The brightness, color, transparency and other display parameters of the page originally displayed by the display device can be adjusted to Highlight the source page.
其中,区域201可以包括:区域201a以及多个区域201b。区域201用于展示信号源页面的名称,名称可以采用任意语言,例如图23中采用中文“信号源”。区域201b用于展示信号源,每个区域201b对应一个信号源,例如,图23中包含6个信号源,分别为“主页面”、“实时直播”、“隔空播放”、“HDMI1”、“HDMI2”以及“HDMI3”,用户选中的信号源可以采用不同的显示样式体现,例如用户选中的信号源对应的区域201b中的文字字号加大加粗,且区域201b采用具有明显区别的色彩填充。The area 201 may include an area 201a and multiple areas 201b. Area 201 is used to display the name of the signal source page. The name can be in any language. For example, in Figure 23, the Chinese "signal source" is used. Area 201b is used to display signal sources. Each area 201b corresponds to a signal source. For example, Figure 23 contains 6 signal sources, namely "Home Page", "Live Broadcast", "Air Play", "HDMI1", "HDMI2" and "HDMI3", the signal source selected by the user can be reflected in different display styles. For example, the text size in the area 201b corresponding to the signal source selected by the user is enlarged and bold, and the area 201b is filled with an obviously different color. .
在图23所示用户界面21的基础上,用户可以从信号源页面中展示的多种信号源选择其中一种作为显示设备当前的信号输入源,接收该信号源输入的数据进行解析并展示。例如,用户选择实时直播作为当前信号源,则显示设备200接收实时的广播电视数据作为信号输入,以展示广播电视内容;又如,用户选择隔空播放作为当前信号源,则可以从发起投屏的智能设备接收投屏数据解析并进行展示。Based on the user interface 21 shown in Figure 23, the user can select one of the multiple signal sources displayed on the signal source page as the current signal input source of the display device, and receive the data input by the signal source for analysis and display. For example, if the user selects real-time live broadcast as the current signal source, the display device 200 receives real-time broadcast and television data as signal input to display the radio and television content; for another example, if the user selects air play as the current signal source, the display device 200 can initiate screencasting. The smart device receives and analyzes the screen projection data and displays it.
设备可能支持采用多种不同的隔空播放协议实现投屏,例如,可以采用Miracast协议或者airplay协议。其中,不同的隔空播放协议的规范也不同。例如,通过airplay协议实现隔空播放时,当用户在信号源页面选择隔空播放作为当前信号源,则基于airplay协议的规范,会要求显示设备200跳转至投屏信息页面,其中,投屏信息页面可以展示显示设备的名称、显示设备当前连接的WiFi的名称等等投屏信息,且投屏信息页面还可以提供其他功能入口,显示设备200跳转至投屏信息页面后,便可等待用户操作智能设备通过镜像投屏、直接操作应用程序投屏等方式进行投屏。通过投屏信息页面向用户展示要连接的显示设备以及WiFi的信息,能够保证用户在智能设备中进行操作时可以选择正确的显示设备,并连接至正确的WiFi中,避免出现投屏失败的问题。The device may support multiple different airplay protocols for screencasting, for example, Miracast protocol or airplay protocol may be used. Among them, different air play protocols have different specifications. For example, when airplay is implemented through the airplay protocol, when the user selects airplay as the current signal source on the signal source page, based on the specifications of the airplay protocol, the display device 200 will be required to jump to the screen casting information page, where the screen casting information page The information page can display the name of the display device, the name of the WiFi currently connected to the display device, etc., and the screen casting information page can also provide other function entrances. After the display device 200 jumps to the screen casting information page, it can wait Users operate smart devices to mirror the screen, directly operate the application to mirror the screen, etc. The screen casting information page displays information about the display device and WiFi to be connected to the user, which ensures that the user can select the correct display device and connect to the correct WiFi when operating on the smart device to avoid the problem of screen casting failure. .
例如,在图23所示用户界面21的基础上,用户通过选择隔空播放作为信号源,则显示设备200可以跳转至图24所示的用户界面31,以展示投屏信息页面。参阅图24所示,用户界面31包括:区域301、区域302、区域303、入口304以及区域305。For example, based on the user interface 21 shown in Figure 23, if the user selects air play as the signal source, the display device 200 can jump to the user interface 31 shown in Figure 24 to display the screen projection information page. Referring to FIG. 24 , the user interface 31 includes: area 301 , area 302 , area 303 , entrance 304 and area 305 .
其中,区域301用于展示一些隔空播放的介绍说明,例如,“隔空播放,通过无线网络将您手机、PAD或者MAC中的内容进行分享”,并且可以展示相关隔空播放的图标。区域302用于展示显示设备连接的WiFi的名称。区域303用于展示显示设备的名称。Among them, area 301 is used to display some introductory instructions for Air Play, for example, "Air Play, share content on your mobile phone, PAD or MAC through a wireless network", and can display related Air Play icons. Area 302 is used to display the name of the WiFi to which the display device is connected. Area 303 is used to display the name of the display device.
入口304用于进入隔空播放设置页面,隔空播放设置页面可以修改显示设备的名称、更换显示设备当前连接的WiFi等等。The entrance 304 is used to enter the air play setting page. The air play setting page can modify the name of the display device, change the WiFi currently connected to the display device, and so on.
区域305用于展示隔空播放相关的提示信息,例如,文字提示内容“请确保您的手机、PAD或者MAC连接至本设备连接的WiFi网络。如您想获取更多信息,请访问 xxxxxx网站”。Area 305 is used to display prompt information related to air play, for example, the text prompt content "Please ensure that your mobile phone, PAD or MAC is connected to the WiFi network connected to this device. If you want to get more information, please visit xxxxxx website".
进入投屏信息页面之后,显示设备便会等待用户操作智能设备进行投屏。在一些情况下,用户可能不想进行下一步投屏操作,通常用户会操作控制装置进行返回。然而,目前的显示设备基于隔空播放协议实现投屏时,当通过信号源页面进入投屏信息页面之后,用户通过操作移动终端300或者控制装置100中的返回按键向显示设备200发送返回指令,显示设备200在投屏信息页面针对返回指令无响应,这可能会让用户认为显示设备出现卡顿或者投屏功能出现错误,这既不符合用户的使用习惯,也会导致用户使用隔空播放功能的体验感受较差。After entering the screen mirroring information page, the display device will wait for the user to operate the smart device to mirror the screen. In some cases, the user may not want to proceed with the next step of screencasting, and usually the user will operate the control device to return. However, when the current display device implements screen casting based on the AirPlay protocol, after entering the screen casting information page through the signal source page, the user sends a return instruction to the display device 200 by operating the return button on the mobile terminal 300 or the control device 100. The display device 200 does not respond to the return command on the screen casting information page. This may make the user think that the display device is stuck or there is an error in the screen casting function. This is not in line with the user's usage habits and may also cause the user to use the air play function. The experience is poor.
为了解决该问题,本公开通过在显示设备200中添加相应的业务逻辑,使得显示设备200响应投屏信息页面的返回指令,跳转至预先指定的页面,既符合用户的使用习惯,也能够较好地提升用户感受。其中,处理逻辑可以灵活设置,例如,可以指定响应投屏信息页面的返回指令统一返回至某个指定页面,处理逻辑简单;或者,也可以通过分析进入投屏信息页面之前显示设备中的活跃的数据源对象,针对不同的数据源对象设置不同的处理逻辑,该方式也更加契合用户的使用习惯。In order to solve this problem, the present disclosure adds corresponding business logic to the display device 200, so that the display device 200 responds to the return instruction of the screen projection information page and jumps to the pre-specified page, which is not only in line with the user's usage habits, but also more convenient. Improve user experience. Among them, the processing logic can be set flexibly. For example, the return instructions of the screen projection information page can be specified to be uniformly returned to a specified page. The processing logic is simple; or, the active data in the display device before entering the screen projection information page can also be analyzed. Data source objects set different processing logic for different data source objects. This method is also more in line with users' usage habits.
本公开中,移动终端300、控制装置200以及智能设备发送的指令或者请求先被传输至内核层,由内核层中的隔空播放SDK对接收到的返回指令进行解析,一些情况下,隔空播放SDK可以在内部处理接收到的指令或者请求,另一些情况下,隔空播放SDK需要调用上层系统库层的相关组件,以将接收到的指令或请求传递至上层的系统库层,再经过系统库层中的相关组件将指令或请求传递给应用程序层中的用于响应指令或则请求的目标应用程序进行处理。In this disclosure, the instructions or requests sent by the mobile terminal 300, the control device 200 and the smart device are first transmitted to the kernel layer, and the airplay SDK in the kernel layer parses the received return instructions. In some cases, the airplay SDK in the kernel layer parses the received return instructions. The playback SDK can process the received instructions or requests internally. In other cases, the air playback SDK needs to call the relevant components of the upper system library layer to pass the received instructions or requests to the upper system library layer, and then through The relevant components in the system library layer pass the instructions or requests to the target application in the application layer for processing in response to the instructions or requests.
接下来通过图25至图27所示实施例详细介绍显示设备响应返回指令时所涉及的组件之间调用流程以及各组件的处理流程。Next, the calling process between components involved when the display device responds to the return command and the processing flow of each component will be introduced in detail through the embodiments shown in FIGS. 25 to 27 .
图25为根据本公开一个或多个实施例的显示设备控制方法的流程示意图。请参阅图25所示,本实施例包括:Figure 25 is a schematic flowchart of a display device control method according to one or more embodiments of the present disclosure. Please refer to Figure 25. This embodiment includes:
S2501、接收用户通过操作控制装置的返回按键生成的返回指令。S2501. Receive a return instruction generated by the user by operating the return button of the control device.
S2502、响应返回指令,确定当前是否展示投屏信息页面,投屏信息页面符合指定隔空播放协议的要求。S2502. Respond to the return command and determine whether the screen projection information page is currently displayed. The screen projection information page meets the requirements of the specified air play protocol.
其中,指定隔空播放协议即为airplay协议。Among them, the specified airplay protocol is the airplay protocol.
S2503、确定显示器当前展示投屏信息页面时,控制显示器返回展示预先指定的页面。S2503. When it is determined that the display is currently displaying the screen projection information page, control the display to return to display the pre-specified page.
结合前文所述,至少有以下两种实现方式:(1)基于不同的投屏前通道进入投屏信息页面可以统一返回至安卓系统的桌面;(2)根据进入投屏信息页面前处于启动状态的数据源对象返回至该数据源对象对应的指定页面。其中,图26以及图27分别示出了上述两种实现方式分别对应的组件调用过程示意图。Based on the above, there are at least the following two implementation methods: (1) Based on different pre-casting channels, entering the screen casting information page can uniformly return to the desktop of the Android system; (2) Based on the startup state before entering the screen casting information page The data source object returns to the specified page corresponding to the data source object. Among them, Figure 26 and Figure 27 respectively show schematic diagrams of the component calling processes corresponding to the above two implementation methods.
请参阅图26以及图27所示,并结合图4所示的软件配置实施例,隔空播放SDK接收到返回指令进行解析,确定当前是否显示投屏信息页面,若是,则执行步骤S603; 若否,则由隔空播放SDK响应返回指令。也就是说,在确定显示器当前显示投屏信息页面时,才会将返回指令向上传递,否则便在隔空播放功能内部处理。Referring to Figures 26 and 27, combined with the software configuration embodiment shown in Figure 4, the AirPlay SDK receives the return command and analyzes it to determine whether the screen projection information page is currently displayed. If so, step S603 is executed; If not, the AirPlay SDK will respond to the return command. In other words, the return command will be passed upward only when it is determined that the display is currently displaying the screen projection information page, otherwise it will be processed within the air play function.
其中,返回指令向上传递主要设计隔空播放SDK、系统库层中的启动服务以及应用程序层中的隔空播放应用程序。图26与图27的区别在于,返回指令被传输至隔空播放应用程序之后的处理方式不同,但前端隔空播放SDK、启动服务以及隔空播放应用程序三者之间的交互过程是相同的。因此,这里首先对前端对于返回指令的处理流程进行介绍。Among them, the return command is passed upward mainly to design the AirPlay SDK, the startup service in the system library layer, and the AirPlay application in the application layer. The difference between Figure 26 and Figure 27 is that the processing method after the return command is transmitted to the AirPlay application is different, but the interaction process between the front-end AirPlay SDK, startup service and AirPlay application is the same. . Therefore, here we first introduce the front-end processing flow of return instructions.
具体地,通过调用隔空播放SDK将返回指令以广播(broadcast)的方式发送给隔空播放应用程序,使得隔空播放应用程序响应返回指令,控制显示器返回展示预先指定的页面。Specifically, the return instruction is sent to the AirPlay application in a broadcast manner by calling the AirPlay SDK, so that the AirPlay application responds to the return instruction and controls the display to return to display the pre-specified page.
在安卓系统中,内核层中的隔空播放SDK无法与应用程序层直接进行通信,需要依赖中间层的组件实现,因此,隔空播放SDK需要将接收到的返回指令先转发给系统库层中的启动服务,再调用启动服务广播返回指令,以将返回指令发送给应用程序层中的隔空播放应用程序,使得隔空播放应用程序响应返回指令返回至预先指定的页面。In the Android system, the AirPlay SDK in the kernel layer cannot communicate directly with the application layer and needs to rely on components in the middle layer. Therefore, the AirPlay SDK needs to forward the received return instructions to the system library layer first. The startup service is then called to broadcast the return instruction to send the return instruction to the AirPlay application in the application layer, so that the AirPlay application responds to the return instruction and returns to the pre-specified page.
在一些实施例中,启动服务可以监听套接字连接,隔空播放SDK可以将返回指令可以套接字(socket)的方式转发给启动服务。套接字是对网络中不同应用进程之间进行双向通信的端点的抽象,一个套接字可以理解为是进程通信的一端。通信时,隔空播放SDK将返回指令写入底层驱动所对应的socket中,再通过隔空播放SDK与启动服务之间的传输介质将返回指令发送至启动服务对应的socket中,启动服务从自身相对应的socket中读取返回指令。其中,通过socket方式传输数据组件之间的通信效率较高,能够提高显示设备的处理速度。In some embodiments, the startup service can monitor socket connections, and the AirPlay SDK can forward the return command to the startup service in the form of a socket. A socket is an abstraction of an endpoint for two-way communication between different application processes in the network. A socket can be understood as one end of process communication. During communication, the AirPlay SDK writes the return command into the socket corresponding to the underlying driver, and then sends the return command to the socket corresponding to the startup service through the transmission medium between the AirPlay SDK and the startup service. The startup service starts from itself. Read the return instruction from the corresponding socket. Among them, the communication efficiency between data components transmitted through socket is relatively high, which can improve the processing speed of the display device.
可以理解的是,隔空播放SDK还可以通过其他方式将返回指令发送给启动服务,例如,还可以通过广播或者Binder的方式传输返回指令。其中,采用广播的方式简单易于实现;采用Binder的方式相比较而言性能更好,实时性更强。可根据需求灵活设置隔空播放SDK向启动服务传输返回指令的方式。It can be understood that the AirPlay SDK can also send return instructions to the startup service through other methods. For example, the return instructions can also be transmitted through broadcast or Binder. Among them, the broadcast method is simple and easy to implement; the Binder method has better performance and stronger real-time performance. The way the AirPlay SDK transmits return instructions to the startup service can be flexibly set according to needs.
接下来分别对图26以及图27所示实施例中隔空播放应用程序响应返回指令的处理方式进行介绍。Next, the processing method of the air play application program's response to the return command in the embodiments shown in FIG. 26 and FIG. 27 will be introduced respectively.
针对上述实现方式(1),如图26所示,需要通过意图组件和安卓的桌面启动组件(Launcher)实现。For the above implementation method (1), as shown in Figure 26, it needs to be implemented through the intent component and the Android desktop launcher component (Launcher).
针对上述实现方式(2),参照图27所示,需要通过活动管理器、目标应用程序(进入投屏信息页面前处于启动状态的数据源对象)、意图组件以及安卓的桌面启动组件。For the above implementation method (2), as shown in Figure 27, it is necessary to use the activity manager, the target application (the data source object in the startup state before entering the screencast information page), the intent component, and the Android desktop startup component.
在图26所示实施例中,针对上述实现方式(1),无论是在安卓的操作系统的桌面、HDMI或者其他信号源通道下,通过信号源入口进入信号源页面再进入隔空播放,还是由安装在显示设备中的应用程序的相关页面通过信号源入口进入信号源页面再进入隔空播放,当接收到返回指令,均返回安卓的操作系统的桌面,返回至操作系统的桌面需要重启桌面启动组件。 In the embodiment shown in Figure 26, for the above implementation method (1), whether it is on the desktop of the Android operating system, HDMI or other signal source channels, enter the signal source page through the signal source entrance and then enter air playback, or The relevant page of the application installed in the display device enters the signal source page through the signal source entrance and then enters Air Play. When receiving the return command, it returns to the desktop of the Android operating system. Returning to the desktop of the operating system requires restarting the desktop. Start the component.
具体地,隔空播放应用程序响应返回指令执行结束隔空播放应用程序的操作,活动管理器将隔空播放应用程序对应的任务从堆栈顶部弹出,并控制关闭隔空播放应用程序对应的窗口,从而关闭投屏信息页面;进一步地,通过意图组件针对返回指令生成相应的描述数据,安卓系统通过描述数据确定要调用的组件为安卓的桌面启动组件,再调用安卓的桌面启动组件重新启动,拉起操作系统的桌面进行显示。该业务逻辑既能够满足用户的使用习惯,解决显示设备在投屏信息页面对于返回指令无响应的问题,且实现复杂度也相对较为简单。Specifically, the AirPlay application responds to the return instruction to execute the operation of ending the AirPlay application. The activity manager pops the task corresponding to the AirPlay application from the top of the stack and controls the closing of the window corresponding to the AirPlay application. Thereby closing the screen projection information page; further, the corresponding description data is generated for the return instruction through the intent component. The Android system determines that the component to be called is the Android desktop startup component through the description data, and then calls the Android desktop startup component to restart. Start the operating system desktop and display it. This business logic can not only meet the user's usage habits, but also solve the problem of the display device not responding to return instructions on the screen projection information page, and the implementation complexity is relatively simple.
在图27所示实施例中,针对上述实现方式(2),针对不同的投屏前通道返回不同的页面,更加具有针对性,也更符合“从哪儿来回哪儿去”的业务逻辑以及用户的使用习惯,能够带给用户更好的体验感受。具体地,隔空播放应用程序接收到返回指令后,可以获取自定义参数的值,基于自定义参数的值确定返回安卓系统的桌面,还是应用程序的主页面。In the embodiment shown in Figure 27, for the above implementation method (2), different pages are returned for different pre-screening channels, which is more targeted and more consistent with the business logic of "going back and forth from where to go" and the user's needs. Usage habits can give users a better experience. Specifically, after the AirPlay application receives the return command, it can obtain the value of the custom parameter, and determine whether to return to the desktop of the Android system or the main page of the application based on the value of the custom parameter.
自定义参数能够指示进入投屏信息页面前处于启动状态的数据源对象是属于显示设备支持的信号源还是安装在显示设备中的某个应用程序。假设,自定义参数为launch source,任意信号源对应的launch source值相同,不同应用程序分别对应的launch source值可以相同也可以不同,本公开对此不做限定。以任意信号源对应的launch source值相同为例,隔空播放应用程序比较确定launch source值等于预设值则表示显示设备是在信号源下进入隔空播放,比较确定launch source值不等于预设值则表示显示设备在应用程序下进入隔空播放;若launch source等于预设值,则确定需要返回安卓系统的桌面;若launch source不等于预设值,则确定需要返回至应用程序的主页面。Custom parameters can indicate whether the data source object in the startup state before entering the screen projection information page belongs to a signal source supported by the display device or an application installed in the display device. Assume that the custom parameter is launch source. The launch source value corresponding to any signal source is the same. The launch source value corresponding to different applications can be the same or different. This disclosure does not limit this. For example, if the launch source value corresponding to any signal source is the same, the airplay application is relatively certain that the launch source value is equal to the default value, which means that the display device enters airplay under the signal source. It is relatively certain that the launch source value is not equal to the default value. The value indicates that the display device enters airplay under the application; if the launch source is equal to the default value, it is determined that you need to return to the desktop of the Android system; if the launch source is not equal to the default value, you are determined to return to the main page of the application .
其中,本公开对于预设值的大小不做限定,例如,预设值可以为1也可以为0,还可以为其他数值。此外,launch source可以由活动管理器根据处于启动状态的各应程序的任务进行更新。隔空播放应用程序接收到返回指令后始终需要从活动管理器中得到最新状态的launch source值。The present disclosure does not limit the size of the preset value. For example, the preset value can be 1, 0, or other numerical values. In addition, the launch source can be updated by the activity manager based on the tasks of each application in the launched state. After receiving the return command, the AirPlay application always needs to obtain the latest launch source value from the activity manager.
在图27所示实施例中,确定返回至安卓系统的桌面之后的具体处理流程与图26所示实施例的处理流程是一致的,可参照图26所示实施例的描述,简明起见,此处不再赘述。In the embodiment shown in Figure 27, the specific processing flow after it is determined to return to the desktop of the Android system is consistent with the processing flow of the embodiment shown in Figure 26. Reference can be made to the description of the embodiment shown in Figure 26. For the sake of simplicity, this No further details will be given.
若确定需要返回至应用程序的主页面,则响应返回指令执行结束隔空播放应用程序的操作,活动管理器将隔空播放应用程序对应的任务从堆栈顶部弹出,并控制关闭隔空播放应用程序对应的窗口,从而关闭投屏信息页面;之后,可以通过活动管理器将接下来要重新恢复为启动状态的目标应用程序对应的任务推至堆栈顶部并获得焦点,进而再重新启动目标应用程序对应的任务,并显示目标应用程序对应的窗口,在窗口中展示目标应用程序提供的主页面。If it is determined that it is necessary to return to the main page of the application, in response to the return command, the operation of ending the AirPlay application is executed. The activity manager pops the task corresponding to the AirPlay application from the top of the stack and controls the closing of the AirPlay application. corresponding window to close the screencasting information page; after that, you can use the activity manager to push the task corresponding to the target application that is to be restored to the startup state to the top of the stack and gain focus, and then restart the corresponding task of the target application. task, and display the window corresponding to the target application, and display the main page provided by the target application in the window.
接下来,以图28至图30所示实施例对采用前述两种不同实现方式时,显示设备中的用户界面变化进行示意。Next, the embodiments shown in FIGS. 28 to 30 are used to illustrate the changes in the user interface in the display device when the aforementioned two different implementation methods are adopted.
参阅图28所示,按照箭头所示的界面顺序,显示设备响应用户操作遥控器上的信 号源按键生成的指令,在安卓系统的桌面上显示信号源页面,接着,用户从多个信号源中选择隔空播放作为信号源,启动隔空播放功能,显示设备则跳转至中间所示的投屏信息页面,之后,再接收用户操作遥控器中的返回按键生成的返回指令,显示设备则由投屏信息页面返回至安卓系统的桌面。Referring to Figure 28, according to the interface sequence shown by the arrow, the display device responds to the user's operation of the message on the remote control. The command generated by the signal source button displays the signal source page on the desktop of the Android system. Then, the user selects Air Play as the signal source from multiple signal sources, starts the Air Play function, and the display device jumps to the center shown The screen projection information page, and then receives the return command generated by the user operating the return button on the remote control, and the display device returns to the Android system desktop from the screen projection information page.
请参阅图29所示,按照箭头所示的界面顺序,显示设备响应用户操作遥控器上的信号源按键生成的指令,在安卓系统的桌面上方显示信号源页面;接着,用户从多个信号源中选择隔空播放作为信号源,启动隔空播放功能,显示设备则跳转至投屏信息页面,通过投屏信息页面中的隔空播放设置入口进入隔空播放设置页面;之后,用户可以通过屏幕镜像的方式或者直接通过操作手机上应用程序提供的多媒体内容播放页面中的投屏按钮等方式,与显示设备建立连接并在显示设备中展示投屏内容展示页面;在展示投屏内容的过程中,显示设备接收用户操作遥控器中的返回按键生成的返回指令,显示设备则由投屏内容展示页面先返回至投屏信息页面;之后,显示设备再次接收用户操作遥控器中的返回按键生成的返回指令,显示设备则由投屏信息页面跳转至安卓系统的桌面。Please refer to Figure 29. According to the interface sequence shown by the arrow, the display device responds to the instructions generated by the user operating the signal source button on the remote control and displays the signal source page on the top of the desktop of the Android system; then, the user selects the signal source page from multiple signal sources. Select AirPlay as the signal source, start the AirPlay function, the display device will jump to the screen casting information page, and enter the AirPlay setting page through the AirPlay setting entrance in the screen casting information page; after that, the user can Establish a connection with the display device through screen mirroring or directly operate the cast button on the multimedia content playback page provided by the mobile phone application and display the cast content display page on the display device; in the process of displaying the cast content , the display device receives the return command generated by the user's operation of the return button on the remote control, and the display device first returns from the projection content display page to the projection information page; after that, the display device again receives the return command generated by the user's operation of the return button on the remote control. Return command, the display device will jump from the screen projection information page to the desktop of the Android system.
请参阅图30所示,按照箭头所示的界面顺序,显示设备正在展示安装在显示设备中的应用1的主页面;之后,显示设备响应用户操作遥控器上的信号源按键生成的指令,在应用1的主界面上显示信号源页面;接着,用户从多个信号源中选择隔空播放作为信号源,启动隔空播放功能,显示设备则跳转至投屏信息页面;之后,用户可以直接通过操作手机上应用程序提供的多媒体内容播放页面中的投屏按钮或者屏幕镜像等方式,与显示设备建立连接并在显示设备中展示投屏内容;在展示投屏内容的过程中,显示设备接收用户操作遥控器中的返回按键生成的返回指令,显示设备则由投屏内容展示页面先返回至投屏信息页面;之后,显示设备再次接收用户操作遥控器中的返回按键生成的返回指令,显示设备则由投屏信息页面跳转至应用1的主页面。Please refer to Figure 30. According to the interface sequence shown by the arrow, the display device is displaying the main page of application 1 installed in the display device; after that, the display device responds to the instructions generated by the user operating the signal source button on the remote control. The signal source page is displayed on the main interface of Application 1; then, the user selects air play as the signal source from multiple signal sources, starts the air play function, and the display device jumps to the screen casting information page; after that, the user can directly By operating the screen casting button or screen mirroring in the multimedia content playback page provided by the mobile phone application, establish a connection with the display device and display the screen casting content on the display device; during the process of displaying the screen casting content, the display device receives The user operates the return button on the remote control to generate a return instruction, and the display device first returns from the projection content display page to the projection information page; after that, the display device again receives the return instruction generated by the user operating the return button on the remote control, and displays The device will jump from the screencasting information page to the main page of Application 1.
结合图29以及图30所示,显示设备接收的第一个返回指令是由隔空播放SDK内部处理的,第二个返回指令是由隔空播放SDK通过启动服务上传至隔空播放应用程序进行处理。As shown in Figure 29 and Figure 30, the first return command received by the display device is processed internally by the AirPlay SDK, and the second return command is uploaded by the AirPlay SDK to the AirPlay application by starting the service. deal with.
结合图28至图30所示实施例,通过采用本公开提供的显示设备控制方法,显示设备可以统一的策略或者采用灵活性较高且针对性较强的策略响应针对投屏信息页面的返回指令,控制页面跳转以满足用户的使用习惯,且能够提高用户使用显示设备的隔空播放功能的体验感受。With reference to the embodiments shown in Figures 28 to 30, by using the display device control method provided by the present disclosure, the display device can respond to the return instruction for the screen projection information page with a unified strategy or a more flexible and targeted strategy. , control page jumps to meet the user's usage habits, and can improve the user's experience using the air playback function of the display device.
此外,前文提及的隔空播放功能的正常使用需要依赖业务凭证MFI key(Made for iPhone/iPod/iPad,用于主要用于苹果设备的合法性校验)和FairPlay Key(用于解密受FairPlay的数字版权保护的加密多媒体内容)。In addition, the normal use of the air playback function mentioned above requires the business certificate MFI key (Made for iPhone/iPod/iPad, used mainly for legality verification of Apple devices) and FairPlay Key (used to decrypt files protected by FairPlay digital copyright protected encrypted multimedia content).
为了保证业务凭证的安全性,目前普遍采用的业务凭证写入方法为在生产环境将业务凭证写入显示设备。然而,一方面在生产环境对相关设备进行业务凭证的写入导致生产进度必须依赖业务凭证的认证进度,如果显示设备未通过业务方的认证,则无 法获取业务凭证,进而影响显示设备的生产进度;另一方面,在生产环境对相关设备进行业务凭证的写入还会导致业务凭证一旦被写入显示设备并交付用户,则无法更改业务凭证,当业务凭证异常或需要更新时,无法对显示设备中业务凭证进行重写。因此如何在显示设备交付后安全的对显示设备进行业务凭证的写入是一个亟待解决的问题。In order to ensure the security of business credentials, the currently commonly used method of writing business credentials is to write the business credentials to the display device in the production environment. However, on the one hand, writing business credentials to relevant equipment in the production environment causes the production progress to depend on the certification progress of the business credentials. If the display device does not pass the certification of the business party, there will be no It is impossible to obtain business credentials, thereby affecting the production progress of the display device; on the other hand, writing business credentials to related devices in the production environment will also result in that once the business credentials are written into the display device and delivered to the user, the business credentials cannot be changed. When the business credentials are abnormal or need to be updated, the business credentials in the display device cannot be rewritten. Therefore, how to safely write business credentials to the display device after the display device is delivered is an urgent problem that needs to be solved.
在一些实施例中,本公开通过为显示设备200写入了第一加密秘钥,并将显示设备200对应的业务凭证和第一加密秘钥对应的第一解密秘钥上传到了服务器400中。显示设备200在需要进行业务凭证写入时,通过控制器250读取写入的第一加密秘钥,并根据所述第一加密秘钥生成第一设备签名,然后通过控制器220向服务器400发送携带有所述第一设备签名的凭证获取请求。服务器400根据第一解密秘钥和第一设备签名对显示设备200进行鉴权,若显示设备200鉴权通过,则服务器400向显示设备200发送显示设备200对应的业务凭证。显示设备200通过接收到服务器400发送的业务凭证后,将业务凭证保存至预设存储位置,以完成业务凭证的写入。由于服务器400只有确定显示设备200鉴权通过的情况下才会向显示设备200发送业务凭证,因此上述实施例可以避免非法设备从服务器400盗取所述显示设备200的业务凭证,进而保证业务凭证的安全性。In some embodiments, the present disclosure writes the first encryption key to the display device 200 and uploads the business certificate corresponding to the display device 200 and the first decryption key corresponding to the first encryption key to the server 400 . When the display device 200 needs to write a business certificate, the display device 200 reads the written first encryption key through the controller 250, generates a first device signature based on the first encryption key, and then sends the first device signature to the server 400 through the controller 220. Send a credential acquisition request carrying the signature of the first device. The server 400 authenticates the display device 200 based on the first decryption key and the first device signature. If the display device 200 passes the authentication, the server 400 sends the business voucher corresponding to the display device 200 to the display device 200 . After receiving the business voucher sent by the server 400, the display device 200 saves the business voucher to a preset storage location to complete writing the business voucher. Since the server 400 will only send the service credentials to the display device 200 when it is sure that the display device 200 has passed the authentication, the above embodiment can prevent illegal devices from stealing the service credentials of the display device 200 from the server 400, thereby ensuring the business credentials. security.
在一些实施例中,显示设备200根据写入所述显示设备200的第一加密秘钥生成第一设备签名的实现方式可以包括:显示设备200的控制器250通过所述第一加密秘钥对第一文件进行加密,获取第一加密文件;并基于预设算法获取所述第一文件的摘要信息,以及根据所述第一加密文件和所述摘要信息生成所述第一设备签名。相应的,服务器400基于所述第一设备签名对显示设备200进行鉴权的实现方式可以包括:服务器400解析第一设备签名获取所述第一加密文件和所述第一文件的摘要信息,基于第一加密秘钥对应的第一解密秘钥对所述第一加密文件进行解密获取第一加密文件对应的解密数据,然后基于所述预设算法获取所述第一加密文件对应的解密数据的摘要信息,最后比对第一加密文件对应的解密数据的摘要信息是否与凭证获取请求中携带的摘要信息相同;若相同,则确定显示设备200鉴权通过,若不同,则确定显示设备200鉴权不通过。In some embodiments, the implementation of the display device 200 generating the first device signature according to the first encryption key written in the display device 200 may include: the controller 250 of the display device 200 passing the first encryption key pair The first file is encrypted to obtain the first encrypted file; and summary information of the first file is obtained based on a preset algorithm, and the first device signature is generated based on the first encrypted file and the summary information. Correspondingly, the implementation of the server 400 to authenticate the display device 200 based on the first device signature may include: the server 400 parses the first device signature to obtain the first encrypted file and the summary information of the first file, based on The first decryption key corresponding to the first encryption key decrypts the first encrypted file to obtain the decrypted data corresponding to the first encrypted file, and then obtains the decrypted data corresponding to the first encrypted file based on the preset algorithm. summary information, and finally compare whether the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information carried in the certificate acquisition request; if they are the same, it is determined that the display device 200 has passed the authentication; if they are different, it is determined that the display device 200 has been authenticated. The right does not pass.
在一些实施例中,为了保证写入显示设备200中的第一加密秘钥的有效性,在将所述第一加密秘钥写入所述显示设备200之后,显示设备200的控制器250还会根据所述第一加密秘钥生成第二设备签名;显示设备200的通信器200还会向所述服务器400发送携带有所述第二设备签名的鉴权请求,以及接收所述服务器400发送的鉴权响应;显示设备200的控制器250还会在所述鉴权响应指示所述显示设备鉴权通过的情况下,确定所述第一加密秘钥有效,在所述鉴权响应指示所述显示设备鉴权不通过的情况下,确定所述第一加密秘钥无效。相应的,服务器400接收到显示设备200发送的鉴权请求后,基于鉴权请求中携带第二设备签名对所述显示设备200进行鉴权,以及向显示设备200返回鉴权结果。上述实施例在将所述第一加密秘钥写入所述显示 设备200之后,还会对第一加密秘钥的有效性进行验证,因此本公开实施还可以避免写入显示设备200的第一加密秘钥无效导致的显示设备200无法从服务器400获取业务凭证,进而提升向显示设备写入业务凭证的可靠性。In some embodiments, in order to ensure the validity of the first encryption key written into the display device 200, after writing the first encryption key into the display device 200, the controller 250 of the display device 200 also A second device signature will be generated based on the first encryption key; the communicator 200 of the display device 200 will also send an authentication request carrying the second device signature to the server 400, and receive the authentication request sent by the server 400. Authentication response; the controller 250 of the display device 200 will also determine that the first encryption key is valid when the authentication response indicates that the display device has passed the authentication. If the display device fails to pass the authentication, it is determined that the first encryption key is invalid. Correspondingly, after receiving the authentication request sent by the display device 200, the server 400 authenticates the display device 200 based on the second device signature carried in the authentication request, and returns the authentication result to the display device 200. In the above embodiment, the first encryption key is written into the display After the device 200 is installed, the validity of the first encryption key will also be verified. Therefore, the disclosed implementation can also avoid the display device 200 being unable to obtain the business certificate from the server 400 due to the invalid first encryption key written to the display device 200. This improves the reliability of writing business credentials to the display device.
在一些实施例中,还向服务器上传了第二加密秘钥服务器400,显示设备200还被写入了第二加密秘钥对应的第二解密秘钥。服务器400向显示设备200发送业务凭证的实现方式可以包括:服务器400向显示设备200发送通过第二加密秘钥对业务凭证进行加密到的第二加密文件。显示设备200接收到第二加密文件后,获取写入所述显示设备的第二解密秘钥,并通过所述第二解密秘钥对所述第二加密文件进行解密,以获取所述业务凭证。其中,服务器400获取第二加密文件的一种实现方式为:将第二加密秘钥和业务凭证均上传到服务器400,服务器400根据第二加密秘钥对业务凭证进行加密,以获取第二加密文件;服务器400获取第二加密文件的另一种实现方式可以为:直接将通过第二加密秘钥对业务凭证进行加密得到的第二加密文件上传到服务器400中。In some embodiments, the second encryption key server 400 is also uploaded to the server, and the display device 200 is also written with a second decryption key corresponding to the second encryption key. The implementation of the server 400 sending the business voucher to the display device 200 may include: the server 400 sends to the display device 200 a second encrypted file that encrypts the business voucher using a second encryption key. After receiving the second encrypted file, the display device 200 obtains the second decryption key written to the display device, and decrypts the second encrypted file using the second decryption key to obtain the business voucher. . Among them, one way for the server 400 to obtain the second encrypted file is to upload both the second encryption key and the business voucher to the server 400, and the server 400 encrypts the business voucher according to the second encryption key to obtain the second encrypted file. File; Another implementation method for the server 400 to obtain the second encrypted file may be to directly upload the second encrypted file obtained by encrypting the business voucher with the second encryption key to the server 400 .
在一些实施例中,为保证写入显示设备200中的第二解密秘钥的有效性,显示设备200的通信器220还会在将所述第二解密秘钥写入所述显示设备200之后,从服务器400获取基于所述第二加密秘钥对预设文件进行加密得到的第三加密文件,显示设备200的控制器250还会通过所述第二解密秘钥对所述第三加密文件进行解密获取解密数据,以及比对所述解密第三加密文件得到的解密数据是否与预设文件一致,以及在所述解密数据与所述预设文件一致的情况下,确定所述第二解密秘钥有效,在所述解密数据与所述预设文件不一致的情况下,确定所述第二解密秘钥无效。上述实施例在将所述第二解密秘钥写入所述显示设备200之后,还会进一步对第二解密秘钥的有效性进行验证,因此本公开实施可以避免写入显示设备200的第二解密秘钥无效导致的显示设备200无法解密加密后的业务凭证,进而提升向显示设备写入业务凭证的可靠性。In some embodiments, in order to ensure the validity of the second decryption key written into the display device 200, the communicator 220 of the display device 200 will also write the second decryption key into the display device 200. , obtain the third encrypted file obtained by encrypting the preset file based on the second encryption key from the server 400, and the controller 250 of the display device 200 will also use the second decryption key to encrypt the third encrypted file. Perform decryption to obtain decrypted data, and compare whether the decrypted data obtained by decrypting the third encrypted file is consistent with the preset file, and if the decrypted data is consistent with the preset file, determine the second decryption The secret key is valid. If the decryption data is inconsistent with the preset file, it is determined that the second decryption key is invalid. In the above embodiment, after writing the second decryption key to the display device 200, the validity of the second decryption key will be further verified. Therefore, the disclosed implementation can avoid writing the second decryption key to the display device 200. The display device 200 cannot decrypt the encrypted business voucher due to the invalid decryption key, thereby improving the reliability of writing the business voucher to the display device.
在一些实施例中,为了避免第二解密秘钥在写入过程中被窃取,向显示设备200写入第二解密秘钥的实现方式可包括:显示设备200的存储器接收写入的基于第三加密秘钥对所述第二解密秘钥进行加密得到的第四加密文件,显示设备200的控制根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第四加密文件进行解密,以获取所述第二解密秘钥。其中,所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。由于写入过程中第二解密秘钥已被加密,写入相关人员或设备只能获取基于第三加密秘钥对所述第二解密秘钥进行加密得到的第四加密文件,而无法获取解密后的第二解密秘钥,因此上述实施例可以避免第二解密秘钥在写入过程中被窃取。In some embodiments, in order to avoid the second decryption key being stolen during the writing process, the implementation of writing the second decryption key to the display device 200 may include: the memory of the display device 200 receives the written third decryption key based on The encryption key encrypts the fourth encrypted file obtained by encrypting the second decryption key. The display device 200 controls the fourth encrypted file according to the third decryption key preset in the software system of the display device. Decrypt to obtain the second decryption key. Wherein, the third decryption key is the decryption key corresponding to the third encryption key. Since the second decryption key has been encrypted during the writing process, the writing-related personnel or equipment can only obtain the fourth encrypted file obtained by encrypting the second decryption key based on the third encryption key, but cannot obtain the decryption Therefore, the above embodiment can prevent the second decryption key from being stolen during the writing process.
在一些实施例中,为了避免第一加密秘钥在写入过程中被窃取,显示设备200写入第一加密秘钥的实现方式可包括:显示设备200的存储器接收写入的基于第三加密秘钥对所述第一加密秘钥进行加密得到的第五加密文件,显示设备200的控制根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第五加密文件进行解密,以获 取所述第二解密秘钥。其中,所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。由于写入过程中第一加密秘钥已被加密,写入相关人员或设备只能获取基于第三加密秘钥对所述第一加密秘钥进行加密得到的第五加密文件,而无法获取解密后的第一加密秘钥,因此上述实施例可以避免第一加密秘钥在写入过程中被窃取。In some embodiments, in order to avoid the first encryption key being stolen during the writing process, the display device 200 writes the first encryption key in an implementation manner that may include: the memory of the display device 200 receives the written third encryption-based The display device 200 controls the fifth encrypted file obtained by encrypting the first encryption key with the secret key according to the third decryption key preset in the software system of the display device. decrypt to obtain Get the second decryption key. Wherein, the third decryption key is the decryption key corresponding to the third encryption key. Since the first encryption key has been encrypted during the writing process, the writing-related personnel or equipment can only obtain the fifth encrypted file obtained by encrypting the first encryption key based on the third encryption key, but cannot obtain the decryption Therefore, the above embodiment can prevent the first encryption key from being stolen during the writing process.
图31中在本公开的某一实施例中示出了根据一些实施例的业务凭证写入方法的交互流程示意图,如图31所示,根据一些实施例的业务凭证写入方法包括如下步骤:Figure 31 shows a schematic interactive flow diagram of a business credential writing method according to some embodiments in an embodiment of the present disclosure. As shown in Figure 31, the business credential writing method according to some embodiments includes the following steps:
S3101、显示设备根据中写入所述显示设备的第一加密秘钥生成第一设备签名。S3101. The display device generates a first device signature according to the first encryption key written in the display device.
在一些实施例中,可以在生产环境中将所述第一加密秘钥写入所述显示设备。即,在生产环境中将第一加密秘钥写入显示设备,显示设备在需要获取业务凭证时,读取在生产环境中写入的第一加密秘钥,并根据第一加密秘钥生成第一设备签名。In some embodiments, the first encryption key may be written to the display device in a production environment. That is, the first encryption key is written to the display device in the production environment. When the display device needs to obtain the business voucher, it reads the first encryption key written in the production environment and generates the first encryption key based on the first encryption key. A device signature.
由于本公开实施例中第一加密秘钥作用为对显示设备进行鉴权,因此第一加密秘钥与显示设备一一对应,每一个显示设备具有唯一的第一加密秘钥。Since the first encryption key is used to authenticate the display device in the embodiment of the present disclosure, the first encryption key corresponds to the display device one-to-one, and each display device has a unique first encryption key.
S3102、显示设备向服务器发送携带有所述第一设备签名的凭证获取请求。S3102. The display device sends a certificate acquisition request carrying the signature of the first device to the server.
相应的,服务器接收显示设备发送的携带有第一设备签名的凭证获取请求。Correspondingly, the server receives the certificate acquisition request sent by the display device and carries the signature of the first device.
其中,所述凭证获取请求用于请求所述服务器在基于所述第一设备签名确定所述显示设备鉴权通过的情况下返回所述显示设备对应的业务凭证。Wherein, the credential acquisition request is used to request the server to return the business credential corresponding to the display device when it is determined that the display device is authenticated based on the first device signature.
在一些实施例中,凭证获取请求可以为显示设备首次联网使用时向服务器发送的注册请求,当服务器完成显示设备的鉴权后,会向显示设备发送显示设备对应的业务凭证。In some embodiments, the credential acquisition request may be a registration request sent to the server when the display device is used online for the first time. After the server completes the authentication of the display device, it will send the business credentials corresponding to the display device to the display device.
本公开实施例中的业务凭证可以为MFI key、FairPlay Key等,本公开实施例对此不作限定。The business certificate in the embodiment of the disclosure may be an MFI key, FairPlay Key, etc., which is not limited in the embodiment of the disclosure.
S3103、服务器根据所述第一设备签名和所述第一加密秘钥对应的第一解密秘钥对所述显示设备进行鉴权。S3103. The server authenticates the display device according to the first device signature and the first decryption key corresponding to the first encryption key.
本公开实施例中的第一加密秘钥与第一解密秘钥是一对一的关系,且每一台显示设备具有唯一的第一加密秘钥。In this disclosed embodiment, the first encryption key and the first decryption key have a one-to-one relationship, and each display device has a unique first encryption key.
在一些实施中,所述第一加密秘钥与所述第一解密秘钥可以为对称加密算法中的秘钥。即,第一加密秘钥与第一解密秘钥相同。In some implementations, the first encryption key and the first decryption key may be keys in a symmetric encryption algorithm. That is, the first encryption key and the first decryption key are the same.
在一些实施中,所述第一加密秘钥与所述第一解密秘钥可以为非对称加密算法中的秘钥对,第一加密秘钥为非对称加密算法中的公钥,第一解密秘钥为非对称加密算法中的私钥。In some implementations, the first encryption key and the first decryption key may be a key pair in an asymmetric encryption algorithm, the first encryption key is a public key in an asymmetric encryption algorithm, and the first decryption key The secret key is the private key in the asymmetric encryption algorithm.
在上步骤S3103中,若服务器根据所述第一设备签名和所述第一加密秘钥对应的第一解密秘钥确定所述显示设备鉴权不通过,则服务器可以确定所述显示设备不具有获取所述业务凭证的权限,因此拒绝向所述显示设备发送所述业务凭证,而若服务器根据所述第一设备签名和所述第一加密秘钥对应的第一解密秘钥确定所述显示设备鉴权通过,则服务器可以确定所述显示设备具有获取所述业务凭证的权限,因此执行如下步骤S3104。 In the above step S3103, if the server determines that the display device fails to pass authentication based on the first device signature and the first decryption key corresponding to the first encryption key, the server may determine that the display device does not have Obtain the authority for the business voucher, and therefore refuse to send the business voucher to the display device, and if the server determines the display based on the first device signature and the first decryption key corresponding to the first encryption key If the device authentication passes, the server can determine that the display device has the authority to obtain the business voucher, and therefore executes the following step S3104.
S3104、服务器向所述显示设备发送所述业务凭证。S3104. The server sends the service voucher to the display device.
相应的,显示设备接收所述服务器发送的所述业务凭证。Correspondingly, the display device receives the service voucher sent by the server.
S3105、显示设备将所述业务凭证写入所述显示设备的预设存储位置。S3105. The display device writes the business voucher into a preset storage location of the display device.
在一些实施例中,所述预设存储位置可以为所述显示设备的可信执行环境(Trusted execution environment,TEE)中的存储位置。In some embodiments, the preset storage location may be a storage location in a trusted execution environment (Trusted execution environment, TEE) of the display device.
将业务凭证存储在可信执行环境中的存储位置可以避免业务凭证在写入显示设备被从显示设备中窃取,进而进一步提升业务凭证的安全性。Storing business credentials in a storage location in a trusted execution environment can prevent the business credentials from being stolen from the display device when they are written to the display device, thereby further improving the security of the business credentials.
根据一些实施例的显示设备和业务凭证写入方法,首先根据写入所述显示设备的第一加密秘钥生成第一设备签名,然后向服务器发送携带有所述第一设备签名的凭证获取请求,并接收所述服务器发送的所述业务凭证,以及将所述业务凭证写入所述显示设备的预设存储位置。一方面,由于本公开实施例是通过从服务器获取业务凭证,并将从服务器获取的业务凭证写入预设存储位置的方式对显示设备进行业务凭证写入的,因此本公开实施例可以在任意阶段对显示设备进行业务凭证的写入,而不必局限于在生产环境下对显示设备进行业务凭证的写入。另一方面,由于凭证获取请求携带有显示设备根据写入所述显示设备的第一加密秘钥生成第一设备签名,且服务器只有在基于所述第一设备签名确定所述显示设备鉴权通过的情况下才会向所述显示设备发送所述显示设备对应的业务凭证,因此本公开实施例可以避免非法设备从服务器盗取所述显示设备的业务凭证,进而保证业务凭证的安全性。综上所述,本公开实施例可以在显示设备交付后安全的对显示设备进行业务凭证的写入,解决在生产环境对显示设备进行业务凭证的写入带来的影响生产进度和无法重写的问题。According to the display device and business voucher writing method of some embodiments, first generate a first device signature based on the first encryption key written to the display device, and then send a voucher acquisition request carrying the first device signature to the server. , and receive the business voucher sent by the server, and write the business voucher into a preset storage location of the display device. On the one hand, since the embodiment of the present disclosure writes the business voucher to the display device by obtaining the business voucher from the server and writing the business voucher obtained from the server to the preset storage location, the embodiment of the present disclosure can be used in any Write business credentials to the display device at this stage, instead of being limited to writing business credentials to the display device in the production environment. On the other hand, since the credential acquisition request carries the display device to generate a first device signature based on the first encryption key written to the display device, and the server can only determine that the display device has passed the authentication based on the first device signature. The business voucher corresponding to the display device will be sent to the display device only under the condition. Therefore, the embodiment of the present disclosure can prevent illegal devices from stealing the business voucher of the display device from the server, thereby ensuring the security of the business voucher. To sum up, the embodiments of the present disclosure can safely write business credentials to the display device after the display device is delivered, solving the problem of writing business credentials to the display device in the production environment that affects the production progress and cannot be rewritten. The problem.
作为对上图31所示实施例的扩展和细化,本公开实施例提供了另一种业务凭证写入方法,参照图32所示,该业务凭证写入方法的交互流程图包括如下步骤:As an expansion and refinement of the embodiment shown in Figure 31 above, the embodiment of the present disclosure provides another method of writing business credentials. Referring to Figure 32, the interactive flow chart of the method of writing business credentials includes the following steps:
S3201、显示设备根据写入所述显示设备的第一加密秘钥对第一文件进行加密,获取第一加密文件。S3201. The display device encrypts the first file according to the first encryption key written in the display device, and obtains the first encrypted file.
本公开实施例中的第一文件可以为任意文件。The first file in the embodiment of the present disclosure can be any file.
在一些实施例中,显示设备可以随机生成包含多个字符的文本文件作为所述第一文件。In some embodiments, the display device may randomly generate a text file containing a plurality of characters as the first file.
S3202、显示设备基于预设算法获取所述第一文件的摘要信息。S3202. The display device obtains summary information of the first file based on a preset algorithm.
在一些实施例中,上述步骤S3202(基于预设算法获取所述第一文件的摘要信息)可以包括:In some embodiments, the above step S3202 (obtaining summary information of the first file based on a preset algorithm) may include:
基于哈希算法对第一文件进行哈希计算,并将对第一文件进行哈希计算得到的哈希值作为所述第一文件的摘要信息。Hash calculation is performed on the first file based on a hash algorithm, and a hash value obtained by hash calculation on the first file is used as the digest information of the first file.
例如:可以基于SHA256算法(哈希值长度为256位的哈希算法)对第一文件进行哈希计算,并得到的哈希值作为所述第一文件的摘要信息。For example, the first file can be hashed based on the SHA256 algorithm (a hash algorithm with a hash value length of 256 bits), and the obtained hash value can be used as the digest information of the first file.
S3203、显示设备根据所述第一加密文件和所述摘要信息生成所述第一设备签名。S3203. The display device generates the first device signature according to the first encrypted file and the summary information.
在一些实施例中,可以直接对所述第一加密文件和所述摘要信息封装到同一个数 据包中,并将封装得到的数据包作为所述第一设备签名。In some embodiments, the first encrypted file and the summary information may be directly encapsulated into the same data. data packet, and the encapsulated data packet is used as the signature of the first device.
S3204、显示设备向服务器发送携带有所述第一设备签名的凭证获取请求。S3204. The display device sends a certificate acquisition request carrying the signature of the first device to the server.
相应的,服务器接收显示设备发送的携带有第一设备签名的凭证获取请求。Correspondingly, the server receives the certificate acquisition request sent by the display device and carries the signature of the first device.
其中,所述凭证获取请求用于请求所述服务器在基于所述第一设备签名确定所述显示设备鉴权通过的情况下返回所述显示设备对应的业务凭证。Wherein, the credential acquisition request is used to request the server to return the business credential corresponding to the display device when it is determined that the display device is authenticated based on the first device signature.
S3205、服务器解析所述第一设备签名获取所述第一加密文件和所述摘要信息。S3205: The server parses the first device signature to obtain the first encrypted file and the summary information.
S3206、服务器通过第一解密秘钥对所述第一加密文件进行解密,获取所述第一加密文件对应的解密数据。S3206. The server decrypts the first encrypted file using the first decryption key, and obtains the decrypted data corresponding to the first encrypted file.
S3207、服务器通过所述预设算法获取所述第一加密文件对应的解密数据的摘要信息。S3207. The server obtains the summary information of the decrypted data corresponding to the first encrypted file through the preset algorithm.
需要说明的是,服务器获取所述第一加密文件对应的解密数据的摘要信息算法与显示设备获取所述第一文件的摘要信息的算法一致。It should be noted that the algorithm used by the server to obtain the summary information of the decrypted data corresponding to the first encrypted file is consistent with the algorithm used by the display device to obtain the summary information of the first file.
S3208、服务器比对所述第一加密文件对应的解密数据的摘要信息是否与所述第一文件的摘要信息相同。S3208: The server compares whether the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file.
当显示设备为合法的显示设备时,由于生成第一加密文件的加密秘钥(第一加密秘钥)与解密第一加密文件的解密秘钥(第一解密秘钥)互为秘钥对,因此服务器获取解密数据即为第一文件,且因为显示设备与服务器获取摘要信息采用的算法相同,因此获取的摘要信息也应当是相同的;而当显示设备为非法设备时,由于生成第一加密文件的加密秘钥(第一加密秘钥)与解密第一加密文件的解密秘钥(第一解密秘钥)不互为秘钥对,因此服务器获取解密数据不会与第一文件相同,进而会导致获取的解密数据的摘要信息与第一文件的摘要信息不同,因此本公开实施例中可以根据所述第一加密文件对应的解密数据的摘要信息是否与所述第一文件的摘要信息相同来判断所述显示设备鉴权是否通过。When the display device is a legal display device, since the encryption key (first encryption key) for generating the first encrypted file and the decryption key (first decryption key) for decrypting the first encrypted file are a key pair, Therefore, the decrypted data obtained by the server is the first file, and because the algorithm used by the display device and the server to obtain summary information is the same, the summary information obtained should also be the same; and when the display device is an illegal device, because the first encrypted data is generated The encryption key of the file (first encryption key) and the decryption key (first decryption key) for decrypting the first encrypted file are not a key pair. Therefore, the decrypted data obtained by the server will not be the same as the first file, and thus This will cause the obtained summary information of the decrypted data to be different from the summary information of the first file. Therefore, in the embodiment of the present disclosure, it is possible to determine whether the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file. To determine whether the display device has passed the authentication.
即,在上述步骤S3208中,若所述第一加密文件对应的解密数据的摘要信息与所述第一文件的摘要信息不同,则可以确定显示设备鉴权不通过,决绝向所述显示设备发送业务凭证;若所述第一加密文件对应的解密数据的摘要信息与所述第一文件的摘要信息相同,则可以确定显示设备鉴权通过并执行如下后续步骤。That is, in the above-mentioned step S3208, if the summary information of the decrypted data corresponding to the first encrypted file is different from the summary information of the first file, it can be determined that the display device fails to authenticate, and the message is never sent to the display device. Business voucher; if the summary information of the decrypted data corresponding to the first encrypted file is the same as the summary information of the first file, it can be determined that the display device has passed the authentication and the following subsequent steps are performed.
S3209、服务器向所述显示设备发送所述业务凭证。S3209: The server sends the service voucher to the display device.
相应的,显示设备接收服务器发送的所述业务凭证。Correspondingly, the display device receives the service voucher sent by the server.
S3210、显示设备将所述业务凭证写入所述显示设备的预设存储位置。S3210. The display device writes the business voucher into a preset storage location of the display device.
向显示设备写入的第一加密秘钥可能会因为并非第一解密秘钥对应的加密秘钥等原因导致写入显示设备中的第一加密秘钥无效,进而导致显示设备无法从服务器获取业务凭证。为了保证写入显示设备中的第一加密秘钥的有效性,在将所述第一加密秘钥写入所述显示设备之后,根据一些实施例的业务凭证写入方法还会对写入显示设备中的第一加密秘钥的有效性进行校验。参照图33所示,对写入显示设备中的第一加密秘钥的有效性进行校验的过程包括如下步骤: The first encryption key written to the display device may be invalid because it is not the encryption key corresponding to the first decryption key, resulting in the display device being unable to obtain services from the server. certificate. In order to ensure the validity of the first encryption key written into the display device, after the first encryption key is written into the display device, the business voucher writing method according to some embodiments also performs the writing on the display device. The validity of the first encryption key in the device is verified. Referring to Figure 33, the process of verifying the validity of the first encryption key written in the display device includes the following steps:
S3301、显示设备根据所述第一加密秘钥生成第二设备签名。S3301. The display device generates a second device signature based on the first encryption key.
在一些实施例中,显示设备根据所述第一加密秘钥生成第二设备签名的实现方式可以与显示设备根据所述第一加密秘钥生成第二设备签名的实现方式相同。In some embodiments, the implementation manner in which the display device generates the second device signature based on the first encryption key may be the same as the implementation manner in which the display device generates the second device signature based on the first encryption key.
在一些实施例中,显示设备根据所述第一加密秘钥生成第二设备签名的实现方式可以为:通过所述第一加密秘钥对指定文件进行加密,以获取所述第二设备签名。In some embodiments, the display device may generate a second device signature based on the first encryption key by encrypting a specified file using the first encryption key to obtain the second device signature.
S3302、显示设备向所述服务器发送携带有所述第二设备签名的鉴权请求。S3302. The display device sends an authentication request carrying the signature of the second device to the server.
相应的,服务器接收显示设备发送的携带有所述第二设备签名的鉴权请求。Correspondingly, the server receives the authentication request sent by the display device and carries the signature of the second device.
其中,所述鉴权请求用于请求所述服务器根据所述第二设备签名对所述显示设备进行鉴权。Wherein, the authentication request is used to request the server to authenticate the display device according to the second device signature.
S3303、服务器根据所述第二设备签名和所述第一解密秘钥对所述显示设备进行鉴权。S3303. The server authenticates the display device according to the second device signature and the first decryption key.
在一些实施例中,显示设备根据所述第一加密秘钥生成第二设备签名的实现方式可以与显示设备根据所述第一加密秘钥生成第二设备签名的实现方式相同,此时,服务器根据所述第二设备签名和所述第一加密秘钥对应的第一解密秘钥对所述显示设备进行鉴权的实现方式与根据所述第一设备签名和所述第一加密秘钥对应的第一解密秘钥对所述显示设备进行鉴权的实现方式相同。In some embodiments, the display device generates the second device signature based on the first encryption key in the same manner as the display device generates the second device signature based on the first encryption key. At this time, the server The implementation of authenticating the display device based on the first decryption key corresponding to the second device signature and the first encryption key is the same as the implementation of authenticating the display device based on the first device signature and the first encryption key. The implementation of the first decryption key for authenticating the display device is the same.
在一些实施例中,显示设备根据所述第一加密秘钥生成第二设备签名的实现方式可以包括:通过所述第一加密秘钥对指定文件进行加密,以获取所述第二设备签名,此时服务器根据所述第二设备签名和所述第一加密秘钥对应的所述第一解密秘钥对所述显示设备进行鉴权的实现方式可以为:通过所述第一解密秘钥对所述第二加密文件进行解密,获取所述第二加密文件对应的解密数据,并根据所述第二加密文件对应的解密数据是否与所述指定文件相同,确定所述显示设备的鉴权是否通过。In some embodiments, the implementation of the display device generating a second device signature based on the first encryption key may include: encrypting a specified file using the first encryption key to obtain the second device signature, At this time, the server authenticates the display device according to the first decryption key corresponding to the second device signature and the first encryption key. The implementation method may be: through the first decryption key pair. Decrypt the second encrypted file, obtain the decrypted data corresponding to the second encrypted file, and determine whether the authentication of the display device is based on whether the decrypted data corresponding to the second encrypted file is the same as the specified file. pass.
S3304、服务器向显示设备发送鉴权响应。S3304. The server sends an authentication response to the display device.
相应的,显示设备接收服务器发送的鉴权响应。Correspondingly, the display device receives the authentication response sent by the server.
其中,所述鉴权响应用于指示所述显示设备鉴权通过,或者所述显示设备鉴权不通过。Wherein, the authentication response is used to indicate that the display device has passed the authentication, or the display device has failed to pass the authentication.
若所述鉴权响应指示所述显示设备鉴权通过,则执行如下步骤S3305,而若所述鉴权响应指示所述显示设备鉴权不通过,则执行如下步骤S3306。If the authentication response indicates that the display device has passed the authentication, the following step S3305 is executed. If the authentication response indicates that the display device fails the authentication, the following step S3306 is executed.
S3305、确定所述第一加密秘钥有效。S3305. Determine that the first encryption key is valid.
S3306、确定所述第一加密秘钥无效。S3306. Determine that the first encryption key is invalid.
上述实施例在将所述第一加密秘钥写入所述显示设备之后,还会进一步对第一加密秘钥的有效性进行验证,因此本公开实施可以避免写入显示设备的第一加密秘钥无效导致的显示设备无法从服务器获取业务凭证。In the above embodiment, after writing the first encryption key to the display device, the validity of the first encryption key will be further verified. Therefore, the disclosed implementation can avoid writing the first encryption key to the display device. The display device cannot obtain business credentials from the server due to an invalid key.
在一些实施例中,触发对第一加密秘钥的有效性进行校验方式可以为:响应于用户操作开始执行图33所示的用于对第一加密秘钥的有效性进行校验的流程。In some embodiments, triggering the verification of the validity of the first encryption key may be: in response to a user operation, starting to execute the process for verifying the validity of the first encryption key shown in Figure 33 .
例如:用户进入显示设备隐藏入口,如:设置(Settings)–声音(Sound)–高级 设置(Advance Settings),并按遥控器按键“2022”,打开出货品质检验(Outgoing Quality Control,OQC)应用程序,选择应用程序界面中的目标虚拟按键并确认,则开始执行图33所示的用于对第一加密秘钥的有效性进行校验的流程。For example: the user enters the hidden entrance of the display device, such as: Settings – Sound – Advanced Advance Settings, and press the remote control button "2022" to open the Outgoing Quality Control (OQC) application, select the target virtual button in the application interface and confirm, then start executing as shown in Figure 33 A process for verifying the validity of the first encryption key.
在服务器向显示设备发送业务凭证的过程,业务凭证可能被拦截,进而导致业务凭证被盗取。为了保证服务器向显示设备发送业务凭证的过程的安全性,参照图34所示,在图31所示实施例的基础上,上述步骤S3104(服务器向所述显示设备发送所述业务凭证)的实现方式可以包括:During the process of the server sending the business credentials to the display device, the business credentials may be intercepted, resulting in the business credentials being stolen. In order to ensure the security of the process of the server sending the business voucher to the display device, with reference to Figure 34, on the basis of the embodiment shown in Figure 31, the implementation of the above step S3104 (the server sends the business voucher to the display device) Methods may include:
S3104a、服务器向显示设备发送的第二加密文件。S3104a. The server sends the second encrypted file to the display device.
相应的,显示设备接收所述服务器发送的第二加密文件。Correspondingly, the display device receives the second encrypted file sent by the server.
其中,所述第二加密文件为基于第二加密秘钥对所述业务凭证进行加密得到的加密文件。Wherein, the second encrypted file is an encrypted file obtained by encrypting the business voucher based on a second encryption key.
在一些实施例中,服务器获取第二加密文件的实现方式可以包括:服务器接收上传的所述业务凭证和所述第二加密秘钥,并基于第二加密秘钥对所述业务凭证进行加密,以获取所述第二加密文件。In some embodiments, the implementation of the server obtaining the second encrypted file may include: the server receives the uploaded business voucher and the second encryption key, and encrypts the business voucher based on the second encryption key, to obtain the second encrypted file.
即,向服务器写入所述业务凭证和所述第二加密秘钥,然后由服务器基于第二加密秘钥对所述业务凭证进行加密生成所述第二加密文件。That is, the business voucher and the second encryption key are written to the server, and then the server encrypts the business voucher based on the second encryption key to generate the second encrypted file.
在一些实施例中,服务器获取第二加密文件的实现方式可以包括:服务器接收上传的所述第二加密文件。In some embodiments, the implementation of the server obtaining the second encrypted file may include: the server receiving the uploaded second encrypted file.
即,直接向服务器写入所述第二加密文件。That is, the second encrypted file is directly written to the server.
图34中以服务器获取第二加密文件的实现方式包括:服务器接收上传的所述业务凭证、所述第二加密秘钥,并基于第二加密秘钥对所述业务凭证进行加密,以获取所述第二加密文件为例示出,但本公开实施例中也可以直接向服务器上传所述第二加密文件。In Figure 34, the implementation of obtaining the second encrypted file by the server includes: the server receives the uploaded business voucher and the second encryption key, and encrypts the business voucher based on the second encryption key to obtain the The second encrypted file is shown as an example, but in the embodiment of the present disclosure, the second encrypted file can also be directly uploaded to the server.
相比于向服务器写入所述业务凭证和所述第二加密秘钥,向服务器写入所述第二加密文件可以避免业务凭证被从服务器盗取,进而进一步提升业务凭证的安全性。Compared with writing the business voucher and the second encryption key to the server, writing the second encrypted file to the server can prevent the business voucher from being stolen from the server, thereby further improving the security of the business voucher.
S3104b、显示设备获取写入所述显示设备的第二解密秘钥。S3104b. The display device obtains the second decryption key written in the display device.
其中,所述第二解密秘钥为所述第二加密秘钥对应的解密秘钥。Wherein, the second decryption key is the decryption key corresponding to the second encryption key.
在一些实施例中,可以在生产环境中将所述第二解密秘钥写入所述显示设备。In some embodiments, the second decryption key may be written to the display device in a production environment.
在一些实施中,所述第二加密秘钥与所述第二解密秘钥可以为对称加密算法中的秘钥。即,第一加密秘钥与第一解密秘钥相同。In some implementations, the second encryption key and the second decryption key may be keys in a symmetric encryption algorithm. That is, the first encryption key and the first decryption key are the same.
在一些实施中,所述第二加密秘钥与所述第二解密秘钥可以为非对称加密算法中的秘钥对,第二加密秘钥为非对称加密算法中的公钥,第二解密秘钥为非对称加密算法中的私钥。In some implementations, the second encryption key and the second decryption key may be a key pair in an asymmetric encryption algorithm, the second encryption key is a public key in an asymmetric encryption algorithm, and the second decryption key The secret key is the private key in the asymmetric encryption algorithm.
S3104c、显示设备通过所述第二解密秘钥对所述第二加密文件进行解密,以获取所述业务凭证S3104c. The display device decrypts the second encrypted file using the second decryption key to obtain the business voucher.
由于服务器向显示设备发送是加密后的业务凭证,因此上述实施例可以避免业务 凭证在服务器向显示设备发送的过程中被盗取,进而进一步提升业务凭证的安全性。Since the server sends encrypted business credentials to the display device, the above embodiment can avoid business The credentials are stolen during the process of being sent from the server to the display device, further improving the security of the business credentials.
向显示设备写入的第二解密秘钥可能会因为并非第二加密秘钥对应的解秘钥等原因导致写入显示设备中的第二解密秘钥无效,进而导致显示设备从服务器获取加密后的业务凭证(第二加密文件)后,无法解密出业务凭证。为了保证写入显示设备中的第二解密秘钥的有效性,在将所述第二解密秘钥写入所述显示设备之后,根据一些实施例的业务凭证写入方法还会对写入显示设备中的第二解密秘钥的有效性进行校验。参照图35所示,对写入显示设备中的第二解密秘钥的有效性进行校验的过程包括如下步骤:The second decryption key written to the display device may be invalid because it is not the decryption key corresponding to the second encryption key, causing the display device to obtain the encrypted data from the server. After decrypting the business voucher (second encrypted file), the business voucher cannot be decrypted. In order to ensure the validity of the second decryption key written into the display device, after the second decryption key is written into the display device, the business voucher writing method according to some embodiments also performs the writing on the display device. The validity of the second decryption key in the device is verified. Referring to Figure 35, the process of verifying the validity of the second decryption key written in the display device includes the following steps:
S3501、服务器向显示设备发送第三加密文件。S3501. The server sends the third encrypted file to the display device.
相应的,显示设备接收服务器发送的第三加密文件。Correspondingly, the display device receives the third encrypted file sent by the server.
其中,所述第三加密文件为基于所述第二加密秘钥对预设文件进行加密得到的加密文件。Wherein, the third encrypted file is an encrypted file obtained by encrypting a preset file based on the second encryption key.
S3502、显示设备通过所述第二解密秘钥对所述第三加密文件进行解密,获取所述第三加密文件对应的解密数据。S3502. The display device decrypts the third encrypted file using the second decryption key, and obtains the decrypted data corresponding to the third encrypted file.
S3503、显示设备比对所述第三加密文件对应的解密数据与所述预设文件是否相同。S3503. The display device compares whether the decrypted data corresponding to the third encrypted file is the same as the preset file.
在上述步骤S3503中,若所述第三加密文件对应的解密数据与所述预设文件相同,则执行如下步骤S3504,而若所述第三加密文件对应的解密数据与所述预设文件不同,则执行如下步骤S3505。In the above step S3503, if the decrypted data corresponding to the third encrypted file is the same as the default file, the following step S3504 is executed, and if the decrypted data corresponding to the third encrypted file is different from the default file , then execute the following step S3505.
S3504、确定所述第二解密秘钥有效。S3504. Determine that the second decryption key is valid.
S3505、确定所述第二解密秘钥无效。S3505. Determine that the second decryption key is invalid.
上述实施例在将所述第二解密秘钥写入所述显示设备之后,还会进一步对第二解密秘钥的有效性进行验证,因此本公开实施可以避免写入显示设备的第二解密秘钥无效导致的显示设备无法解密加密后的业务凭证。In the above embodiment, after the second decryption key is written into the display device, the validity of the second decryption key is further verified. Therefore, the disclosed implementation can avoid writing the second decryption key into the display device. The display device cannot decrypt the encrypted business credentials due to an invalid key.
向显示设备写入第二解密秘钥的过程一般为,首先将第二解密秘钥发放到显示设备的生产系统,然后再由显示设备的生产系统写入显示设备。然而,在将第二解密秘钥发放到显示设备的生产系统后,第二解密秘钥有可能被从生产系统中被窃取。为了避免第二解密秘钥在写入显示设备的过程中被窃取,参照图36所示,根据一些实施例的业务凭证写入方法中向显示设备写入第二解密秘钥的实现方式可以包括如下步骤:The process of writing the second decryption key to the display device generally involves first issuing the second decryption key to the production system of the display device, and then writing the second decryption key into the display device by the production system of the display device. However, after the second decryption key is issued to the production system of the display device, the second decryption key may be stolen from the production system. In order to prevent the second decryption key from being stolen during the writing process of the display device, referring to Figure 36, the implementation of writing the second decryption key to the display device in the business voucher writing method according to some embodiments may include Follow these steps:
S3601、显示设备接收写入的第四加密文件。S3601. The display device receives the written fourth encrypted file.
其中,所述第四加密文件为基于第三加密秘钥对所述第二解密秘钥进行加密得到的加密文件。Wherein, the fourth encrypted file is an encrypted file obtained by encrypting the second decryption key based on the third encryption key.
S3602、显示设备根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第四加密文件进行解密,以获取所述第二解密秘钥。S3602. The display device decrypts the fourth encrypted file according to the third decryption key preset in the software system of the display device to obtain the second decryption key.
其中,所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。Wherein, the third decryption key is the decryption key corresponding to the third encryption key.
即,预先在显示设备的软件系统中配置了第三解密秘钥,且发放到显示设备的生产系统第二解密秘钥是通过第三加密秘钥对第二解密秘钥加密进行加密得到的第四加 密文件,显示设备的生产系统直接将第四加密文件写入显示设备,显示再通过第三解密秘钥解密第四加密文件,以获取所述第二解密秘钥。That is, the third decryption key is configured in the software system of the display device in advance, and the second decryption key issued to the production system of the display device is obtained by encrypting the second decryption key with the third encryption key. four plus The production system of the display device directly writes the fourth encrypted file to the display device, and the display decrypts the fourth encrypted file using the third decryption key to obtain the second decryption key.
在一些实施中,所述第三加密秘钥与所述第三解密秘钥可以为对称加密算法中的秘钥。即,第三加密秘钥与第三解密秘钥相同。In some implementations, the third encryption key and the third decryption key may be keys in a symmetric encryption algorithm. That is, the third encryption key is the same as the third decryption key.
在一些实施中,所述第三加密秘钥与所述第三解密秘钥可以为非对称加密算法中的秘钥对,第三加密秘钥为非对称加密算法中的公钥,第三解密秘钥为非对称加密算法中的私钥。In some implementations, the third encryption key and the third decryption key may be a key pair in an asymmetric encryption algorithm, the third encryption key is a public key in an asymmetric encryption algorithm, and the third decryption key The secret key is the private key in the asymmetric encryption algorithm.
由于发放到显示设备的生产系统第二解密秘钥是通过第三加密秘钥对第二解密秘钥加密进行加密得到的第四加密文件,因此即使对第二解密秘钥进行窃取也只能窃取到第二解密秘钥密文,而无法获取第二解密秘钥的明文,因此上述实施例可以避免第二解密秘钥在写入显示设备的过程中被窃取,进而提升第二解密秘钥的安全性。Since the second decryption key of the production system issued to the display device is a fourth encrypted file obtained by encrypting the second decryption key with the third encryption key, even if the second decryption key is stolen, only the second decryption key can be stolen. The ciphertext of the second decryption key cannot be obtained, but the plaintext of the second decryption key cannot be obtained. Therefore, the above embodiment can prevent the second decryption key from being stolen during the process of writing to the display device, thereby improving the efficiency of the second decryption key. safety.
在一些实施例中,显示设备可以在被写入第四加密文件后,对通过第三解密秘钥对所述第四加密文件进行解密,并存储获取的第二解密秘钥,以便在后续需要使用时直接读取。In some embodiments, the display device may decrypt the fourth encrypted file using a third decryption key after being written to the fourth encrypted file, and store the obtained second decryption key so that it is needed later. Read directly when using.
在一些实施例中,显示设备可以仅在需要使用第二解密秘钥时通过第三解密秘钥对所述第四加密文件进行解密,获取第二解密秘钥,并在使用后删除。由于显示设备中存储也是第二解密秘钥的密文,本公开实施例还可以避免第二解密秘钥在显示设备中被窃取,进而进一步提升第二解密秘钥的安全性。In some embodiments, the display device can decrypt the fourth encrypted file using the third decryption key only when the second decryption key needs to be used, obtain the second decryption key, and delete it after use. Since the display device stores the ciphertext that is also the second decryption key, the embodiment of the present disclosure can also prevent the second decryption key from being stolen in the display device, thereby further improving the security of the second decryption key.
向显示设备写入第一加密秘钥的过程一般为,首先将第一加密秘钥发放到显示设备的生产系统,然后再由显示设备的生产系统写入显示设备。然而,在将第一加密秘钥发放到显示设备的生产系统后,第一加密秘钥也有可能被从生产系统中被窃取。为了避免第一加密秘钥在写入显示设备的过程中被窃取,参照图37所示,根据一些实施例的业务凭证写入方法中向显示设备写入第一加密秘钥的实现方式可以包括如下步骤:The process of writing the first encryption key to the display device generally involves first issuing the first encryption key to the production system of the display device, and then writing the first encryption key to the display device by the production system of the display device. However, after the first encryption key is issued to the production system of the display device, the first encryption key may also be stolen from the production system. In order to prevent the first encryption key from being stolen during the writing process of the display device, referring to Figure 37, the implementation of writing the first encryption key to the display device in the business voucher writing method according to some embodiments may include Follow these steps:
S3701、显示设备接收写入的第五加密文件。S3701. The display device receives the fifth encrypted file written.
其中,所述第五加密文件为基于第三加密秘钥对所述第一加密秘钥进行加密得到的加密文件。Wherein, the fifth encrypted file is an encrypted file obtained by encrypting the first encryption key based on a third encryption key.
S3702、显示设备根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第五加密文件进行解密,以获取所述第一加密秘钥。S3702. The display device decrypts the fifth encrypted file according to the third decryption key preset in the software system of the display device to obtain the first encryption key.
其中,所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。Wherein, the third decryption key is the decryption key corresponding to the third encryption key.
即,预先在显示设备的软件系统中配置了第三解密秘钥,且发放到显示设备的生产系统第一加密秘钥是通过第三加密秘钥对第一加密秘钥加密进行加密得到的第五加密文件,显示设备的生产系统直接将第五加密文件写入显示设备,显示再通过第三解密秘钥解密第五加密文件,以获取所述第一加密秘钥。That is, the third decryption key is configured in the software system of the display device in advance, and the first encryption key of the production system issued to the display device is the first encryption key obtained by encrypting the first encryption key with the third encryption key. Fifth encrypted file, the production system of the display device directly writes the fifth encrypted file to the display device, and the display decrypts the fifth encrypted file through the third decryption key to obtain the first encryption key.
由于发放到显示设备的生产系统第一加密秘钥是通过第三加密秘钥对第一加密秘钥加密进行加密得到的第五加密文件,因此即使对第一加密秘钥进行窃取也只能窃取到第一加密秘钥密文,而无法获取第一加密秘钥的明文,因此上述实施例可以避免第 一加密秘钥在写入显示设备的过程中被窃取,进而提升第一加密秘钥的安全性。Since the first encryption key of the production system issued to the display device is a fifth encrypted file obtained by encrypting the first encryption key with the third encryption key, even if the first encryption key is stolen, only the first encryption key can be stolen. to obtain the ciphertext of the first encryption key, but cannot obtain the plaintext of the first encryption key. Therefore, the above embodiment can avoid the third An encryption key is stolen during the process of writing to the display device, thereby improving the security of the first encryption key.
在一些实施例中,显示设备可以在被写入第五加密文件后,对通过第三解密秘钥对所述第五加密文件进行解密,并存储获取的第一加密秘钥,以便在后续需要使用时直接读取。In some embodiments, the display device may decrypt the fifth encrypted file using a third decryption key after being written to the fifth encrypted file, and store the obtained first encryption key so that it is needed later. Read directly when using.
在一些实施例中,显示设备可以仅在需要使用第一加密秘钥时通过第三解密秘钥对所述第五加密文件进行解密,获取第一加密秘钥,并在使用后删除。由于显示设备中存储也是第一加密秘钥的密文,本公开实施例还可以避免第一加密秘钥在显示设备中被窃取,进而进一步提升第一加密秘钥的安全性。In some embodiments, the display device can decrypt the fifth encrypted file using the third decryption key only when the first encryption key needs to be used, obtain the first encryption key, and delete it after use. Since the display device stores the ciphertext that is also the first encryption key, embodiments of the present disclosure can also prevent the first encryption key from being stolen in the display device, thereby further improving the security of the first encryption key.
为了方便解释,已经结合在本公开的某一实施例中实施方式进行了上述说明。但是,上述在一些实施例中讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释本公开的内容,从而使得本领域技术人员更好的使用实施方式。 For convenience of explanation, the above description has been made in connection with the implementation in a certain embodiment of the present disclosure. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Various modifications and variations are possible in light of the above teachings. The above embodiments are selected and described to better explain the contents of the present disclosure, thereby enabling those skilled in the art to better use the embodiments.

Claims (28)

  1. 一种显示设备,包括:A display device including:
    显示器,被配置为显示投屏功能页面,所述投屏功能页面包含所述显示设备的投屏信息;A display configured to display a screen projection function page, where the screen projection function page contains screen projection information of the display device;
    控制器,被配置为:Controller, configured as:
    响应于用户输入的指示显示所述投屏功能页面的指令,获取设备标识,所述设备标识用于验证所述显示设备使用投屏功能的权限;In response to an instruction input by the user to display the screen projection function page, obtain a device identification, and the device identification is used to verify the permission of the display device to use the screen projection function;
    若未获取到所述设备标识,或者根据获取到的所述设备标识验证所述显示设备不具有投屏功能的使用权限,则不启动投屏功能,并控制所述显示器呈黑屏状态,并显示提示信息;If the device identification is not obtained, or it is verified based on the obtained device identification that the display device does not have the permission to use the screen projection function, the screen projection function will not be started, and the display will be controlled to be in a black screen state and display Prompt information;
    在根据获取到的所述设备标识验证所述显示设备具有投屏功能的使用权限之后,启动投屏功能,并在投屏功能启动之后控制所述显示器显示所述投屏功能页面。After verifying that the display device has the permission to use the screen projection function based on the obtained device identification, the screen projection function is started, and after the screen projection function is started, the display is controlled to display the screen projection function page.
  2. 根据权利要求1所述的显示设备,所述控制器还控制所述显示器显示第一入口,所述控制器,还被配置为:The display device according to claim 1, the controller further controls the display to display the first entrance, and the controller is further configured to:
    响应于用户基于所述第一入口输入的进入指令,控制所述显示器显示第一询问页面,所述第一询问页面用于询问用户是否再次获取设备标识;In response to an entry instruction input by the user based on the first portal, controlling the display to display a first inquiry page, the first inquiry page being used to inquire the user whether to obtain the device identification again;
    响应于用户输入的指示重新获取设备标识的指令,获取设备标识,并控制所述显示器显示等待页面。In response to an instruction input by the user to re-obtain the device identification, the device identification is obtained, and the display is controlled to display a waiting page.
  3. 根据权利要求2所述的显示设备,所述等待页面包括倒计时图标,所述倒计时图标包括时长数值和/或进度图示,其中,所述时长数值用于表示所述控制器获取到所述设备标识的剩余时长,所述时长数值的初始值为所述控制器预计获取到所述设备标识的总时长,所述进度图示用于表示所述控制器获取所述设备标识的进度,所述控制器获取所述设备标识的总进度对应的总时长与所述时长数值的初始值相等。The display device according to claim 2, the waiting page includes a countdown icon, the countdown icon includes a duration value and/or a progress icon, wherein the duration value is used to indicate that the controller obtains the device The remaining duration of the identification, the initial value of the duration value is the total duration expected by the controller to obtain the device identification, the progress icon is used to represent the progress of the controller in obtaining the device identification, the The total duration corresponding to the total progress obtained by the controller and identified by the device is equal to the initial value of the duration value.
  4. 根据权利要求2所述的显示设备,所述控制器,还被配置为:The display device according to claim 2, the controller is further configured to:
    响应于用户输入的指示再次获取设备标识的指令;Instructions to obtain the device identity again in response to instructions input by the user;
    获取所述设备标识之后,所述控制器还被配置为:After obtaining the device identification, the controller is also configured to:
    若在至少一次重新获取设备标识之后,未获取到所述设备标识,或者根据获取到的所述设备标识验证所述显示设备不具有投屏功能的使用权限,则控制所述显示器显示更新失败页面,所述更新失败页面包括指定编号和操作提示,所述指定编号与设备标识唯一对应,所述操作提示用于提示用户向第三方终端或服务器反馈所述指定编号,以通过所述第三方终端或服务器更新设备标识。If the device identification is not obtained after re-obtaining the device identification at least once, or it is verified based on the obtained device identification that the display device does not have the permission to use the screen projection function, control the display to display an update failure page , the update failure page includes a designated number and an operation prompt, the designated number uniquely corresponds to the device identification, and the operation prompt is used to prompt the user to feed back the designated number to a third-party terminal or server to pass the third-party terminal Or the server updates the device identity.
  5. 根据权利要求4所述的显示设备,所述更新失败页面还包括确认选项,所述控制器,还被配置为:The display device according to claim 4, the update failure page further includes a confirmation option, and the controller is further configured to:
    响应于用户基于所述确认选项输入的指令,以预设的通信方式将所述指定编号发送至所述第三方终端或服务器。 In response to an instruction input by the user based on the confirmation option, the designated number is sent to the third-party terminal or server in a preset communication method.
  6. 根据权利要求1所述的显示设备,所述控制器,还被配置为:The display device according to claim 1, the controller is further configured to:
    启动投屏功能,并在投屏功能启动之后控制所述显示器显示所述投屏功能页面,包括:Start the screen projection function, and control the display to display the screen projection function page after the screen projection function is started, including:
    通过投屏服务根据所述投屏功能页面的入口传递的指令,获取操作系统的启动状态,并向投屏应用程序发送启动通知,以启动所述投屏应用程序,其中,所述启动通知根据所述操作系统的启动状态生成;Through the screen casting service, the startup status of the operating system is obtained according to the instructions passed at the entrance of the screen casting function page, and a startup notification is sent to the screen casting application to start the screen casting application, wherein the startup notification is based on Generating a startup state of the operating system;
    通过所述投屏应用程序根据所述启动通知,以与所述操作系统的启动状态对应的目标通信模式向投屏进程发送启动完毕的通知,以令所述投屏进程驱动所述显示器显示所述投屏功能页面。The screen projection application sends a startup completion notification to the screen projection process in the target communication mode corresponding to the startup state of the operating system according to the startup notification, so that the screen projection process drives the display to display the required information. Describe the screencasting function page.
  7. 根据权利要求6所述的显示设备,所述操作系统的启动状态为正在启动,所述目标通信模式为所述投屏应用程序通过所述投屏服务向所述投屏进程传递启动完毕的通知,所述控制器,还被配置为:The display device according to claim 6, the startup state of the operating system is starting, and the target communication mode is that the screen casting application transmits a startup completion notification to the screen casting process through the screen casting service. , the controller is also configured as:
    通过所述投屏应用程序以前台广播的广播方式向所述投屏服务发送所述启动完毕的通知;Send the notification of completion of startup to the screen casting service in a foreground broadcast manner through the screen casting application;
    通过所述投屏服务向所述投屏进程发送所述启动完毕的通知,以令所述投屏进程驱动所述显示器显示所述投屏功能页面。The start-up completion notification is sent to the screen casting process through the screen casting service, so that the screen casting process drives the display to display the screen casting function page.
  8. 根据权利要求6所述的显示设备,所述目标通信模式为所述投屏应用程序直接向所述投屏进程发送启动完毕的通知,所述控制器,还被配置为:The display device according to claim 6, the target communication mode is that the screen projection application directly sends a startup completion notification to the screen projection process, and the controller is further configured to:
    在所述投屏应用程序与所述投屏进程之间建立通信连接;Establish a communication connection between the screen casting application and the screen casting process;
    通过所述投屏应用程序向所述投屏进程发送所述启动完毕的通知,以令所述投屏进程驱动所述显示器显示所述投屏功能页面。The start-up completion notification is sent to the screen casting process through the screen casting application, so that the screen casting process drives the display to display the screen casting function page.
  9. 根据权利要求1所述的显示设备,所述显示设备还包括:The display device according to claim 1, further comprising:
    通信器,被配置为:接收用户通过操作控制装置的返回按键生成的返回指令;The communicator is configured to: receive a return instruction generated by the user by operating a return button of the control device;
    控制器还被配置为:响应所述返回指令,确定所述显示器当前是否展示投屏信息页面,所述投屏信息页面符合指定隔空播放协议的要求;以及,确定所述显示器当前展示所述投屏信息页面时,控制所述显示器返回展示预先指定的页面。The controller is further configured to: respond to the return instruction, determine whether the display currently displays the screen projection information page, and the screen projection information page meets the requirements of the specified air play protocol; and determine whether the display currently displays the screen projection information page. When projecting an information page, the display is controlled to return to display a pre-specified page.
  10. 根据权利要求9所述的显示设备,所述控制器执行确定所述显示器当前展示所述投屏信息页面时,控制所述显示器返回展示预先指定的页面,被配置为:The display device according to claim 9, when the controller determines that the display is currently displaying the screen projection information page, controls the display to return to display a pre-specified page, and is configured as:
    根据所述显示设备进入所述投屏信息页面之前处于启动状态的数据源对象,控制所述显示器返回显示所述数据源对象对应的指定页面;不同的数据源对象对应的指定页面不同。According to the data source object in the activated state before the display device enters the screen projection information page, the display is controlled to return to display the designated page corresponding to the data source object; different data source objects correspond to different designated pages.
  11. 根据权利要求10所述的显示设备,所述控制器执行根据所述显示设备进入所述投屏信息页面之前处于启动状态的数据源对象,控制所述显示器返回显示所述数据源对象对应的指定页面,被配置为:The display device according to claim 10, the controller executes according to the data source object in the activated state before the display device enters the screen projection information page, and controls the display to return to display the specified data source object corresponding to the display device. Page, configured as:
    若所述数据源对象为所述显示设备所支持的信号源,则控制所述显示器返回显示所述显示设备的操作系统的桌面; If the data source object is a signal source supported by the display device, control the display to return to the desktop displaying the operating system of the display device;
    若所述数据源对象为安装在所述显示设备的操作系统的应用程序层中的应用程序,则控制所述显示器返回显示所述应用程序对应的主页面。If the data source object is an application installed in the application layer of the operating system of the display device, the display is controlled to return to display the main page corresponding to the application.
  12. 根据权利要求11所述的显示设备,所述控制器,还被配置为:The display device according to claim 11, the controller is further configured to:
    获取自定义参数;Get custom parameters;
    确定所述自定义参数的值是否等于预设值;Determine whether the value of the custom parameter is equal to the preset value;
    若等于,则确定进入所述投屏信息页面之前处于启动状态的所述数据源对象为所述显示设备所支持的信号源;If equal, it is determined that the data source object in the activated state before entering the screen projection information page is a signal source supported by the display device;
    若不等于,则确定进入所述投屏信息页面之前处于启动状态的所述数据源对象为安装在所述显示设备的操作系统的应用程序层中的应用程序。If not, it is determined that the data source object in the startup state before entering the screen projection information page is an application installed in the application layer of the operating system of the display device.
  13. 根据权利要求9所述的显示设备,所述控制器,还被配置为:确定所述显示器当前展示所述投屏信息页面时,调用所述显示设备中的隔空播放软件工具开发包SDK将所述通信器输入的所述返回指令以广播的方式发送给隔空播放应用程序,以使所述隔空播放应用程序响应所述返回指令,控制所述显示器返回展示预先指定的页面。The display device according to claim 9, the controller is further configured to: when determining that the display is currently displaying the screen projection information page, calling the airplay software tool development kit SDK in the display device to The return instruction input by the communicator is sent to the airplay application program in a broadcast manner, so that the airplay application program responds to the return instruction and controls the display to return to display a pre-specified page.
  14. 根据权利要求13所述的显示设备,所述控制器执行调用所述显示设备中的隔空播放软件工具开发包SDK将所述通信器输入的所述返回指令以广播的方式发送给隔空播放应用程序,被配置为:The display device according to claim 13, the controller executes calling the AirPlay software tool development kit SDK in the display device to send the return instruction input by the communicator to AirPlay in a broadcast manner. Application, configured as:
    调用所述隔空播放SDK将所述返回指令转发给启动服务,通过调用所述启动服务广播所述返回指令,以将所述返回指令发送给所述隔空播放应用程序。The airplay SDK is called to forward the return instruction to the startup service, and the return instruction is broadcast by calling the startup service to send the return instruction to the airplay application.
  15. 根据权利要求14所述的显示设备,所述控制器执行调用所述隔空播放SDK将所述返回指令转发给启动服务,被配置为:调用所述隔空播放SDK以套接字的方式将所述返回指令发送给所述启动服务。The display device according to claim 14, the controller executes calling the airplay SDK to forward the return instruction to the startup service, and is configured to: call the airplay SDK to forward the return instruction to the start service in a socket manner. The return instruction is sent to the startup service.
  16. 根据权利要求9所述的显示设备,所述控制器执行确定所述显示器当前展示所述投屏信息页面时,控制所述显示器返回展示预先指定的页面,被配置为:控制所述显示器返回显示所述显示设备的操作系统的桌面。The display device according to claim 9, when the controller determines that the display is currently displaying the screen projection information page, controls the display to return to display a pre-specified page, and is configured to: control the display to return to display The desktop of the operating system of the display device.
  17. 根据权利要求9-16中任一所述的显示设备,所述显示设备还包括:The display device according to any one of claims 9-16, further comprising:
    存储器,被配置为将业务凭证写入所述显示设备的预设存储位置;A memory configured to write business credentials into a preset storage location of the display device;
    所述控制器,还被配置为根据写入所述显示设备的第一加密秘钥生成第一设备签名;The controller is further configured to generate a first device signature based on the first encryption key written to the display device;
    所述通信器,还被配置为向服务器发送携带有所述第一设备签名的凭证获取请求;所述凭证获取请求用于请求所述服务器在基于所述第一设备签名确定所述显示设备鉴权通过的情况下返回所述显示设备对应的业务凭证;The communicator is further configured to send a credential acquisition request carrying the first device signature to the server; the credential acquisition request is used to request the server to determine the display device authentication based on the first device signature. If the right is passed, the business voucher corresponding to the display device is returned;
    接收所述服务器发送的所述业务凭证。Receive the service voucher sent by the server.
  18. 根据权利要求17所述的显示设备,所述控制器执行根据写入所述显示设备的第一加密秘钥生成第一设备签名,被配置为:The display device according to claim 17, the controller performs generating a first device signature according to a first encryption key written in the display device, and is configured to:
    通过所述第一加密秘钥对第一文件进行加密,获取第一加密文件;Encrypt the first file using the first encryption key to obtain the first encrypted file;
    基于预设算法获取所述第一文件的摘要信息; Obtain summary information of the first file based on a preset algorithm;
    根据所述第一加密文件和所述摘要信息生成所述第一设备签名。The first device signature is generated based on the first encrypted file and the summary information.
  19. 根据权利要求17所述的显示设备,所述控制器,还被配置为在将所述第一加密秘钥写入所述显示设备之后,根据所述第一加密秘钥生成第二设备签名;The display device of claim 17, the controller, further configured to generate a second device signature based on the first encryption key after writing the first encryption key to the display device;
    所述通信器,还被配置为向所述服务器发送携带有所述第二设备签名的鉴权请求,以及接收所述服务器发送的鉴权响应;所述鉴权请求用于请求所述服务器根据所述第二设备签名对所述显示设备进行鉴权;The communicator is also configured to send an authentication request carrying the signature of the second device to the server, and receive an authentication response sent by the server; the authentication request is used to request the server according to The second device signature authenticates the display device;
    所述控制器,还被配置为在所述鉴权响应指示所述显示设备鉴权通过的情况下,确定所述第一加密秘钥有效,在所述鉴权响应指示所述显示设备鉴权不通过的情况下,确定所述第一加密秘钥无效。The controller is further configured to determine that the first encryption key is valid when the authentication response indicates that the display device is authenticated. If it fails, it is determined that the first encryption key is invalid.
  20. 根据权利要求17所述的显示设备,所述通信器执行接收所述服务器发送的所述业务凭证,被配置为:The display device according to claim 17, the communicator performs receiving the service voucher sent by the server, and is configured to:
    接收所述服务器发送的第二加密文件,所述第二加密文件为基于第二加密秘钥对所述业务凭证进行加密得到的加密文件;Receive a second encrypted file sent by the server, where the second encrypted file is an encrypted file obtained by encrypting the business voucher based on a second encryption key;
    获取写入所述显示设备的第二解密秘钥,所述第二解密秘钥为所述第二加密秘钥对应的解密秘钥;Obtain a second decryption key written to the display device, where the second decryption key is the decryption key corresponding to the second encryption key;
    通过所述第二解密秘钥对所述第二加密文件进行解密,以获取所述业务凭证。Decrypt the second encrypted file using the second decryption key to obtain the business voucher.
  21. 根据权利要求20所述的显示设备,所述通信器,还被配置为在将所述第二解密秘钥写入所述显示设备之后,接收所述服务器发送的第三加密文件;所述第三加密文件为基于所述第二加密秘钥对预设文件进行加密得到的加密文件;The display device according to claim 20, the communicator is further configured to receive a third encrypted file sent by the server after writing the second decryption key to the display device; the third The third encrypted file is an encrypted file obtained by encrypting the preset file based on the second encryption key;
    所述控制器,还被配置为通过所述第二解密秘钥对所述第三加密文件进行解密获取解密数据,以及在所述解密数据与所述预设文件一致的情况下,确定所述第二解密秘钥有效,在所述解密数据与所述预设文件不一致的情况下,确定所述第二解密秘钥无效。The controller is further configured to decrypt the third encrypted file using the second decryption key to obtain decrypted data, and when the decrypted data is consistent with the preset file, determine that the The second decryption key is valid. If the decryption data is inconsistent with the preset file, it is determined that the second decryption key is invalid.
  22. 根据权利要求20所述的显示设备,所述存储器,还被配置为接收写入的第四加密文件,所述第四加密文件为基于第三加密秘钥对所述第二解密秘钥进行加密得到的加密文件;The display device according to claim 20, the memory is further configured to receive a written fourth encrypted file, the fourth encrypted file encrypts the second decryption key based on a third encryption key. The obtained encrypted file;
    所述控制器,还被配置为根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第四加密文件进行解密,以获取所述第二解密秘钥;所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。The controller is further configured to decrypt the fourth encrypted file according to a third decryption key preset in the software system of the display device to obtain the second decryption key; The third decryption key is the decryption key corresponding to the third encryption key.
  23. 根据权利要求17所述的显示设备,所述存储器,还被配置为接收写入的第五加密文件,所述第五加密文件为基于第三加密秘钥对所述第一加密秘钥进行加密得到的加密文件;The display device according to claim 17, the memory is further configured to receive a written fifth encrypted file, the fifth encrypted file encrypts the first encryption key based on a third encryption key. The obtained encrypted file;
    所述控制器,还被配置为根据预置于所述显示设备的软件系统中的第三解密秘钥对所述第五加密文件进行解密,以获取所述第一加密秘钥,所述第三解密秘钥为所述第三加密秘钥对应的解密秘钥。The controller is further configured to decrypt the fifth encrypted file according to a third decryption key preset in the software system of the display device to obtain the first encryption key, and the third The third decryption key is the decryption key corresponding to the third encryption key.
  24. 一种用于显示设备的处理方法,所述方法包括: A processing method for a display device, the method includes:
    响应于用户输入的指示显示所述投屏功能页面的指令,获取设备标识,所述设备标识用于验证所述显示设备使用投屏功能的权限;In response to an instruction input by the user to display the screen projection function page, obtain a device identification, and the device identification is used to verify the permission of the display device to use the screen projection function;
    若未获取到所述设备标识,或者根据获取到的所述设备标识验证所述显示设备不具有投屏功能的使用权限,则不启动投屏功能,并控制所述显示器呈黑屏状态,并显示提示信息;If the device identification is not obtained, or it is verified based on the obtained device identification that the display device does not have the permission to use the screen projection function, the screen projection function will not be started, and the display will be controlled to be in a black screen state and display Prompt information;
    在根据获取到的所述设备标识验证所述显示设备具有投屏功能的使用权限之后,启动投屏功能,并在投屏功能启动之后控制所述显示器显示所述投屏功能页面。After verifying that the display device has the permission to use the screen projection function based on the obtained device identification, the screen projection function is started, and after the screen projection function is started, the display is controlled to display the screen projection function page.
  25. 根据权利要求24所述的方法,所述启动投屏功能,并在投屏功能启动之后显示所述投屏功能页面,包括:The method according to claim 24, activating the screen projection function and displaying the screen projection function page after the screen projection function is started includes:
    通过投屏服务根据所述投屏功能页面的入口传递的指令,获取操作系统的启动状态,并向投屏应用程序发送启动通知,以启动所述投屏应用程序,其中,所述启动通知根据所述操作系统的启动状态生成;Through the screen casting service, the startup status of the operating system is obtained according to the instructions passed at the entrance of the screen casting function page, and a startup notification is sent to the screen casting application to start the screen casting application, wherein the startup notification is based on Generating a startup state of the operating system;
    通过所述投屏应用程序根据所述启动通知,以与所述操作系统的启动状态对应的目标通信模式向投屏进程发送启动完毕的通知,以令所述投屏进程驱动所述显示器显示所述投屏功能页面。The screen projection application sends a startup completion notification to the screen projection process in the target communication mode corresponding to the startup state of the operating system according to the startup notification, so that the screen projection process drives the display to display the required information. Describe the screencasting function page.
  26. 根据权利要求24所述的方法,所述方法还包括:The method of claim 24, further comprising:
    接收用户通过操作控制装置的返回按键生成的返回指令;Receive the return instruction generated by the user by operating the return button of the control device;
    响应所述返回指令,确定当前是否展示投屏信息页面,所述投屏信息页面符合指定隔空播放协议的要求;In response to the return instruction, determine whether the screen projection information page is currently displayed, and the screen projection information page meets the requirements of the specified air playback protocol;
    确定当前展示所述投屏信息页面时,控制返回展示预先指定的页面。When it is determined that the screen projection information page is currently displayed, the control returns to displaying the pre-specified page.
  27. 根据权利要求26所述的方法,所述确定当前展示所述投屏信息页面时,控制返回展示预先指定的页面,包括:According to the method of claim 26, when it is determined that the projection information page is currently displayed, controlling the return to display a pre-specified page includes:
    确定所述显示器当前展示所述投屏信息页面时,根据所述显示设备进入所述投屏信息页面之前处于启动状态的数据源对象;When it is determined that the display is currently displaying the screen projection information page, the data source object in the activated state before the display device enters the screen projection information page is determined;
    控制所述显示器返回显示所述数据源对象对应的指定页面;其中,不同的数据源对象对应的指定页面不同。Control the display to return to display the designated page corresponding to the data source object; wherein different data source objects correspond to different designated pages.
  28. 根据权利要求24所述的方法,所述方法还包括:The method of claim 24, further comprising:
    根据写入显示设备的第一加密秘钥生成第一设备签名;Generate a first device signature based on the first encryption key written to the display device;
    向服务器发送携带有所述第一设备签名的凭证获取请求,所述凭证获取请求用于请求所述服务器在基于所述第一设备签名确定所述显示设备鉴权通过的情况下返回所述显示设备对应的业务凭证;Send a credential acquisition request carrying the first device signature to the server, where the credential acquisition request is used to request the server to return the display if it is determined that the display device is authenticated based on the first device signature. Business credentials corresponding to the device;
    接收所述服务器发送的所述业务凭证;Receive the business voucher sent by the server;
    将所述业务凭证写入所述显示设备的预设存储位置。 Write the business voucher into a preset storage location of the display device.
PCT/CN2023/078668 2022-06-28 2023-02-28 Display device and processing method for display device WO2024001257A1 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202210746808.9 2022-06-28
CN202210746808.9A CN115150645A (en) 2022-06-28 2022-06-28 Display device and display method of screen projection function page
CN202210803145.X 2022-07-07
CN202210803145.XA CN117411651A (en) 2022-07-07 2022-07-07 Display device, server and service credential writing method
CN202210977484.X 2022-08-15
CN202210977484.XA CN115454367A (en) 2022-08-15 2022-08-15 Display device and display device control method

Publications (1)

Publication Number Publication Date
WO2024001257A1 true WO2024001257A1 (en) 2024-01-04

Family

ID=89382576

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/078668 WO2024001257A1 (en) 2022-06-28 2023-02-28 Display device and processing method for display device

Country Status (1)

Country Link
WO (1) WO2024001257A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109451345A (en) * 2018-11-05 2019-03-08 四川长虹电器股份有限公司 A kind of method that DLNA throws screen authority managing and controlling in Android intelligent television
CN110248216A (en) * 2019-06-03 2019-09-17 广东有线广播电视网络有限公司 TV throws screen method, apparatus, TV throws screen system and computer equipment
CN112256225A (en) * 2020-10-21 2021-01-22 深圳前海茂佳软件科技有限公司 Screen projection method, server, terminal device and computer readable storage medium
CN113590067A (en) * 2021-07-28 2021-11-02 深圳创维-Rgb电子有限公司 Screen projection control method, system, device and computer readable storage medium
CN115150645A (en) * 2022-06-28 2022-10-04 海信视像科技股份有限公司 Display device and display method of screen projection function page
CN115454367A (en) * 2022-08-15 2022-12-09 海信视像科技股份有限公司 Display device and display device control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109451345A (en) * 2018-11-05 2019-03-08 四川长虹电器股份有限公司 A kind of method that DLNA throws screen authority managing and controlling in Android intelligent television
CN110248216A (en) * 2019-06-03 2019-09-17 广东有线广播电视网络有限公司 TV throws screen method, apparatus, TV throws screen system and computer equipment
CN112256225A (en) * 2020-10-21 2021-01-22 深圳前海茂佳软件科技有限公司 Screen projection method, server, terminal device and computer readable storage medium
CN113590067A (en) * 2021-07-28 2021-11-02 深圳创维-Rgb电子有限公司 Screen projection control method, system, device and computer readable storage medium
CN115150645A (en) * 2022-06-28 2022-10-04 海信视像科技股份有限公司 Display device and display method of screen projection function page
CN115454367A (en) * 2022-08-15 2022-12-09 海信视像科技股份有限公司 Display device and display device control method

Similar Documents

Publication Publication Date Title
CN108595970B (en) Configuration method and device of processing assembly, terminal and storage medium
CN109963178B (en) Method for projecting screen by using safe screen projector and safe screen projector
US9088861B2 (en) Method and apparatus for bearer and server independent parental control on smartphone, managed by smartphone
US11210076B2 (en) Downloading and launching an app on a second device from a first device
US8266341B2 (en) Display apparatus, control method thereof and control method of external device
US20110247013A1 (en) Method for Communicating Between Applications on an External Device and Vehicle Systems
CN111787377B (en) Display device and screen projection method
WO2020168561A1 (en) Device network distribution method and apparatus, electronic device, and storage medium
KR102121358B1 (en) Data transmission method and device
US10728486B2 (en) Smart television playing method and device
CN111757152B (en) Multimedia content projection method and device and electronic equipment
CN114286165A (en) Display device, mobile terminal and screen projection data transmission method
JP2016537904A (en) WI-FI network connection method, apparatus, program, and recording medium
CN105228141A (en) A kind of methods, devices and systems set up network and connect
US10764038B2 (en) Method and apparatus for generating terminal key
CN113784200A (en) Communication terminal, display device and screen projection connection method
WO2024001257A1 (en) Display device and processing method for display device
US20140181880A1 (en) Broadcasting system and method for multimedia bitstream
CN112911380A (en) Display device and connection method with Bluetooth device
KR101709861B1 (en) Settop box, method and computer program for controlling of internet of things device using the same
CN115150645A (en) Display device and display method of screen projection function page
US20210326492A1 (en) Transaction security processing method and apparatus, and terminal device
WO2024007719A1 (en) Display device, and control method for display device
WO2020187008A1 (en) Service invocation control method, service invocation method, device, and terminal
CN114286320A (en) Display device, mobile terminal and Bluetooth connection method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23829449

Country of ref document: EP

Kind code of ref document: A1