WO2022205793A1 - 显示设备及设备控制方法 - Google Patents

显示设备及设备控制方法 Download PDF

Info

Publication number
WO2022205793A1
WO2022205793A1 PCT/CN2021/118613 CN2021118613W WO2022205793A1 WO 2022205793 A1 WO2022205793 A1 WO 2022205793A1 CN 2021118613 W CN2021118613 W CN 2021118613W WO 2022205793 A1 WO2022205793 A1 WO 2022205793A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display device
video call
state
speaker mode
Prior art date
Application number
PCT/CN2021/118613
Other languages
English (en)
French (fr)
Inventor
穆聪聪
付延松
王学磊
卢可敬
徐桂玲
马晓燕
吴聪聪
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110340150.7A external-priority patent/CN114302201B/zh
Priority claimed from CN202110413878.8A external-priority patent/CN114339358A/zh
Priority claimed from CN202110412706.9A external-priority patent/CN114302238B/zh
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2022205793A1 publication Critical patent/WO2022205793A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working

Definitions

  • the present application relates to the technical field of smart TVs, and in particular, to a display device and a device control method.
  • the display devices can be smart TVs or other products with smart display screens.
  • a state different from the display mode and the shutdown state can be configured for the display device, such as a speaker mode.
  • speaker mode the display of the display device is turned off and the host is running normally. At this time, the display device can still respond to voice commands and use the display device as a smart speaker.
  • the display device provided by this application includes:
  • a display configured to present a user interface
  • controller connected to the display, the controller configured to:
  • the specified application refers to the application that needs to present the content on the display during operation
  • the speaker mode refers to the display device. The mode in which the controller is in the running state and the display is in the off-screen state
  • the use state of the display is switched to the open-screen state, so that the local end of the display device exits the speaker mode, and the content of the specified application is presented in the display in the open-screen state , and, after the running of the specified application is completed, the use state of the display is switched to the off-screen state, so that the local end of the display device enters the speaker mode;
  • the present application also provides a display device, including:
  • a display configured to present a user interface
  • controller connected to the display, the controller configured to:
  • the speaker mode refers to a mode in which the controller of the display device is in a running state and the display is in a screen-off state.
  • the present application also provides an intelligent terminal, including:
  • a display configured to present a user interface
  • controller connected to the display, the controller configured to:
  • the target display device is used to determine whether it is in the speaker mode in response to the video call request, so as to switch the screen-on state and the screen-off state of the target display, and the speaker mode refers to the display device mode in which the controller is running and the display is off.
  • the present application also provides a device control method, which is applied to a display device, and the method includes:
  • the specified application refers to the application that needs to present the content on the display during operation
  • the speaker mode refers to the display device. The mode in which the controller is in the running state and the display is in the off-screen state
  • the use state of the display is switched to the open-screen state, so that the local end of the display device exits the speaker mode, and the content of the specified application is presented in the display in the open-screen state , and, after the running of the specified application is completed, the use state of the display is switched to the off-screen state, so that the local end of the display device enters the speaker mode;
  • the present application further provides a device control method, which is applied to a display device, and the method includes:
  • the speaker mode refers to a mode in which the controller of the display device is in a running state and the display is in a screen-off state.
  • the present application also provides a device control method, which is applied to an intelligent terminal, and the method includes:
  • the target display device is used to determine whether it is in the speaker mode in response to the video call request, so as to switch the screen-on state and the screen-off state of the target display, and the speaker mode refers to the display device mode in which the controller is running and the display is off.
  • the application also provides a storage medium, the computer storage medium can store a program, and when the program is executed, part or all of the embodiments of the method for automatically switching the screen on and off in the speaker mode provided by the application can be implemented. step.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments
  • FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments
  • FIG. 3 exemplarily shows a hardware configuration block diagram of the control device 100 according to some embodiments
  • FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments
  • FIG. 5 exemplarily shows a schematic diagram of displaying an icon control interface of an application in the display device 200 according to some embodiments
  • FIG. 6 shows an overall architecture diagram of a speaker mode according to some embodiments
  • FIG. 7 shows a flowchart of a display device entering a speaker mode according to some embodiments
  • FIG. 8 shows a flowchart of a display device exiting a speaker mode according to some embodiments
  • FIG. 9 shows a first flow chart of a method for automatically switching a screen on and off in a speaker mode according to some embodiments
  • FIG. 10 shows a first data flow diagram of a method for automatically switching a screen on and off in a speaker mode according to some embodiments
  • FIG. 11 shows a second flow chart of a method for automatically switching a screen on and off in a speaker mode according to some embodiments
  • FIG. 12 shows a second data flow diagram of the method for automatically switching the screen on and off in speaker mode according to some embodiments
  • FIG. 13 shows a third flowchart of a method for automatically switching a screen on and off in a speaker mode according to some embodiments
  • FIG. 14 shows a third data flow diagram of a method for automatically switching a screen on and off in a speaker mode according to some embodiments
  • FIG. 15 shows a schematic diagram of an interface for selecting a target display device by a smart terminal according to some embodiments
  • FIG. 16 shows a flowchart of a dynamic processing method for a shutdown selection interface according to some embodiments
  • FIG. 17 shows a data flow diagram of a dynamic processing method of a shutdown selection interface according to some embodiments
  • FIG. 18 shows a schematic diagram of the effect of a shutdown selection interface according to some embodiments.
  • FIG. 19 shows a schematic diagram of the effect of triggering a screen shutdown option based on a shutdown selection interface according to some embodiments
  • FIG. 20 shows a flowchart of a method for displaying prompt information in speaker mode according to some embodiments
  • 21 shows a data flow diagram of a method for displaying prompt information in speaker mode according to some embodiments
  • Figure 22 shows a flowchart of a method of acquiring a cutscene, according to some embodiments.
  • Figure 23 shows a schematic diagram of the effect of a cutscene according to some embodiments.
  • FIG. 24 shows a flow chart of a method for acquiring a broadcast speech corpus and a countdown to a cutscene, according to some embodiments.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user can operate the display device 200 through the smart device 300 or the control device 100 .
  • the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, and the display device 200 is controlled wirelessly or wiredly.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • a smart device 300 eg, a mobile terminal, a tablet computer, a computer, a notebook computer, etc.
  • the display device 200 is controlled using an application running on the smart device.
  • the display device may not use the above-mentioned smart device or control device to receive instructions, but receive user control through touch or gesture.
  • the display device 200 can also be controlled in a manner other than the control apparatus 100 and the smart device 300.
  • the module for acquiring voice commands configured inside the display device 200 can directly receive the user's voice command for control.
  • the user's voice command control can also be received through a voice control device provided outside the display device 200 device.
  • the display device 200 is also in data communication with the server 400 .
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • FIG. 2 shows a block diagram of a hardware configuration of the control apparatus 100 according to some embodiments.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
  • FIG. 3 shows a block diagram of a hardware configuration of the display device 200 according to some embodiments.
  • the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, at least one of the user interfaces.
  • the display 260 includes a display screen component for presenting pictures, and a driving component for driving image display, for receiving image signals output from the controller, components for displaying video content, image content, and menu manipulation interfaces, and user manipulation UI interfaces Wait.
  • the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
  • the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220 .
  • the detector 230 is used to collect external environment or external interaction signals.
  • the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.
  • the external device interface 240 may include, but is not limited to, the following: any one of high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. or multiple interfaces. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.
  • HDMI high-definition multimedia interface
  • component analog or data high-definition component input interface
  • CVBS composite video input interface
  • USB USB input interface
  • RGB port etc.
  • It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.
  • the controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory.
  • the controller 250 controls the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
  • the object may be any of the selectable objects, such as hyperlinks, icons, or other operable controls.
  • the operations related to the selected object include: displaying operations connected to hyperlinked pages, documents, images, etc., or executing operations of programs corresponding to the icons.
  • the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.
  • CPU Central Processing Unit
  • video processor video processor
  • audio processor audio processor
  • graphics processor Graphics Processing Unit, GPU
  • RAM Random Access Memory
  • ROM Read- Only Memory
  • GUI Graphical User Interface
  • FIG. 4 shows a software configuration diagram in the display device 200 according to some embodiments.
  • the system is divided into four layers, from top to bottom, they are an application layer (referred to as “application layer”), an application framework layer (referred to as “framework layer”) ”), the Android runtime and the system library layer (referred to as the “system runtime layer”), and the kernel layer.
  • application layer an application layer
  • frame layer an application framework layer
  • Android runtime the system library layer
  • kernel layer the kernel layer
  • At least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, or a clock program that comes with the operating system; they may also be developed by third-party developers. s application.
  • the application package in the application layer is not limited to the above examples.
  • the framework layer provides an application programming interface (API) and a programming framework for the application.
  • the application framework layer includes some predefined functions.
  • the application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action.
  • the API interface Through the API interface, the application program can access the resources in the system and obtain the services of the system during execution.
  • the system runtime layer provides support for the upper layer, that is, the framework layer.
  • the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.
  • the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.
  • the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensors, etc.), and power drives, etc.
  • FIG. 5 shows a display diagram of an icon control interface of an application in the display device 200 according to some embodiments.
  • the display device can directly enter a preset VOD program interface after startup.
  • the VOD program interface can be as shown in FIG. 5 , including at least a navigation bar 510 and a content display area located below the navigation bar 510 , the content displayed in the content display area will change with the selected control in the navigation bar.
  • the program in the application layer can be integrated in the video-on-demand program to be displayed through a control in the navigation bar, or it can be further displayed after the application control in the navigation bar is selected.
  • the display device after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources.
  • a speaker mode in order to improve the use function of the display device, can be configured for the display device.
  • the speaker mode is a mode after the screen is turned off. Different from the normal mode, the TV screen is turned off, but the host is still running. In this speaker mode, the screen can be switched on and off quickly to improve the user experience.
  • the screen of the display device is turned off, and only a few communicators such as WiFi modules work, other modules are powered off, the display device cannot receive most of the user's voice commands or can only receive far-field wake-up commands, and Unable to play audio data.
  • the controller of the display device is still in the running state, so that the display device can still respond to the control commands normally, and still has the voice interaction function, and the display device in the speaker mode will be displayed.
  • the device is used as a smart speaker, and users can enjoy most of the business in the ordinary TV mode (except watching videos) in the speaker mode, such as business related to the voice function, just turn off the display screen, such as turning off the backlight. Entering the speaker mode of the display device can save power, prevent children from watching TV for a long time and affect their eyesight, and improve the user experience.
  • the overall process of using the speaker mode is as follows: the user triggers the conditions for entering the speaker mode (screen off); determines whether the current business scenario is a non-interrupting scenario; If the business scenario is a non-interrupted scenario, the music will not be played (currently non-interrupted scenarios include QQ Music, Media Center, Hi Music, and music screencasting applications); if the current business scenario is an interrupted scenario (for example, the current scenario is JUUI) video playback page), you need to send a transition broadcast to mute the system sound.
  • FIG. 6 shows an overall architectural diagram of a speaker mode according to some embodiments.
  • the applications that can trigger the display device to enter the speaker mode include but are not limited to: at least one of media center, Hi music, video call, Power key (power key) and voice .
  • the applications that can trigger the display device to enter the speaker mode include but are not limited to: at least one of media center, Hi music, video call, Power key (power key) and voice .
  • the shutdown selection interface depends on the properties of the whole machine, so as to determine whether the interface needs to be displayed and the options that need to be displayed in the interface.
  • the system driver layer can control the Flow lighting effect/screen-off/screen-on/off-screen interface encapsulation layer.
  • a shutdown selection interface is displayed on the display, options such as screen-off, shutdown, and restart are displayed in the shutdown selection interface, and the user can trigger one of the options through the remote control to make the display device perform the corresponding function.
  • the local display device sends a request for cutscenes and media assets to the cloud server, and the cloud server returns the corresponding data for display on the display.
  • the user When controlling the display device to enter the speaker mode by voice, the user inputs a voice command, such as "enter the speaker mode", and at this time, the display device responds to the voice command and displays a cutscene on the display.
  • the cutscene is a random image displayed, and the image displayed each time is different.
  • the content of the voice broadcast is related to how to use the voice commands in the speaker mode. For example, the content of the voice broadcast is "The screen is about to turn off, you can wake me up as shown in the picture” .
  • the cutscenes have a display time limit. When the cutscenes are displayed, the countdown will be displayed synchronously.
  • the countdown can be set to 5 seconds, which can be determined according to the content of the broadcast. It supports background operations and operates independently for each series of machines to improve user experience.
  • the broadcast sound supports voiceprint. Users can customize the broadcast sound in Settings->AI->Voice broadcast sound.
  • the broadcast sound can be male Mandarin, female Mandarin, female Cantonese, female Sichuan dialect, male Hunan dialect, etc.
  • FIG. 7 illustrates a flow diagram of a display device entering a speaker mode in accordance with some embodiments.
  • the main ways to enter the speaker mode are Power key, voice, speaker screen saver, Hi music, media center, screen off, etc.
  • the shutdown selection interface When the user triggers the Power key, the shutdown selection interface is activated. At this time, the shutdown selection interface displays options such as “shutdown”, “shutdown”, “restart”, and "art gallery”, and the user selects the "shutdown” option through the remote control , you can put the display device into speaker mode.
  • the display device determines whether the current service scenario is a service non-interrupting scenario, and if not, for example, if the current scenario is a homepage or a video is playing on a TV, the current service needs to be interrupted through transition. At the same time, start the cutscene page, the countdown starts, and the voice broadcast is performed. When you need to enter the speaker mode, call the screen-off interface to turn off the screen.
  • the scenarios where services are not interrupted usually refer to scenarios of music playback, and other scenarios can be scenarios where services are interrupted.
  • the user when the user makes the display device enter the speaker mode through the voice/speaker screen saver mode, the user can directly enter the display device into the speaker mode through the voice mode without relying on the aforementioned steps. If the user controls the display device to enter the speaker mode through Hi music or DMP screen off, because the Hi music screen is off to listen to songs, and the media center (DMP) screen is off to listen to songs, the current business is not interrupted. Therefore, you can directly close the Screen.
  • the screen-off property can be set synchronously, that is, setting the system property value to 1 means entering the speaker mode; setting the system property value to 0 means that the speaker mode is not entered and the screen is on.
  • setting the system property value to 1 means entering the speaker mode
  • setting the system property value to 0 means that the speaker mode is not entered and the screen is on.
  • a screen-opening broadcast needs to be sent by an application that triggers the exit of the speaker mode (screen-opening).
  • FIG. 8 illustrates a flow diagram of a display device exiting a speaker mode in accordance with some embodiments.
  • applications that trigger exit from speaker mode include, but are not limited to, key commands based on the return key, home key, and Power key; voice commands; at least one of.
  • the speaker mode application receives the screen-opening broadcast, it determines whether the current scene is a business uninterrupted scene; if it is a business uninterrupted scene, set the current mode to normal TV mode; if it is a business interruption scene, it needs to send a transition broadcast , pull up the IPTV mode to display the IPTV home page. Send a broadcast to notify each application that the speaker mode has been exited, call the screen-opening interface, and control the display to open the screen.
  • the display device when the display device enters the speaker mode, the display is in the off-screen state; and if the normal TV function of the display device is to be used again, the display device needs to exit the speaker mode and control the display to be in the on-screen state. Therefore, it is possible to quickly switch the screen. In order to improve the user experience, it is necessary to quickly switch the screen switch state of the display in the speaker mode.
  • the only difference between the display device entering the speaker mode or exiting the speaker mode is that the switch screen status of the display is different, and the rest of the status is the same. For example, the host has been running and can respond to control commands normally.
  • Fig. 9 shows the first flow chart of the method for automatically switching the screen on and off in the speaker mode according to some embodiments
  • Fig. 10 shows the first data flow diagram of the method for automatically switching the screen on and off in the speaker mode according to some embodiments
  • An embodiment of the present invention provides a display device, including: a display configured to present a user interface; a controller connected to the display, when the method for automatically switching the screen in the speaker mode shown in FIG. 9 and FIG. 10 is executed, the controller is configured to perform the following steps:
  • the designated application refers to the application that needs to present content on the display during operation
  • the speaker mode refers to the controller of the display device is running state, the mode in which the monitor is in the off-screen state.
  • the display needs to be called, that is, the content of the application is displayed on the display. To do this, the display needs to be on when the app is running.
  • the display device enters the speaker mode, the display is in the off-screen state at this time. Therefore, in order to accurately determine whether the content of the application can be displayed on the display in time, it is possible to first determine whether the local end of the display device is in the speaker mode, that is, to determine whether the current use state of the display is the screen-on state or the screen-off state.
  • the specified application that invokes the display is an application that needs to present content on the display at runtime. Therefore, when the specified application is triggered, a display invocation instruction is generated to invoke the display to display the corresponding content.
  • the display call command can be generated by triggering the whole machine application on the local end, for example, DMP, Hi music, video call, etc.
  • the video call application of the local end can generate a display calling instruction.
  • the controller after receiving the display invocation instruction sent by the specified application, the controller is further configured to:
  • Step 111 when the designated application is a video call application, receive a video call request sent by the opposite end device when the opposite end video call application is triggered.
  • Step 112 in response to the video call request, start the video call application on the local end of the display device, and generate a display call instruction.
  • the peer user When the specified application is a video call application, and the peer user wants to make a video call with the local user, the peer user operates the peer device used by him, starts the video call application configured in the peer device, and generates a video call request. And send it to the local display device.
  • the specified application is a video call application
  • the peer user wants to make a video call with the local user
  • the peer user operates the peer device used by him, starts the video call application configured in the peer device, and generates a video call request. And send it to the local display device.
  • the local display device After receiving the video call request, the local display device can start the video call application configured on the local end, and when the local video call application is started, a display calling instruction is generated synchronously.
  • the peer device may be a smart terminal or a display device, and the smart terminal may be a mobile phone, an iPad, or the like.
  • the process of triggering a video call application to generate a video call request by the smart terminal can refer to the implementation process of subsequent steps S31 to S33, and the process of triggering a video call application to generate a video call request by the peer display device can refer to the implementation process of subsequent steps S21 to S23, here I won't go into details.
  • the display calling command can be generated synchronously according to the start command of the specified application on the local end.
  • the controller is further configured to:
  • Step 113 Obtain the system attribute value of the local end of the display device.
  • Step 114 If the system attribute value of the local end of the display device is 1, it is determined that the local end of the display device is in the speaker mode.
  • Step 115 If the system attribute value of the local end of the display device is 0, it is determined that the local end of the display device is not in the speaker mode.
  • the judgment can be made by obtaining the system property value (sys.tvbox.state) of the local end. If the system property value sys.tvbox.state of the local end is 1, then Make sure the local end is in speaker mode. If the local system property value sys.tvbox.state is 0, it is determined that the local end is not in speaker mode.
  • the screen When in the speaker mode, the screen needs to be turned on to start the specified application at this time, for example, the screen needs to be turned on (the screen is turned on) in order to conduct a video call between two users. At this time, the local user can answer the video call when it is convenient, and choose to hang up when it is inconvenient.
  • the display of the local display device When it is not in the speaker mode, it means that the display of the local display device has been turned on, and the content of the specified application can be directly displayed, for example, the video call interface can be displayed directly.
  • the local end of the display device When starting the specified application, if the local end of the display device is in the speaker mode, it means that the display is in the off-screen state. In order to facilitate the timely display of the content of the specified application, it is necessary to first control the display device to exit the speaker mode, and notify the display to switch the use state, that is, to switch the use state of the display from the screen-off state to the screen-on state.
  • the display turns on, and the content of the specified application can be displayed on the screen-on display.
  • the display device after the designated application finishes running, if the display device was originally in the speaker mode, when the designated application is exited, the display device needs to be controlled to enter the speaker mode again.
  • an application exit instruction is generated, and the local end responds to the application exit instruction, and switches the use state of the display from the screen-on state to the screen-off state, so that the local end enters the speaker mode again.
  • the notification speaker mode automatically opens the screen. After the current service is executed, the screen is closed again.
  • the local end of the display device When starting the specified application, if the local end of the display device is not in the speaker mode, it means that the display is in the screen-on state. Therefore, the content of a given application can be displayed directly on the display.
  • the specified application is a video call application, for example, when making a video call with a TV through a mobile phone (TV), the local screen needs to be lit to make a video call, and the video call application notifies the speaker mode at this time.
  • the video call application notifies the speaker mode at this time.
  • the display device When running the video call application, to display the video call interface, the display device needs to be configured with a camera. Therefore, after the local screen is on, the camera needs to be detected so that the content of the video call application can be displayed on the display.
  • the controller is further configured to:
  • the specified application is a video call application
  • the display is in the open-screen state
  • the running state of the camera is detected, and the open-screen state is used to indicate that the local end is not in the speaker mode
  • the video calling interface generated by the video calling application at runtime is displayed on the display;
  • a camera fault prompt is generated, and the camera fault prompt is displayed on the display.
  • the conditions for displaying the content of the video call application are that the display is in the open state, and the display is in the open state, indicating that the display device is not in speaker mode, or, the display device is originally in speaker mode but has been When exiting speaker mode.
  • the local end of the display device detects the running state of the camera to ensure the normal progress of the video call.
  • the running state includes a callable state and a non-callable state.
  • the callable state indicates that the camera is configured on the local end of the display device and the camera is in an idle state; the non-callable state indicates that the local end is not configured with a camera, or the camera configured on the local end is being used by other devices.
  • the application is occupied or faulty, at this time, the video calling application cannot be called.
  • the running state of the camera When it is determined that the running state of the camera is in a callable state, it means that the current display device supports the camera and can make video calls. At this point, the video call application can be started, and the video call interface is generated, and the video call interface is displayed on the display.
  • a camera failure prompt can be generated and displayed on the display to prompt the user to detect the camera, hang up the video call, or display the camera failure prompt through the UI. Switch to voice calls, etc.
  • the display device if the display device is in the speaker mode after the video call ends, after exiting the video call application, the display device needs to be controlled to re-enter the speaker mode, and the video call application notifies the speaker mode to turn off the screen. If the display device is in the open state, the video calling application will exit directly.
  • the display device when starting the specified application, it can first determine whether the local end of the display device is in the speaker mode, if it is in the speaker mode, exit the speaker mode first, and display the specified application on the display; and When the specified application exits, control the display device to enter the speaker mode again. If the local end of the display device is not in the speaker mode, directly display the specified application on the display; and directly exit the specified application when the specified application finishes running. It can be seen that the display device can switch the on/off screen state of the display in time according to the application scenario, and display the application content on the display in time, and the user experience is good.
  • the opposite end device that communicates with the local display device may be an intelligent terminal or a display device.
  • FIG. 11 shows a second flow chart of the method for automatically switching the screen on and off in the speaker mode according to some embodiments
  • Fig. 12 shows the second data flow diagram of the method for automatically switching the screen on and off in the speaker mode according to some embodiments
  • a display device provided by an embodiment of the present invention includes: a display, configured to present a user interface; a controller connected to the display, when executing the method for automatically switching the screen in the speaker mode shown in FIG. 11 and FIG. 12 , controls The device is configured as:
  • the local display device A When the local display device A initiates a video call to the opposite display device B, the local display device A triggers its configured video call application to generate an application startup instruction.
  • the local display device A displays the video call list on the display.
  • the video call list displays the device accounts corresponding to different display devices.
  • the device account can be an account registered with the user's mobile phone number, similar to a WeChat account.
  • user A When user A operates the display device A to start the video call application, it first determines whether the local end is logged into the device account. If not logged in, log in to the device account first, for example, enter the mobile phone number to log in. If you have already logged in with a device account, you can continue to search for the device account that needs to make a video call.
  • User A can search for the device account to be dialed in the video call list displayed on the local display, and after selecting one of the device accounts, the operation of making a video call can be realized, thereby generating a video call request.
  • the local display device A sends the video call request to the peer display device B, and the peer display device B is receiving the video call request; if it is in the speaker mode, first exit the speaker mode to brighten the screen, and then detect the use of the camera state. Display the video call interface on the display when the camera is in a callable state. If it is not in the speaker mode, it directly detects the use state of the camera, and when the camera is in the callable state, the video call interface is displayed on the display.
  • the peer display device B When the peer display device B generates a video call interface in response to the video call request, and sends a connection success notification to the local display device A, the local end also generates a video call interface and displays it on the display. At this point, the local user A can use the local display device A and the opposite display device B to implement a video call with the opposite user B.
  • the camera is turned off, the video call application is exited, and the display screen is turned off again to enter the speaker mode.
  • the steps performed by the smart terminal are different from the steps performed by the peer device for the display device.
  • FIG. 13 shows a third flow chart of the method for automatically switching the screen on and off in the speaker mode according to some embodiments
  • FIG. 14 shows the third data flow diagram of the method for automatically switching the screen on and off in the speaker mode according to some embodiments .
  • An embodiment of the present invention provides an intelligent terminal, including: a display configured to present a user interface; a controller connected to the display, when the method for automatically switching the screen in the speaker mode shown in FIG. 13 and FIG. 14 is executed, the controller is configured as:
  • the smart terminal at the local end When the smart terminal at the local end initiates a video call to the display device on the opposite end, the smart terminal on the local end triggers the video call application configured by the smart terminal to generate an application startup instruction.
  • the local smart terminal displays the video call list on the display.
  • the video call list displayed on the mobile terminal includes at least one bound to the local terminal. a display device.
  • the smart terminal user searches for the bound display device through the login account. If the login account of the local smart terminal is the same as the login account of the display device, it means that the smart terminal has been bound to the display device, and only the bound display device can implement video calls.
  • the controller when checking whether the mobile terminal and the display device are logged into the same account, the controller is further configured to:
  • Step 321 After selecting the target display device based on the video call list, obtain the login account of the local end and the login account of the target display device;
  • Step 322 If the local login account is inconsistent with the login account of the target display device, switch the local login account based on the login account of the target display device, and the switched local account is consistent with the login account of the target display device.
  • FIG. 15 shows a schematic diagram of an interface for selecting a target display device by a smart terminal according to some embodiments.
  • the information of multiple display devices is displayed in the video call list.
  • the local end obtains the local end login account and the login account of the target display device.
  • the login account is a user account, which can be an account registered by email or mobile phone number.
  • the login account of the local end is inconsistent with the login account of the target display device, it means that the display device selected by the user is not bound to the local end. In this case, it is necessary to switch the two to the same account.
  • the log-in account of the target display device can be used as a reference to switch the local-end login account, so that the switched local-end account is consistent with the login account of the target display device.
  • an operation prompt may be displayed on the local display, and the content of the prompt may be "The accounts are inconsistent, please switch. "Wait.
  • the interface on the display is switched from displaying the video call list to the device information interface, as shown in (b) of FIG. 15 .
  • part (2) is the device information selected by the user
  • part (3) is the video call button. After determining the target display device for the video call, the user triggers the video call button to generate a video call request.
  • the speaker mode means that the controller of the display device is in the speaker mode.
  • the mac address of the display device needs to be obtained. Therefore, the local smart terminal generates a video call request according to the mac address in the acquired device information.
  • the local smart terminal sends the video call request to the corresponding display device based on the mac address.
  • the target display device receives the video call request from the smart terminal, it first determines whether it is in speaker mode. If it is in speaker mode, exit the speaker mode first to brighten the screen, and then detect the usage status of the camera. Display the video call interface on the display when the camera is in a callable state. If it is not in the speaker mode, it directly detects the use state of the camera, and when the camera is in the callable state, the video call interface is displayed on the display.
  • steps S11 to S13 For the steps of switching the screen-on state and the screen-off state of the display performed by the target display device in response to the video call request from the smart terminal, reference may be made to steps S11 to S13 and related steps provided in the foregoing embodiments, which will not be repeated here.
  • the target display device When the target display device generates a video call interface in response to the video call request, and sends a connection success notification to the local smart terminal, the local end also generates a video call interface, which is displayed on the display.
  • user A at the local end can use the intelligent terminal at the local end and the target display device to implement a video call with user B at the opposite end.
  • the display device when the local end of the display device needs to display the content of the specified application, it can first determine whether the local end of the display device is in the speaker mode, and if it is in the speaker mode, exit the speaker first. mode, switch the use state of the display to the screen-on state to display the contents of the specified application on the display; and when the specified application exits, switch the use state of the display to the screen-off state to control the display device to enter the speaker mode again. If the local end of the display device is not in the speaker mode, the specified application is directly displayed on the display; and when the specified application finishes running, the specified application is directly exited. It can be seen that the method, the smart terminal, and the display device can quickly switch the on-off state of the display according to the application scenario, and display the application content on the display in a timely manner, and the user experience is good.
  • a shutdown selection interface including shutdown operation options, including but not limited to shutdown options, At least one of screen off option, restart option, speaker mode, etc.
  • the user after triggering the power button of the remote control, the user performs subsequent steps of acquiring data for rendering the shutdown selection interface.
  • controller is further configured as:
  • Step 41 Determine whether the current scene needs to start the shutdown selection interface.
  • Step 42 If the current scene needs to start the shutdown selection interface, start the shutdown selection process to obtain shutdown operation options.
  • Step 43 If the current scene does not need to start the shutdown selection interface, execute the shutdown process.
  • the shutdown operation options can be selected in the system setting interface. If the user selects three shutdown operation options, the system configuration information includes the information of the three shutdown operation options. When the shutdown selection interface is subsequently rendered, shutdown The three shutdown operation options are presented in the selection interface.
  • the shutdown selection interface does not need to pop up on the display. At this time, the display device can be directly shut down, that is, the shutdown process is performed.
  • the shutdown selection interface needs to be activated. At this time, the process of rendering the shutdown selection interface can be executed.
  • a shutdown selection interface needs to be displayed on the display to facilitate the user to select, so that the display device executes the corresponding process.
  • the embodiment of the present invention provides a shutdown selection interface in a fuzzy form, and the fuzzy shutdown selection interface does not The content originally presented in the user interface of the lower layer will be revealed, which is visually convenient for the user to view the various shutdown operation options displayed on the interface, and the user experience is good.
  • the shutdown selection interface in the fuzzy form is more beautiful than the shutdown selection interface in the transparent form, and the UI is easier to view.
  • the display device is equipped with a Gaussian blur processing function, which can provide a shutdown selection interface in a blurred form.
  • the method used in this embodiment is to intercept an image corresponding to the current user interface, perform Gaussian blur processing on the image, and process the The image after that serves as the bottom layer of the shutdown selection interface.
  • FIG. 16 shows a flowchart of a dynamic processing method of a shutdown selection interface according to some embodiments
  • FIG. 17 shows a data flow diagram of a dynamic processing method of a shutdown selection interface according to some embodiments.
  • An embodiment of the present invention provides a display device, including: a display configured to present a user interface; a controller connected to the display, when executing the dynamic processing method for the shutdown selection interface shown in FIG. 16 and FIG. 17 , the controller is Configured to perform the following steps: Specifically, including:
  • the captured image is the last frame of image displayed in the current user interface when the display device responds to an instruction for invoking the shutdown selection interface.
  • a shutdown selection interface in the form of blur can be provided, and Gaussian blur processing can be performed on the captured image.
  • the controller when performing Gaussian blurring on the image, is further configured to:
  • Step 521 Obtain the reduction ratio and blur radius required for Gaussian blurring of the image.
  • Step 522 performing Gaussian blur processing on the image based on the reduction ratio and the blur radius to obtain a processed image.
  • An image refers to a screenshot of the content displayed in the user interface when the power button is triggered.
  • the operation of capturing an image depends on the underlying interface of the system. Select the width and height of the screenshot. After the screenshot is successful, save it as a Bitmap.
  • the reduction ratio refers to the reduction ratio of the resolution. The smaller the reduction ratio, the smaller the image reduction, that is, the greater the reduction degree.
  • the blur radius refers to the radius in Gaussian blur, that is, the value of a certain pixel point expanding outward, which can be understood as the degree of blur. The larger the value of the blur radius, the greater the degree of blurring and the more obvious the blurring effect.
  • the reduction scale (Scale) and the blur radius (Radius) may take dynamic values.
  • the controller is further configured to execute the acquisition of the reduction scale and the blur radius required to perform Gaussian blurring on the image. The following steps:
  • Step 5211 Acquire the resolution of the image and the corresponding target resolution after Gaussian blurring.
  • Step 5212 Calculate the reduction ratio of the image based on the resolution and the target resolution.
  • Step 5213 Calculate the blur radius of the image based on the reduction ratio of the image and the default Gaussian blur radius.
  • the reduction ratio of the image can be determined based on the resolution of the image itself and the target resolution, and the target resolution is the resolution set after Gaussian blurring.
  • the target resolution is set to 1080P. If the resolution of the image itself is higher than 1080P, the resolution of the image needs to be reduced.
  • the reduction ratio is a dynamic value and depends on the resolution of the image. If the resolution of the current screenshot image is 8k, the Scale is 0.125, which is 1/8, to reduce the image to 1080P. If the resolution of the current screenshot image is 4k, the Scale is 0.25, which is 1/4, to reduce the image to 1080P. If the resolution of the current screenshot image is 1080P, the Scale is 1. The maximum value of Scale is 1.
  • the resolution of the current screenshot image is less than 1080P, there is no need to determine the reduction ratio, and the image can be directly used for subsequent processing.
  • the blur radius can be used to adjust. For example, if the image compression is too large, adjust the sharpness by reducing the blur radius; if the image compression is too small, adjust the sharpness by increasing the blur radius.
  • the image can be blurred to obtain a processed image.
  • a shutdown selection interface can be generated to display the shutdown selection interface on the display.
  • the shutdown operation option is presented in the display, the content originally presented in the lower user interface is seen by the user.
  • the underlying interface of the shutdown selection interface is a screenshot of the original content displayed in the display when the power button is triggered and the image after Gaussian blurring, the user can see a blurred background image from the visual effect.
  • FIG. 18 shows a schematic diagram of the effect of a shutdown selection interface according to some embodiments.
  • the shutdown operation options pre-selected by the user are shutdown, restart and AI Cloud
  • the content displayed in the user interface when the user triggers the power button of the remote control is a video image
  • the lower background image of the shutdown selection interface is in a blurred state
  • the controller generates a shutdown selection interface based on the shutdown operation options and the processed image, and is further configured to:
  • Step 5221 When the shutdown operation option is the shutdown option, configure a countdown control for the shutdown option, and the countdown control is used to trigger the shutdown option when the countdown ends.
  • Step 5222 Display the shutdown option configured with the countdown control in the processed image, and generate a shutdown selection interface.
  • the triggering condition for performing the shutdown process on the display device may be the trigger shutdown option.
  • the shutdown option can be triggered actively by the user or automatically by the device.
  • a countdown control can be configured for the shutdown option, and the shutdown option can be automatically triggered when the countdown ends.
  • a shutdown selection interface is rendered.
  • the shutdown selection interface After rendering the shutdown selection interface, the shutdown selection interface can be displayed on the display. In order to block the user interface originally displayed in the display, the shutdown selection interface can be covered on the original user interface in the display, which can avoid the content originally presented in the lower user interface being seen by the user when the shutdown operation option is displayed on the display.
  • the controller when executing the shutdown process, is further configured to: receive an operation on the shutdown option in the shutdown selection interface, or execute the shutdown process when the countdown of the countdown control on the shutdown option ends.
  • the shutdown selection interface When the user activates the shutdown selection interface by triggering the power button of the remote control, the shutdown selection interface is displayed on the display, and the user can trigger the shutdown option in the shutdown selection interface through the remote control direction keys to start the shutdown process; If no shutdown operation option is triggered, while the shutdown selection interface is displayed, the countdown control on the shutdown option starts to count down, and after the countdown ends, the shutdown process is started.
  • the countdown configured on the shutdown option can be set to 20s. After the 20s countdown is over, if the user does not trigger other options, the device automatically triggers the shutdown option to perform the shutdown operation.
  • the user may further control the display device to enter the speaker mode.
  • the controller is further configured to: when the shutdown operation option is the screen shutdown option, Receive the operation of the screen-off option, and switch the use state of the display to the screen-off state, so that the display device enters the speaker mode.
  • the speaker mode refers to the mode in which the controller of the display device is in the running state and the display is in the off-screen state.
  • FIG. 19 is a schematic diagram illustrating the effect of triggering a screen shutdown option based on a shutdown selection interface according to some embodiments.
  • the use state of the display is the open-screen state. If the user triggers the power button of the remote control, a shutdown selection interface is displayed on the display. At this time, the user triggers the screen shutdown option again to control the display device to enter the speaker mode.
  • the screen-off option is used to control the screen-off of the monitor. At this time, the host of the display device runs normally, and only the monitor is turned off.
  • the user performs a trigger operation on the screen-off option to switch the use state of the display from the screen-on state to the screen-off state.
  • the display device enters the speaker mode. If the display device needs to open the screen again and use it normally, it can be achieved by triggering the application to exit the speaker mode (opening the screen).
  • the application that triggers the opening of the screen includes but is not limited to the infrared voice, the return key, the home key, and the Power key; voice; Push to bright screen; one touch to play; video calls and more.
  • the controller is further configured to: the user presses the power button to determine whether the shutdown selection interface needs to be activated, and if so, obtain system configuration information, background Gaussian blurring, If Gaussian processing is required, Gaussian blur is performed on the captured image to generate a blurred shutdown interface and UI display. If Gaussian processing is not required, set the transparency to generate a grayscale shutdown selection interface and UI display.
  • the target transparency can be set for the shutdown selection interface, so that the shutdown selection interface is not completely transparent, but in a grayscale state.
  • the target transparency can be defined according to the actual usage of the user, and there is no specific limitation here.
  • the shutdown selection interface with the target transparency is displayed on the display, where the user interface is originally displayed, and the shutdown selection interface is overlaid on the upper layer of the user interface. Since the shutdown selection interface is not in a transparent state, but in a grayscale state, the content originally presented in the user interface can be blocked, so that the user can clearly view the various shutdown operation options displayed on the shutdown selection interface, and the user experience is good.
  • the display device when the display device enters the speaker mode, the display is in the off-screen state; and to use the normal TV function of the display device again, the display device needs to exit the speaker mode and control the display to be in the on-screen state.
  • the only difference between the display device entering the speaker mode or exiting the speaker mode is that the switch screen status of the display is different, and the rest of the status is the same. For example, the host has been running and can respond to control commands normally.
  • the display device when the display device is transitioning, the display is directly turned off, and the signal source switching is performed in the background.
  • the state of the display device entering the speaker mode is similar to the state of the display device being turned off, the display is in a closed state in terms of visual effects.
  • the power-on operation of the display device may cause the display device to fail to respond, or to respond, but because the speaker mode cannot be exited, the display does not turn on, causing users to mistakenly believe that the display device is abnormal.
  • an embodiment of the present invention provides a display device configured to perform prompting in the speaker mode
  • the display method of information enables the display device to prompt the user in time when it enters the speaker mode, so as to inform the user that the current state of the display device is to enter the speaker mode instead of shutting down, and prompt the user to turn on the screen in real time to exit the speaker mode to prevent the display device. Do not respond to user's misoperation, affecting user experience.
  • prompt information is displayed on the display, and the prompt information includes cutscenes and broadcast voice material.
  • the prompt information can inform the user of the current state of the display device, and can also prompt the user of the current operation process of using the display device as a smart speaker, so that the user can accurately operate the display device and improve user experience.
  • FIG. 20 shows a flowchart of a method for displaying prompt information in speaker mode according to some embodiments
  • FIG. 21 shows a data flow diagram of a method for displaying prompt information in speaker mode according to some embodiments.
  • An embodiment of the present invention provides a display device, including: a display configured to present a user interface; a controller connected to the display, when the method for displaying prompt information in the speaker mode shown in FIG. 20 and FIG. 21 is executed, the controller is configured to perform the following steps:
  • the speaker mode refers to the mode in which the controller of the display device is in the running state and the display is in the off-screen state.
  • the off-screen condition can be triggered by triggering the off-screen condition, including the Power key, voice, speaker screen saver, Hi music/DMP screen off, etc. as shown in Figure 7.
  • the user performs an operation that triggers the screen-off condition in any manner, and generates a corresponding instruction.
  • a prompt message may be displayed on the display when the display device enters the speaker mode.
  • the background of the display device needs to switch the signal source, and at the same time, obtain the cutscenes and broadcasts used to prompt the user that the display device is in the speaker mode.
  • voice material The cutscene is a randomly displayed background image, which is used to introduce the steps of how to use voice commands to operate the display device in speaker mode.
  • the broadcast voice corpus is used to inform the user of the current state of the display device from an auditory perspective and to prompt the user to operate the display device by voice.
  • the presentation of the cutscenes is time-sensitive, and the broadcast of the broadcast audio material is also time-sensitive. Therefore, it is necessary to display and broadcast in the form of a countdown when the display device displays the cutscenes and plays the broadcast audio material.
  • a cutscene countdown is started based on the cutscenes and the broadcast audio corpus.
  • the cutscene countdown refers to the length of time during which the prompt information is displayed to the user, which is displayed in the form of a countdown.
  • Figure 22 shows a flowchart of a method of acquiring a cutscene in accordance with some embodiments.
  • the display device when obtaining a cutscene, the display device needs to obtain a background image at random to generate a cutscene.
  • the controller is further configured to perform the following steps when performing the acquisition of the cutscene:
  • Step 711 Acquire a background image path for implementing a cutscene.
  • Step 712 If the background image path is not empty, load the background image based on the background image path.
  • Step 713 Generate a cutscene based on the background image.
  • the cutscenes When acquiring the cutscenes, the cutscenes randomly display a background image, and the background images displayed two consecutive times are different. In order to avoid network abnormalities and other reasons, the local end cannot obtain the background image in time, which affects the timely display of cutscenes, and the background image can be stored in the background image path in advance.
  • the display device may use the background image read during the previous execution of the cutscene process when acquiring the cutscene this time, and the background image read this time can be used in the next execution of the cutscene process.
  • the background image path that stores the previously acquired background image can be stored locally. If there is a background image stored in the background image path, it means that the background image was read during the previous execution of the process of acquiring cutscenes, and the background image path is not null. At this point, the background image can be loaded directly based on the background image path, and finally, a cutscene is generated based on the background image.
  • the controller when the background image path is empty, the controller is further configured to:
  • Step 714 If the background image path is empty, obtain the advertisement path for realizing the cutscene.
  • Step 715 If the advertisement path is not empty, load the advertisement, and generate a cutscene based on the advertisement.
  • Step 716 If the advertisement path is empty, load a local default image, and generate a cutscene based on the local default image.
  • the background image path When the background image path is empty, it means that the background image was not read during the previous execution of the process of obtaining the cutscene. At this time, in order to ensure the normal display of the cutscenes, the interface for displaying the advertising service can be replaced. Therefore, the ad path for implementing the cutscene can be obtained.
  • the advertisement path is stored locally, and the advertisement path is not empty.
  • the advertisement can be loaded directly based on the advertisement path, so as to generate a cutscene based on the advertisement.
  • the locally stored advertisement path is empty.
  • a local default image can be loaded.
  • Local default images can be stored in the local cache path to generate cutscenes based on the local default images.
  • some social applications that are popular in the current period such as AI fitness, heart rate health research, etc.
  • some social applications that are popular in the current period such as AI fitness, heart rate health research, etc.
  • the cutscenes displayed by the display device when it enters the speaker mode can not only improve the user experience (remind the user of the operation process of various display devices in the speaker mode), but also display richer content and recommend more to the user. interesting content, better user experience.
  • the cloud animation data is acquired from the server in real time during the current process of acquiring the cutscenes, the data acquisition speed is slow, and if there is a network abnormality, the cutscenes cannot be generated, causing the display device to enter the speaker In the mode, the prompt information cannot be displayed in time on the display, which affects the user experience.
  • the display device can store the required background pictures locally in advance, that is, the display device obtains the background pictures from the local (execute the current acquisition of the cutscenes).
  • another process can also be executed, that is, to obtain cloud animation data from the server cloud, and the cloud animation data obtained in real time is the background image required for the next execution of the process of obtaining cutscenes.
  • the two processes run synchronously and do not interfere with each other.
  • the cloud animation data requested by the display device from the server in real time includes a background image
  • the background image is stored in a local background image path, so that the background image under the path can be directly read next time the process of obtaining a cutscene is executed.
  • Pictures, and cutscenes are generated in time. Therefore, the execution process of the display device acquiring the background image path this time is equivalent to the process of requesting the cloud animation data from the server in real time to store it in the background image path.
  • controller is further configured to perform the following steps when performing step 711, that is, acquiring the background image path for implementing the cutscenes:
  • Step 7111 Detect whether the local system network is in a connected state.
  • Step 7112 When the local system network is in a connected state, obtain the current timestamp of the current request for the cloud animation data and the historical timestamp of the last request for the cloud animation data.
  • Step 7113 If the current time stamp is inconsistent with the historical time stamp, delete the background image in the local cache path, and store the background image in the cloud animation data requested this time in the local cache path, and the local cache path is the following: Get the background image path required for cutscenes at a time.
  • Step 7114 If the current time stamp is consistent with the historical time stamp, store the background image in the cloud animation data requested this time in the local cache path.
  • the display device While executing the process (1) in FIG. 22, the display device synchronously executes the process (2) in FIG. 22, that is, starts the service process (service) that requests data from the server, so as to randomly store the data required by the process (1) in FIG. 22. Background image path.
  • the display device When the display device requests data from the server, it needs to ensure that the local end maintains the network connection state, and different connection states perform different processes of saving the background image path. Therefore, after starting the service, first determine whether the local system network is connected.
  • the display device can send a data request to the server in real time to obtain cloud animation data. Therefore, when the local system network is connected, the local end of the display device requests the cloud interface in real time, and sends a data request to the cloud interface of the server. After the server receives the data request, it sends the cloud animation data to the display device.
  • the display device After receiving the cloud animation data, the display device parses the cloud animation data to obtain the current time stamp and background image.
  • the display device obtains the historical timestamp corresponding to the last request for the cloud animation data, and compares the historical timestamp with the current timestamp.
  • the local folder for storing background images is the local cache path (les/tvbox).
  • the current time stamp is inconsistent with the historical time stamp, it means that the background image stored in the cloud has been updated in the background of the system. At this time, the background image in the local cache path (les/tvbox) needs to be deleted. Delete all background images in the local cache path (les/tvbox).
  • the local cache path is empty, and then the background image in the cloud animation data requested this time is stored in the local cache path to update the background image in the local cache path, so as to use the local cache path as the next time Gets the background image path required for cutscenes.
  • the current time stamp is consistent with the historical time stamp, it means that the background image stored in the cloud has not been updated in the background of the system, and the background image in the cloud animation data requested this time can be directly stored in the local cache path .
  • the local cache path when the local cache path stores the background image, if the local cache path does not perform the delete operation, the local cache path has stored the historical background image before storing the new background image. In order to avoid repeated storage of the same background image, it is necessary to detect whether the new background image has been stored.
  • controller is further configured to perform the following steps when executing the process of storing the background image in the cloud animation data requested this time to the local cache path:
  • Step 717 Detect whether the background image in the cloud animation data requested this time has been stored in the local cache path.
  • Step 718 if it has been stored, do not store the background image in the cloud animation data requested this time in the local cache path;
  • Step 719 If it has not been stored, store the background image in the cloud data requested this time into the local cache path.
  • the display device may store the new background image in the cloud animation data requested from the server in real time to the local cache path (les/tvbox). Since historical background pictures may be stored in the local cache path at this time, before storing a new background picture, it is first determined whether the newly acquired background picture has been stored in the local cache path.
  • the new background image requested this time will not be saved to the local cache path. If the new background image has not been stored, that is, the background image does not exist in the local cache path, the new background image requested this time needs to be saved in the local cache path.
  • the display device can request the cloud animation data from the server in real time.
  • the current timestamp is compared with the historical timestamp to determine whether the background image is updated in the background of the system.
  • the comparison is inconsistent (there is an update)
  • delete the locally cached background image first and download it again, that is, store the new background image in the newly acquired cloud animation data to the local cache path; if the comparison is consistent (not updated), then Store the new background image directly in the local cache path.
  • This solution can ensure that the display device can obtain the background picture in real time, and store the background picture path required by the process (1) in FIG. 22, which is convenient for the next execution of the process of obtaining the cutscenes.
  • the display device if the local system network is not connected, the display device cannot request data from the server in real time. At this time, any background image in the local cache path can be randomly selected as the new background image, and the access path of the new background image can be used as the background image path used in the next execution of the process of obtaining the cutscene.
  • the controller when the local system network is not in a connected state, the controller is further configured to:
  • Step 71115 When the local system network is not in a connected state, randomly acquire the background image in the local cache path.
  • Step 71116 If the background image has already been displayed, randomly acquire the background image in the local cache path again.
  • Step 71117 If the background image has not been shown before, determine the local cache path where the background image is located as the background image path required for the next time the cutscene is acquired.
  • a background image can be randomly selected from the local cache path.
  • the randomly selected background image must be inconsistent with the background image displayed last time. Therefore, after randomly acquiring a background image, it is necessary to determine whether the background image has been displayed last time.
  • the local cache path where the background image is located can be determined as the background image path required for the next cutscenes, so as to update the background image path and ensure that the next time Ability to display a different background image when performing the fetch cutscene process.
  • Figure 23 shows a schematic diagram of the effect of a cutscene according to some embodiments. See the four cutscenes shown in Figure 23, each generated with a different background image.
  • the display device enters the speaker mode, the display can display any one of the cutscenes randomly, and the cutscenes displayed two consecutive times are different.
  • the device can randomly obtain it from the local cache path.
  • a background image if the background image has been displayed last time, it will be randomly selected again; if the background image has not been displayed last time, the path of the background image will be used as the background image path to update the next execution of the acquisition
  • the display device after the display device receives an instruction to control the local end of the display device to enter the speaker mode, it can synchronously acquire the cutscenes and broadcast voice corpus for prompting the user that the display device operated by the display device is in the speaker mode, When the cutscenes are displayed on the display based on the countdown to the cutscenes, the device can broadcast simultaneously in the form of voice, realizing the process of prompting the user how to operate the display device entering the speaker mode from the visual and auditory perspectives, and improving the user experience. Therefore, when the display device performs the process of acquiring the cutscenes provided by the foregoing embodiments, the process of acquiring the broadcast voice corpus can also be simultaneously performed.
  • FIG. 24 shows a flow chart of a method for acquiring a broadcast speech corpus and a countdown to a cutscene, according to some embodiments.
  • the controller is further configured to perform the following steps when performing step S1, that is, acquiring the broadcast voice corpus:
  • Step 7121 Acquire a broadcast buffer for storing the broadcast speech material.
  • Step 7122 If the broadcast buffer is not empty, acquire the broadcast voice corpus stored in the broadcast buffer.
  • Step 7123 If the broadcast buffer is empty, acquire the broadcast voice corpus stored in the local default buffer.
  • the broadcast voice materials required in the speaker mode can be configured by the system background, and different broadcast voices can be configured in different models of display devices.
  • the broadcast audio corpus is strongly correlated with the countdown of the cutscenes, that is, the length of the countdown of the cutscenes is positively correlated with the text length of the broadcast audio corpus.
  • the local end cannot obtain the broadcast audio material in time, which affects the timely display of the broadcast audio material.
  • the local location of the display device for storing the broadcast speech material is the local broadcast cache.
  • the local broadcast buffer can be read. If there are broadcast audio corpus stored in the broadcast buffer, it means that the relevant data was read during the previous execution of the process of obtaining the broadcast audio corpus, and the broadcast buffer is not empty. At this time, the broadcast voice corpus stored in the broadcast buffer can be directly read.
  • the broadcast speech material stored in the local default cache may be obtained.
  • the cloud broadcast data is acquired from the server in real time during the current process of obtaining the broadcast audio corpus, the data acquisition speed is slow, and if there is a network abnormality, the broadcast audio corpus cannot be displayed in time, resulting in the display device When entering the speaker mode, the prompt information cannot be displayed on the display in time, which affects the user experience.
  • the display device can store the required broadcast speech material locally in advance, that is, the display device obtains the broadcast speech material from the local (execute the current speech material).
  • another process can be executed, that is, to obtain the cloud broadcast data from the server cloud, and the cloud broadcast data obtained in real time is the data required for the next execution of the process of obtaining the broadcast voice corpus.
  • the two processes run synchronously and do not interfere with each other.
  • the cloud broadcast data requested by the display device from the server in real time includes the broadcast speech material, and the broadcast speech material is stored in the local broadcast buffer, so that the broadcast speech material can be directly read the next time the process of obtaining the broadcast speech material is executed.
  • the broadcast voice corpus under the cache is played in time. Therefore, the execution process of the display device acquiring the broadcast cache this time is equivalent to the process of requesting the cloud broadcast data from the server in real time to store in the broadcast cache.
  • the controller is further configured to perform the following steps when performing step 121, namely acquiring the broadcast buffer for storing the broadcast voice corpus:
  • Step 71211 When the local system network is in a connected state, obtain cloud broadcast data from the server.
  • Step 71212 Parse the cloud broadcast data, obtain the broadcast voice corpus, and store the broadcast voice corpus in the broadcast cache.
  • the display device While executing the process (1) in FIG. 24, the display device synchronously executes the process (2) in FIG. 24, that is, starts the cloud interface that requests data from the server, so as to store the broadcast buffer required by the process (1) in FIG. 24.
  • the display device When the display device requests data from the server, it needs to ensure that the local end maintains the network connection state. If the local system network is not connected, it does not request the cloud to broadcast data.
  • the local system network If the local system network is connected, get the cloud broadcast data to the server. After the server receives the data request, it sends the cloud broadcast data to the display device. After the display device receives the cloud broadcast data, it parses the cloud broadcast data to obtain the broadcast voice corpus, and finally stores the broadcast voice corpus obtained in real time in the local broadcast cache, so as to control the display device to enter the speaker mode next time. When executing the process of acquiring the broadcast voice corpus, it is directly read, which improves the processing efficiency and provides a good user experience.
  • the countdown of the cutscenes may be based on the broadcast audio. corpus to determine.
  • the controller is further configured to perform the following steps when executing a countdown to initiating a cutscene corresponding to the cutscenes and the announced speech corpus:
  • Step 71213 Obtain the transition consumption time required by the display device when transitioning and the number of text words corresponding to the broadcast voice corpus. Transition refers to the process of switching the signal source when the display device enters the speaker mode.
  • Step 71214 Calculate the broadcast consumption time required for playing the broadcast voice corpus based on the number of text words and the average word consumption time of the broadcast voice corpus.
  • Step 71215 Calculate the total duration of the transition consumption duration and the broadcast consumption duration, and determine the transition countdown.
  • the display device needs to transition when entering the speaker mode, that is, to switch the signal source to turn off the display.
  • the sound of the system will be muted during the transition. If the broadcast voice material is played at this time, there will be no sound, resulting in failure to broadcast successfully. Therefore, in order to ensure the normal playback of the broadcast voice material, the voice broadcast needs to be performed after the display device transitions successfully.
  • the transition countdown starts when the display device starts to perform the transition, the transition countdown is the sum of the transition time and the broadcast time.
  • the broadcast consumption time is related to the number of text words corresponding to the broadcast voice corpus, and the broadcast voice corpus with different text lengths corresponds to different broadcast consumption times.
  • the duration of the countdown to the cutscene is the duration of the presentation of the cutscene.
  • the countdown to the cutscene is based on rounding up.
  • the duration timeCountDown Math.Ceil(totalTime/1000) of the countdown of the cutscene, and the unit is s.
  • the duration of the current transition is 2s
  • the number of text characters in the broadcast voice corpus is 8 characters
  • the display device After receiving the control instruction for controlling the display device to enter the speaker mode, the display device acquires information such as the cutscenes, the broadcast voice material, and the cutscenes countdown required for displaying the prompt information. The display device responds to the control command, starts to count down the cutscene, and at the same time, displays the cutscenes on the display.
  • the cutscenes include the operation schematic scene diagram, operation copy and other information for operating the display device in the speaker mode.
  • the broadcast audio material can be played synchronously after the transition is successful, so that the broadcast audio material can be played completely, and the user can know the complete prompt information to improve the operation experience.
  • the controller displays a cutscene on the display after the cut-scene countdown starts, and calls the audio output interface to play the broadcast audio corpus, which is further configured as:
  • the cutscene countdown control refers to a control generated based on the cutscene countdown.
  • the display device transitions when entering the speaker mode, in order to display prompt information to the user, it can also display the countdown synchronously.
  • the cutscenes countdown control is generated synchronously according to the cutscenes countdown, and then the cutscenes prompt interface is generated according to the cutscenes animation and the cutscenes countdown controls, so as to display the cutscenes prompt interface on the display.
  • the cutscenes prompt interface can be shown in any of the renderings in Figure 23.
  • the cutscenes countdown controls are displayed on the upper layer of the cutscenes and on one side of the cutscenes to avoid obscuring the information in the cutscenes.
  • the duration corresponding to the cutscene countdown control decreases sequentially according to the elapse of system time, and in terms of visual effect, the time displayed in the cutscene prompt interface gradually decreases in the form of countdown.
  • the display device transitions in the background.
  • the display device can send a successful broadcast after the transition is successful.
  • the audio output interface is called to start playing the broadcast audio material.
  • the time when the broadcast is received is the initial playback time of the broadcast audio material.
  • the audio output interface includes: a local default broadcast interface and a TTS broadcast interface.
  • the display device has a built-in TTS broadcast interface to realize the automatic broadcast of the broadcast voice material.
  • TTS Text To Speech, from text to speech
  • the TTS voice broadcast device can receive all kinds of text information sent by the controller and read it in automatic voice mode.
  • the TTS function needs to rely on the network. Therefore, when playing the broadcast speech material, it is necessary to detect whether the local system network is connected, so as to accurately call the target broadcast interface to realize the broadcast speech material playback.
  • different interfaces can be invoked according to the network state of the local system to implement the playback.
  • the TTS broadcast interface can be directly called to play the broadcast voice material to realize automatic playback. If the local system network is not connected, the TTS broadcast interface cannot be called. In order to realize the timely playback of the broadcast audio material, the local default broadcast interface can be called instead to play the broadcast audio material.
  • the default broadcast interface is the audio preset broadcast interface.
  • the broadcast audio material played by the audio preset broadcast interface is a fixed audio file, not the broadcast audio material obtained from the broadcast buffer.
  • the fixed audio file may also be the broadcast speech material obtained from the local default cache.
  • prompt information can be displayed on the display.
  • the cutscenes and the countdown will be displayed at the initial moment; after the transition of the display device is successful, the broadcast audio corpus will be played, so that the broadcast audio corpus can be played completely.
  • the user can know that the current display device is about to enter the speaker mode synchronously with the visual angle and the hearing angle, and obtain the process of operating the display device in the speaker mode, and the user experience is good.
  • the display device can be controlled to enter the speaker mode. At this point, that is, after the countdown of the cutscene is over, the display of the cutscenes is canceled in the display, the display device cancels the call of the audio output interface to stop playing the broadcast audio corpus, and switches the use state of the display to the off-screen state, the display is black, and the host continues run.
  • the duration of the countdown to the cutscene is greater than or equal to the total duration of the transition consumption time and the broadcast consumption time, it can be ensured that the broadcast audio corpus can be fully played before the display is turned off, and the user experience is good.
  • the display device provided by the embodiment of the present invention can display prompt information on the display synchronously when the display device is about to enter the speaker mode, so as to inform the user that the current state of the display device is to enter the speaker mode instead of shutting down, and prompt the user to Open the screen in real time and exit the speaker mode to prevent the display device from not responding to the user's misoperation and affecting the user experience.
  • the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include parts of the various embodiments of the method for automatically switching the screen on and off in the speaker mode provided by the present invention or all steps.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.
  • the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform.
  • the technical solutions in the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products may be stored in a storage medium, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.
  • a computer device which may be a personal computer, a server, or a network device, etc.

Abstract

本申请公开了显示设备及设备控制方法,在显示设备本端需要展示指定应用的内容时,可先判断显示设备本端是否处于音箱模式,若正处于音箱模式,则先退出音箱模式,切换显示器的使用状态为开屏状态,以将指定应用的内容展示在显示器中;并在指定应用退出时,切换显示器的使用状态为关屏状态,以再次控制显示设备进入音箱模式。如果显示设备本端未处于音箱模式,则直接将指定应用展示在显示器中;并在指定应用完成运行时,直接退出指定应用。可见,该方法及智能终端、显示设备,可根据应用场景快速切换显示器的开关屏状态,以及时将应用内容展示在显示器中,用户体验好。

Description

显示设备及设备控制方法
本申请要求在2021年3月30日提交的、申请号为202110340150.7、发明名称为“一种设备控制方法及智能终端、显示设备”的中国专利申请的优先权,在2021年4月16日提交的、申请号为202110413878.8、发明名称为“一种关机选择界面的动态处理方法及显示设备”的中国专利申请的优先权,以及在2021年4月16日提交的、申请号为202110412706.9、发明名称为“一种音箱模式下提示信息的展示方法及显示设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及智能电视技术领域,尤其涉及显示设备及设备控制方法。
背景技术
随着显示设备的快速发展,显示设备的功能将越来越丰富,性能也越来越强大,目前,显示设备可以是智能电视,也可以是其他带有智能显示屏幕的产品等。
出于节能目的以及提高显示设备的功能需求,在用户暂时不需要使用显示设备也不想关机的情况下,可为显示设备配置一种区别于显示模式和关机的状态,例如音箱模式。在音箱模式下,显示设备的显示器被关闭,而主机正常运行,此时,显示设备仍可响应语音指令,将显示设备作为智能音箱来使用。
发明内容
第一方面,本申请提供的显示设备,包括:
显示器,被配置为呈现用户界面;
与所述显示器连接的控制器,所述控制器被配置为:
响应于指定应用发送的显示器调用指令,判断所述显示设备本端是否处于音箱模式,所述指定应用是指在运行时需要将内容呈现在显示器中的应用,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式;
在所述显示设备本端处于音箱模式时,切换所述显示器的使用状态为开屏状态,以使显示设备本端退出音箱模式,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,切换所述显示器的使用状态为关屏状态,以使显示设备本端进入音箱模式;
在所述显示设备本端未处于音箱模式时,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,取消所述显示器中所述指定应用的内容的显示。
第二方面,本申请还提供了一种显示设备,包括:
显示器,被配置为呈现用户界面;
与所述显示器连接的控制器,所述控制器被配置为:
响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有不同显示设备对应的设备账号;
接收对所述视频通话列表中的一个设备账号的操作,生成视频通话请求;
将所述视频通话请求发送至设备账号对应的对端显示设备,所述对端显示设备用于响应视频通话请求确定对端是否处于音箱模式,以切换对端显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
第三方面,本申请还提供了一种智能终端,包括:
显示器,被配置为呈现用户界面;
与所述显示器连接的控制器,所述控制器被配置为:
响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有与所述智能终端本端进行绑定的不同显示设备;
在基于所述视频通话列表选择目标显示设备后,触发视频通话按钮,生成视频通话请求;
将所述视频通话请求发送至目标显示设备,所述目标显示设备用于响应视频通话请求确定是否处于音箱模式,以切换目标显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
第四方面,本申请还提供了一种设备控制方法,应用于显示设备,所述方法包括:
响应于指定应用发送的显示器调用指令,判断所述显示设备本端是否处于音箱模式,所述指定应用是指在运行时需要将内容呈现在显示器中的应用,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式;
在所述显示设备本端处于音箱模式时,切换所述显示器的使用状态为开屏状态,以使显示设备本端退出音箱模式,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,切换所述显示器的使用状态为关屏状态,以使显示设备本端进入音箱模式;
在所述显示设备本端未处于音箱模式时,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,取消所述显示器中所述指定应用的内容的显示。
第五方面,本申请还提供了一种设备控制方法,应用于显示设备,所述方法包括:
响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有不同显示设备对应的设备账号;
接收对所述视频通话列表中的一个设备账号的操作,生成视频通话请求;
将所述视频通话请求发送至设备账号对应的对端显示设备,所述对端显示设备用于响应视频通话请求确定对端是否处于音箱模式,以切换对端显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
第六方面,本申请还提供了一种设备控制方法,应用于智能终端,所述方法包括:
响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有与所述智能终端本端进行绑定的不同显示设备;
在基于所述视频通话列表选择目标显示设备后,触发视频通话按钮,生成视频通话请求;
将所述视频通话请求发送至目标显示设备,所述目标显示设备用于响应视频通话请求确定是否处于音箱模式,以切换目标显示器的开屏状态和关屏状态,所述音箱模 式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
第七方面,本申请还提供了一种存储介质,该计算机存储介质可存储有程序,该程序执行时可实现包括本申请提供的音箱模式下自动开关屏的方法各实施例中的部分或全部步骤。
附图说明
为了更清楚地说明本申请的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1中示例性示出了根据一些实施例的显示设备与控制装置之间操作场景的示意图;
图2中示例性示出了根据一些实施例的显示设备200的硬件配置框图;
图3中示例性示出了根据一些实施例的控制设备100的硬件配置框图;
图4中示例性示出了根据一些实施例的显示设备200中软件配置示意图;
图5中示例性示出了根据一些实施例的显示设备200中应用程序的图标控件界面显示示意图;
图6示出了根据一些实施例的音箱模式的整体架构图;
图7示出了根据一些实施例的显示设备进入音箱模式的流程图;
图8示出了根据一些实施例的显示设备退出音箱模式的流程图;
图9示出了根据一些实施例的音箱模式下自动开关屏的方法的第一种流程图;
图10示出了根据一些实施例的音箱模式下自动开关屏的方法的第一种数据流图;
图11示出了根据一些实施例的音箱模式下自动开关屏的方法的第二种流程图;
图12示出了根据一些实施例的音箱模式下自动开关屏的方法的第二种数据流图;
图13示出了根据一些实施例的音箱模式下自动开关屏的方法的第三种流程图;
图14示出了根据一些实施例的音箱模式下自动开关屏的方法的第三种数据流图;
图15示出了根据一些实施例的智能终端选择目标显示设备的界面示意图;
图16示出了根据一些实施例的关机选择界面的动态处理方法的流程图;
图17示出了根据一些实施例的关机选择界面的动态处理方法的数据流图;
图18示出了根据一些实施例的关机选择界面的效果示意图;
图19示出了根据一些实施例的基于关机选择界面触发关屏选项的效果示意图;
图20示出了根据一些实施例的音箱模式下提示信息的展示方法的流程图;
图21示出了根据一些实施例的音箱模式下提示信息的展示方法的数据流图;
图22示出了根据一些实施例的获取过场动画的方法流程图;
图23示出了根据一些实施例的过场动画的效果示意图;
图24示出了根据一些实施例的获取播报音语料和过场倒计时的方法流程图。
具体实施方式
为使本申请的目的和实施方式更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
需要说明的是,本申请中对于术语的简要说明,仅是为了方便理解接下来描述的实施方式,而不是意图限定本申请的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明。应该理解这样使用的用语在适当情况下可以互换。
术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的所有组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。
术语“模块”是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。
图1为根据实施例中显示设备与控制装置之间操作场景的示意图。如图1所示,用户可通过智能设备300或控制装置100操作显示设备200。
控制装置100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式,通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。
在一些实施例中,也可以使用智能设备300(如移动终端、平板电脑、计算机、笔记本电脑等)以控制显示设备200。例如,使用在智能设备上运行的应用程序控制显示设备200。
在一些实施例中,显示设备可以不使用上述的智能设备或控制设备接收指令,而是通过触摸或者手势等接收用户的控制。
在一些实施例中,显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制,例如,可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制,也可以通过显示设备200设备外部设置的语音控制设备来接收用户的语音指令控制。
在一些实施例中,显示设备200还与服务器400进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。
图2示出了根据一些实施例的控制装置100的硬件配置框图。如图2所示,控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起用用户与显示设备200之间交互中介作用。
图3示出了根据一些实施例的显示设备200的硬件配置框图。参见图3,在一些实施例中,显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。
显示器260包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件,用于接收源自控制器输出的图像信号,进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种,还可以为一种投影装置和投影屏幕。
通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如:通信器可以包括Wifi模块,蓝牙模块,有线以太网模块等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。
检测器230用于采集外部环境或与外部交互的信号。例如,检测器230包括光接收器,用于采集环境光线强度的传感器;或者,检测器230包括图像采集器,如摄像头,可以用于采集外部环境场景、用户的属性或用户交互手势,再或者,检测器230包括声音采集器,如麦克风等,用于接收外部声音。
外部装置接口240可以包括但不限于如下:高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。
控制器250,通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器260上显示UI对象的用户命令,控制器250便可以执行与由用户命令选择的对象有关的操作。
在一些实施例中,所述对象可以是可选对象中的任何一个,例如超链接、图标或其他可操作的控件。与所选择的对象有关操作有:显示连接到超链接页面、文档、图像等操作,或者执行与所述图标相对应程序的操作。
在一些实施例中控制器包括中央处理器(Central Processing Unit,CPU),视频处理器,音频处理器,图形处理器(Graphics Processing Unit,GPU),RAM Random Access Memory,RAM),ROM(Read-Only Memory,ROM),用于输入/输出的第一接口至第n接口,通信总线(Bus)等中的至少一种。
“用户界面”,是应用程序或操作系统与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素,其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。
图4示出了根据一些实施例的显示设备200中软件配置图。参见图4,在一些实施例中,将系统分为四层,从上至下分别为应用程序(Applications)层(简称“应用层”),应用程序框架(Application Framework)层(简称“框架层”),安卓运行时(Android runtime)和系统库层(简称“系统运行库层”),以及内核层。
在一些实施例中,应用程序层中运行有至少一个应用程序,这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等;也可以是第三方开发者所开发的应用程序。在具体实施时,应用程序层中的应用程序包不限于以上举例。
框架层为应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心,这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口,可 在执行中访问系统中的资源和取得系统的服务。
在一些实施例中,系统运行库层为上层即框架层提供支撑,当框架层被使用时,安卓操作系统会运行系统运行库层中包含的C/C++库以实现框架层要实现的功能。
在一些实施例中,内核层是硬件和软件之间的层。如图4所示,内核层至少包含以下驱动中的至少一种:音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器,温度传感器,压力传感器等)、以及电源驱动等。
图5示出了根据一些实施例的显示设备200中应用程序的图标控件界面显示图。在一些实施例中,显示设备启动后可以直接进入预置的视频点播程序的界面,视频点播程序的界面可以如图5中所示,至少包括导航栏510和位于导航栏510下方的内容显示区,内容显示区中显示的内容会随导航栏中被选中控件的变化而变化。应用程序层中的程序可以被集成在视频点播程序中通过导航栏的一个控件进行展示,也可以在导航栏中的应用控件被选中后进行进一步显示。
在一些实施例中,显示设备启动后可以直接进入上次选择的信号源的显示界面,或者信号源选择界面,其中信号源可以是预置的视频点播程序,还可以是HDMI接口,直播电视接口等中的至少一种,用户选择不同的信号源后,显示器可以显示从不同信号源获得的内容。
在一些实施例中,为提高显示设备的使用功能,可为显示设备配置音箱模式。音箱模式属于关屏后的一种模式,与普通模式不同,电视屏幕是关闭的,但主机仍在运行。在该音箱模式下可以实现快速开关屏,提升用户体验。
传统待机状态中,显示设备屏幕被关闭,而且仅仅只有少数通信器如WiFi模块工作,其他模块均已掉电,显示设备无法接收用户的大多数语音指令或者仅能接收远场唤醒的指令,而且无法播放音频数据。
而不同于待机状态的是,当显示设备出于音箱模式时,显示设备的控制器仍处于运行状态,使得显示设备仍可正常响应控制指令,并仍具有语音交互功能,将处于音箱模式的显示设备作为智能音箱来使用,用户可以在音箱模式下享受普通电视模式下的大部分业务(除观看视频),例如与语音功能相关的业务,仅仅是关闭显示器屏幕,如关闭背光。显示设备进入音箱模式可节省电量,也可避免儿童长期观看电视影响视力,提高用户体验。
在一些实施例中,本发明实施例提供的显示设备采用的音箱模式,其使用整体流程为:用户触发进入音箱模式(关屏)的条件;判断当前业务场景是否为非打断场景;如果当前业务场景为非打断场景,则音乐不停播(目前非打断场景包括QQ音乐,媒体中心,Hi音乐,音乐投屏类应用);如果当前业务场景为打断场景(如当前场景为JUUI下视频播放页面),则需要发送转场广播,将系统声音mute(静音)。发送进入音箱模式广播,其余应用在关屏下不能发出声音(通知中心等),并屏蔽按键(如设置键,信号源键)。在音箱模式下,用户可与显示设备进行语音交互。在其他应用需要使用显示器时,则退出音箱模式,显示器开屏。
图6示出了根据一些实施例的音箱模式的整体架构图。参见图6,显示设备中配置的整机应用中,可触发显示设备进入音箱模式的应用包括但不限定于:媒体中心、Hi音乐、视频通话、Power键(电源键)和语音中的至少一个。在音箱模式下,可提 供关机选择界面、过长动画、媒资框架、等效和语音技能等中的至少一个。其中,关机选择界面依赖整机属性,以此来确定是否需要显示界面以及界面中需要显示的选项。
在触发上述任一应用时,系统驱动层可控制Flow灯效/关屏/开屏/关机接口封装层。在显示器中呈现关机选择界面时,关机选择界面中展示息屏、关机、重启等选项,用户可通过遥控器触发其中一个选项,使显示设备执行相应功能。在需要展示过场动画时,本端显示设备发送过场动画及媒资请求至云端服务器,云端服务器返回对应的数据,以展示在显示器中。
在通过语音方式控制显示设备进入音箱模式时,用户输入语音指令,如“进入音箱模式”,此时,显示设备响应该语音指令,将过场动画展示在显示器中。过场动画为随机展示的一张图片,每次展示的图片都不一样。在展示过场动画的过程中,还会进行语音播报,语音播报内容为介绍音箱模式下如何使用语音指令的相关内容,如语音播报内容为“屏幕即将关闭,您可以通过图片所示方式唤醒我”。
过场动画具有展示时效,在开始展示过场动画时,同步展示倒计时,倒计时可设定为5秒,具体可根据播报内容来确定,支持后台运营,针对每个系列机器单独运营,提升用户体验。而且播报音支持声纹,用户可以在设置->AI->语音播报声音中定制播报声音,如播报声音可为男性普通话、女性普通话、女性粤语、女性四川话、男性湖南话等。
图7示出了根据一些实施例的显示设备进入音箱模式的流程图。参见图7,进入音箱模式(关屏)方式主要是Power键、语音、音箱屏保、Hi音乐、媒体中心、关屏等。在控制显示设备进入音箱模式时,需要预先在系统设置中开启待机选择选项,如“关屏”选项。在用户触发Power键时,启动关机选择界面,此时,关机选择界面中展示“关屏”、“关机”、“重启”、“艺术画廊”等选项,用户通过遥控器选择“关屏”选项,则可使显示设备进入音箱模式。
显示设备判断当前业务场景是否为业务不打断场景,如果不是,例如,若当前场景为主页或者电视正在播放视频,需要通过转场,将当前业务打断。同时,启动过场动画页面,倒计时开始,并进行语音播报。在需要进入音箱模式时,调用关屏接口,进行关屏。业务不打断场景通常是指音乐播放类场景,而且其余场景可为业务打断场景。
而用户在通过语音/音箱屏保方式使显示设备进入音箱模式时,则不依赖前述步骤,可以直接通过语音方式使显示设备进入音箱模式。若用户通过Hi音乐或DMP关屏方式控制显示设备进入音箱模式时,由于Hi音乐关屏听歌,媒体中心(DMP)关屏听歌,当前已经为业务不打断场景,因此,可直接关屏。
显示设备在关屏后,可同步设置关屏属性,即将系统属性值设置为1,表示进入音箱模式;将系统属性值设置为0,则表示未进入音箱模式,处于开屏状态。在判断是否需要转场时,需根据当前业务场景而定,如果当前业务场景为业务不打断场景,则无需转场,直接关屏;如果当前业务场景为业务打断场景,则需要转场,完成转场后关屏。转场操作是指应用切换信号源的动作,如切断播放的视频等。
在一些实施例中,在需要显示设备退出音箱模式时,需要由触发退出音箱模式(开屏)的应用发送开屏广播。
图8示出了根据一些实施例的显示设备退出音箱模式的流程图。参见图8,触发 退出音箱模式(开屏)的应用包括但不限定于基于返回键、主页键、Power键的按键指令;语音指令;推送投屏指令;一触即播指令;视频通话等中的至少一个。音箱模式应用收到开屏广播之后,判断当前场景是否为业务不打断场景;如果为业务不打断场景,设置当前模式为普通电视模式;如果为业务打断场景,则需要发送转场广播,拉起网络电视模式,显示网络电视主页。发送广播通知各个应用,当前已经退出音箱模式,调用开屏接口,控制显示器开屏。
可见,在显示设备进入音箱模式时,显示器处于关屏状态;而若要再次使用显示设备的普通电视功能,则需要显示设备退出音箱模式,控制显示器处于开屏状态。因此,可以实现快速开关屏,为提升用户体验,需要快速切换音箱模式下显示器的开关屏状态。显示设备在进入音箱模式或退出音箱模式的区别仅在于,显示器的开关屏状态不同,其余状态均相同,例如主机一直处于运行状态,均可正常响应控制指令等。
图9示出了根据一些实施例的音箱模式下自动开关屏的方法的第一种流程图;图10示出了根据一些实施例的音箱模式下自动开关屏的方法的第一种数据流图。本发明实施例提供一种显示设备,包括:显示器,被配置为呈现用户界面;与显示器连接的控制器,在执行图9和图10所示的音箱模式下自动开关屏的方法时,控制器被配置为执行下述步骤:
S11、响应于指定应用发送的显示器调用指令,判断显示设备本端是否处于音箱模式,指定应用是指在运行时需要将内容呈现在显示器中的应用,音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
显示设备中配置的应用在运行时,需要调用显示器,即将该应用的内容展示在显示器中。为此,需要在运行应用时,显示器应处于开屏状态。
而如果显示设备进入音箱模式时,此时显示器处于关屏状态。因此,为便于准确确定应用的内容是否可及时展示在显示器中,可先判断显示设备本端是否处于音箱模式,即判断显示器的当前使用状态为开屏状态还是关屏状态。
调用显示器的指定应用为在运行时需要将内容呈现在显示器中的应用,因此,在触发指定应用时,产生显示器调用指令,以调用显示器,实现相应内容的展示。
显示器调用指令可通过触发本端整机应用来产生,例如,DMP、Hi音乐、视频通话等。在一种实现场景下,若本端接收到对端的视频通话请求时,可由本端视频通话应用产生显示器调用指令。
在一些实施例中,控制器在接收指定应用发送的显示器调用指令,被进一步配置为:
步骤111、在指定应用为视频通话应用时,接收对端设备在触发对端视频通话应用时发送的视频通话请求。
步骤112、响应于视频通话请求,启动显示设备本端视频通话应用,以及,产生显示器调用指令。
在指定应用为视频通话应用时,对端用户想要与本端用户进行视频通话,则对端用户操作其使用的对端设备,启动对端设备中配置的视频通话应用,产生视频通话请求,并发送至本端显示设备。
本端显示设备在接收到该视频通话请求后,即可启动本端配置的视频通话应用,并在启动本端视频通话应用时,同步产生显示器调用指令。
对端设备可为智能终端或显示设备,智能终端可为手机、iPad等。智能终端触发视频通话应用产生视频通话请求的过程可参照后续步骤S31至S33的实现过程,对端显示设备触发视频通话应用产生视频通话请求的过程可参照后续步骤S21至S23的实现过程,此处不赘述。
在一些实施例中,如果本端启动的指定应用为DMP、Hi音乐等,此场景下不存在对端设备,因此,可根据本端指定应用的启动指令,同步产生显示器调用指令。
在产生显示器调用指令后,为便于准确确定指定应用是否可直接调用显示器,以将指定应用的内容及时展示在显示器中,需先判断本端是否处于音箱模式,即判断显示器的当前使用状态为开屏状态还是关屏状态。
在一些实施例中,控制器在执行判断显示设备本端是否处于音箱模式,被进一步配置为:
步骤113、获取显示设备本端系统属性值。
步骤114、如果显示设备本端系统属性值为1,则确定显示设备本端处于音箱模式。
步骤115、如果显示设备本端系统属性值为0,则确定显示设备本端未处于音箱模式。
基于前述实施例的内容,判断本端是否处于音箱模式,可通过获取本端系统属性值(sys.tvbox.state)的方式进行判断,如果本端系统属性值sys.tvbox.state为1,则确定本端处于音箱模式。如果本端系统属性值sys.tvbox.state为0,则确定本端未处于音箱模式。
在处于音箱模式时,此时启动指定应用需要亮屏,例如,为进行双方用户视频通话需要亮屏(开屏)。此时,本端用户方便时可接听视频通话,不方便时刻选择挂断。在未处于音箱模式时,说明本端显示设备的显示器已处于开屏状态,可直接展示指定应用的内容,例如,可直接展示视频通话界面。
S12、在显示设备本端处于音箱模式时,切换显示器的使用状态为开屏状态,以使显示设备本端退出音箱模式,将指定应用的内容呈现在处于开屏状态的显示器中,以及,在指定应用运行结束后,切换显示器的使用状态为关屏状态,以使显示设备本端进入音箱模式。
在启动指定应用时,如果显示设备本端正处于音箱模式,说明显示器正处于关屏状态。为便于指定应用的内容的及时展示,需要先控制显示设备退出音箱模式,通知显示器进行使用状态的切换,即将显示器的使用状态由关屏状态切换为开屏状态。
在完成开屏状态切换后,显示器亮屏,可将指定应用的内容呈现在处于开屏状态的显示器中。
在一些实施例中,指定应用在完成运行后,如果显示设备原来处于音箱模式下,则在退出指定应用的同时,还需控制显示设备再次进入音箱模式。
此时,在指定应用退出时,生成应用退出指令,本端响应该应用退出指令,将显示器的使用状态由开屏状态切换为关屏状态,以使本端再次进入音箱模式。
因此,在显示设备进入音箱模式后,当有应用需要开屏的时候,通知音箱模式自动开屏。在当前业务执行完毕之后,再重新关屏。
S13、在显示设备本端未处于音箱模式时,将指定应用的内容呈现在处于开屏状态的显示器中,以及,在指定应用运行结束后,取消显示器中指定应用的内容的显示。
在启动指定应用时,如果显示设备本端未处于音箱模式,说明显示器正处于开屏状态。因此,可将指定应用的内容直接展示在显示器中。
在指定应用完成运行后,由于显示设备原处于非音箱模式,因此,在指定应用退出后,无需音箱模式的切换,直接退出指定应用即可,即取消显示器中指定应用的内容的显示。
在一些实施例中,如果指定应用为视频通话应用时,例如通过手机(电视)与电视进行视频通话时,需要将本端屏幕点亮进行视频通话,此时视频通话应用通知音箱模式。
在运行视频通话应用时,若要展示视频通话界面需要显示设备配置有摄像头。因此,在本端亮屏后,需检测摄像头情况,以便能够将视频通话应用的内容展示在显示器中。
在一些实施例中,控制器在执行将指定应用的内容呈现在处于开屏状态的显示器中,被进一步配置为:
在指定应用为视频通话应用,以及,显示器处于开屏状态时,检测摄像头的运行状态,开屏状态用于表征本端未处于音箱模式;
如果摄像头的运行状态为可调用状态,则将视频通话应用在运行时生成的视频通话界面展示在显示器中;
如果摄像头的运行状态为不可调用状态,则生成摄像头故障提示,将摄像头故障提示展示在显示器中。
在指定应用为视频通话应用时,可实现视频通话应用的内容展示的条件为显示器处于开屏状态,而显示器处于开屏状态说明显示设备未处于音箱模式,或者,显示设备原处于音箱模式但已退出音箱模式的情况。
此时,显示设备本端检测摄像头的运行状态,以保证视频通话的正常进行。运行状态包括可调用状态和不可调用状态,可调用状态说明显示设备本端配置有摄像头,且摄像头处于空闲状态;不可调用状态说明本端未配置有摄像头,或者,本端配置的摄像头正被其他应用占用或出现故障,此时,视频通话应用无法调用。
在判断出摄像头的运行状态为可调用状态时,说明当前显示设备支持摄像头,可进行视频通话。此时,可启动视频通话应用,并生成视频通话界面,将视频通话界面展示在显示器中。
在判断出摄像头的运行状态为不可调用状态时,说明当前显示设备无摄像头或者摄像头出现故障。此时,视频通话将无法进行,因此,为提示用户视频通话无法进行的原因,可生成摄像头故障提示,并将摄像头故障提示展示在显示器中,以通过UI提示用户检测摄像头、挂断视频通话或切换至语音通话等操作。
在一些实施例中,若视频通话结束后,如果显示设备原处于音箱模式下,则在退出视频通话应用后,需要控制显示设备重新进入音箱模式,视频通话应用通知音箱模式关屏。如果显示设备原处于开屏状态,则视频通话应用直接退出。
因此,本发明实施例提供的显示设备,在启动指定应用时,可先判断显示设备本端是否处于音箱模式,若正处于音箱模式,则先退出音箱模式,将指定应用展示在显示器中;并在指定应用退出时,再次控制显示设备进入音箱模式。如果显示设备本端未处于音箱模式,则直接将指定应用展示在显示器中;并在指定应用完成运行时,直 接退出指定应用。可见,该显示设备可根据应用场景及时切换显示器的开关屏状态,以及时将应用内容展示在显示器中,用户体验好。
在一些实施例中,在指定应用为视频通话应用时,与本端显示设备进行通话的对端设备可为智能终端,也可为显示设备。
图11示出了根据一些实施例的音箱模式下自动开关屏的方法的第二种流程图;图12示出了根据一些实施例的音箱模式下自动开关屏的方法的第二种数据流图。本发明实施例提供的一种显示设备,包括:显示器,被配置为呈现用户界面;与显示器连接的控制器,在执行图11和图12所示的音箱模式下自动开关屏的方法时,控制器被配置为:
S21、响应于触发本端视频通话应用的启动指令,在显示器中展示视频通话列表,视频通话列表中展示有不同显示设备对应的设备账号。
在本端显示设备A向对端显示设备B发起视频通话时,本端显示设备A触发其配置的视频通话应用,产生应用启动指令。本端显示设备A在显示器中展示视频通话列表,两个显示设备之间进行视频通话时,通过网络即可实现,因此,视频通话列表中展示有不同显示设备对应的设备账号。设备账号可为用户手机号注册的账号,类似于微信账号。
用户A在操作显示设备A启动视频通话应用时,先判断本端是否登录设备账号。如果未登录,则先登录设备账号,例如,输入手机号实现登录。如果已登录有设备账号,则可继续查找需要进行视频通话的设备账号。
S22、接收对视频通话列表中的一个设备账号的操作,生成视频通话请求。
用户A可在本端显示器中展示的视频通话列表中查找要拨打的设备账号,在选中其中一个设备账号后,即可实现拨打视频电话的操作,进而产生视频通话请求。
S23、将视频通话请求发送至设备账号对应的对端显示设备,对端显示设备用于响应视频通话请求确定对端是否处于音箱模式,以切换对端显示器的开屏状态和关屏状态,音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
本端显示设备A将视频通话请求发送至对端显示设备B中,对端显示设备B在接收到该视频通话请求;如果处于音箱模式,则先退出音箱模式以亮屏,再检测摄像头的使用状态。在摄像头处于可调用状态时,将视频通话界面显示在显示器中。如果未处于音箱模式,则直接检测摄像头的使用状态,并在摄像头处于可调用状态时,将视频通话界面显示在显示器中。对端显示设备B在响应来自显示设备A的视频通话请求所执行的切换显示器开屏状态和关屏状态的步骤,均可参照前述实施例提供的步骤S11至S13及相关步骤,此处不再赘述。
在对端显示设备B响应视频通话请求生成视频通话界面的同时,给本端显示设备A发送连接成功通知,则本端也生成视频通话界面,显示在显示器中。此时,本端用户A即可利用本端显示设备A和对端显示设备B实现与对端用户B进行视频通话。
而在视频通话结束后,在一些实施例中,关闭摄像头,退出视频通话应用,并再次关闭显示屏,进入音箱模式。
在一些实施例中,在与显示设备进行视频通话的对端设备为智能终端时,智能终端所执行的步骤与对端设备为显示设备所执行的步骤不同。
图13示出了根据一些实施例的音箱模式下自动开关屏的方法的第三种流程图;图 14示出了根据一些实施例的音箱模式下自动开关屏的方法的第三种数据流图。本发明实施例提供一种智能终端,包括:显示器,被配置为呈现用户界面;与显示器连接的控制器,在执行图13和图14所示的音箱模式下自动开关屏的方法时,控制器被配置为:
S31、响应于触发本端视频通话应用的启动指令,在显示器中展示视频通话列表,视频通话列表中展示有与智能终端本端进行绑定的不同显示设备。
在本端智能终端向对端显示设备发起视频通话时,本端智能终端触发其配置的视频通话应用,产生应用启动指令。本端智能终端在显示器中展示视频通话列表,为实现手机与显示设备的通信,需要先将手机与显示设备进行绑定,因此,手机端展示的视频通话列表中包括与本端绑定的至少一个显示设备。
S32、在基于视频通话列表选择目标显示设备后,触发视频通话按钮,生成视频通话请求。
智能终端用户基于视频通话列表,通过登录账号寻找绑定过的显示设备。如果本端智能终端的登录账号与显示设备的登录账号一致,说明智能终端已与该显示设备绑定,只有绑定的显示设备才可实现视频通话。
因此,用户在视频通话列表中选择其中一个目标显示设备后,需判断二者的登录账号是否一致,以保证视频通话的顺利进行。
在一些实施例中,在查看手机端与显示设备端是否登录同一账号时,控制器被进一步配置为:
步骤321、基于视频通话列表选择目标显示设备后,获取本端登录账号和目标显示设备的登录账号;
步骤322、如果本端登录账号与目标显示设备的登录账号不一致,则基于目标显示设备的登录账号切换本端登录账号,切换后的本端账号与目标显示设备的登录账号一致。
图15示出了根据一些实施例的智能终端选择目标显示设备的界面示意图。参见图15中(a)的(1)部分,视频通话列表中展示多个显示设备的信息。智能终端用户在视频通话列表中选择一个显示设备后,则本端获取本端登录账号和目标显示设备的登录账号。登录账号为用户账号,可为通过邮箱或手机号注册的账号。
如果本端登录账号与目标显示设备的登录账号不一致,说明用户选择的显示设备与本端并未进行绑定,此时,需要将二者切换至相同账号。切换账号时,可以目标显示设备的登录账号为基准,切换本端登录账号,使得切换后的本端账号与目标显示设备的登录账号一致。
在一些实施例中,在判断出本端与用户选择的显示设备的登录账号不一致时,为提示用户切换账号,可在本端显示器中显示操作提示,提示内容可为“账号不一致,请进行切换”等。
如果本端登录账号与目标显示设备的登录账号一致,说明二者已进行绑定,可进行视频通话。此时,显示器中的界面由展示视频通话列表切换为设备信息界面,如图15中(b)所示。
图15中(b)所示的界面中(2)部分为用户所选择的设备信息,(3)部分为视频通话按钮。在确定出进行视频通话的目标显示设备后,用户触发视频通话按钮,即可 生成视频通话请求。
S33、将视频通话请求发送至目标显示设备,目标显示设备用于响应视频通话请求确定是否处于音箱模式,以切换目标显示器的开屏状态和关屏状态,音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
在一些实施例中,智能终端与显示设备实现视频通话,需要获取显示设备的mac地址。因此,本端智能终端根据获取的设备信息中的mac地址,生成视频通话请求。
本端智能终端基于mac地址将视频通话请求发送至对应的显示设备中,目标显示设备接收到来自智能终端的视频通话请求后,先判断自身是否处于音箱模式。如果处于音箱模式,则先退出音箱模式以亮屏,再检测摄像头的使用状态。在摄像头处于可调用状态时,将视频通话界面显示在显示器中。如果未处于音箱模式,则直接检测摄像头的使用状态,并在摄像头处于可调用状态时,将视频通话界面显示在显示器中。目标显示设备在响应来自智能终端的视频通话请求所执行的切换显示器开屏状态和关屏状态的步骤,均可参照前述实施例提供的步骤S11至S13及相关步骤,此处不再赘述。
在目标显示设备响应视频通话请求生成视频通话界面的同时,给本端智能终端发送连接成功通知,则本端也生成视频通话界面,显示在显示器中。此时,本端用户A即可利用本端智能终端和目标显示设备实现与对端用户B进行视频通话。
由以上技术方案可知,本发明实施例提供的显示设备,在显示设备本端需要展示指定应用的内容时,可先判断显示设备本端是否处于音箱模式,若正处于音箱模式,则先退出音箱模式,切换显示器的使用状态为开屏状态,以将指定应用的内容展示在显示器中;并在指定应用退出时,切换显示器的使用状态为关屏状态,以再次控制显示设备进入音箱模式。如果显示设备本端未处于音箱模式,则直接将指定应用展示在显示器中;并在指定应用完成运行时,直接退出指定应用。可见,该方法及智能终端、显示设备,可根据应用场景快速切换显示器的开关屏状态,以及时将应用内容展示在显示器中,用户体验好。
在本申请的另一些实施例中,用户触发如图7示出的电源键执行关机指令,则在执行关机动作之前,提供一关机选择界面,包括关机操作选项,包括但不限定于关机选项、关屏选项、重启选项、音箱模式等中的至少一个。
在一些实施例中,用户在触发遥控器电源键后,执行后续为渲染关机选择界面获取数据的相关步骤。
因此,控制器在执行获取关机操作选项,被进一步配置为:
步骤41、判断当前场景是否需要启动关机选择界面。
步骤42、如果当前场景需要启动关机选择界面,则启动关机选择进程,以获取关机操作选项。
步骤43、如果当前场景不需要启动关机选择界面,则执行关机进程。
在一些实施例中,关机操作选项可在系统设置界面中进行选择,如果用户选择三个关机操作选项,则系统配置信息中包括该三个关机操作选项的信息,后续渲染关机选择界面时,关机选择界面中呈现该三个关机操作选项。
在一些实施例中如果当前场景不需要启动关机选择界面,说明用户在触发电源键 后,显示器中无需弹出关机选择界面,此时,显示设备可直接关机,即执行关机进程。
在触发遥控器电源键时的场景下,如果用户已预先配置了关机操作选项,则需要启动关机选择界面。此时,可执行渲染关机选择界面的进程。
在一些实施例中,在用户对显示设备执行关机操作或者需要显示设备进入音箱模式时,需要显示器中展示关机选择界面,便于用户进行选择,以使显示设备执行相对应的进程。
为避免现有的常采用透明形式的关机选择界面不便于用户查看该界面展示的关机操作选项的问题,本发明实施例提供一种采用模糊形式的关机选择界面,该模糊形式的关机选择界面不会将下层的用户界面中原呈现的内容透显出来,从视觉上便于用户查看该界面上展示的各个关机操作选项,用户体验好。采用模糊形式的关机选择界面较采用透明形式的关机选择界面更为美观,UI更便于查看。
在一些实施例中,显示设备内配置有高斯模糊处理功能,可提供采用模糊形式的关机选择界面,本实施例采用的方法是截取当前用户界面对应的图像,对图像进行高斯模糊处理,将处理后的图像作为关机选择界面的底层界面。
图16示出了根据一些实施例的关机选择界面的动态处理方法的流程图;图17示出了根据一些实施例的关机选择界面的动态处理方法的数据流图。本发明实施例提供一种显示设备,包括:显示器,被配置为呈现用户界面;与显示器连接的控制器,在执行图16和图17所示的关机选择界面的动态处理方法时,控制器被配置为执行下述步骤:具体的,包括:
S51,响应于调起关机选择界面的关机指令,获取关于包括关机操作选项,以及截
取当前用户界面对应的图形;
在一些实施例中,截取的图像为显示设备在响应调起关机选择界面的指令时,当前用户界面中展示的最后一帧图像。
S52、对图像进行高斯模糊处理,以及,基于关机操作选项和处理后的图像,生成关机选择界面。
为在显示设备内配置有高斯模糊处理功能,可提供采用模糊形式的关机选择界面,可对截取的图像进行高斯模糊处理。
在一些实施例中,控制器在执行对图像进行高斯模糊处理,被进一步配置为:
步骤521、获取对图像进行高斯模糊处理所需的缩小比例和模糊半径。
步骤522、基于缩小比例和模糊半径,对图像进行高斯模糊处理,得到处理后的图像。
图像是指在触发电源键时用户界面中呈现内容的截图,截取图像的操作依赖系统底层接口,选择截图宽度值和高度值,截图成功后保存为Bitmap形式。
在对截取的图像进行高斯模糊处理时,需要利用图像的缩小比例(Scale)和模糊半径(Radius)。缩小比例是指分辨率缩小的比例,缩小比例越小,图像缩的越小,即缩小程度越大。模糊半径是指高斯模糊中的半径,即某个像素点向外扩展的值,可理解为模糊的程度。模糊半径的值越大,模糊程度越大,模糊效果越明显。
在一些实施例中,缩小比例(Scale)和模糊半径(Radius)可动态取值,具体地,控制器在执行获取对图像进行高斯模糊处理所需的缩小比例和模糊半径,被进一步配置为执行下述步骤:
步骤5211、获取图像的分辨率和高斯模糊处理后对应的目标分辨率。
步骤5212、基于分辨率和目标分辨率,计算所述图像的缩小比例。
步骤5213、基于图像的缩小比例和默认的高斯模糊半径,计算图像的模糊半径。
图像的缩小比例可基于图像本身的分辨率和目标分辨率来确定,目标分辨率为高斯模糊处理后设定的分辨率。本实施例中,目标分辨率设定为1080P,如果图像本身的分辨率高于1080P,则需将该图像的分辨率进行缩小。
缩小比例(Scale)为动态取值,依赖于图像的分辨率。如果当前屏幕截图图像的分辨率为8k,则缩小比例(Scale)为0.125,即1/8,以将图像缩小至1080P。如果当前屏幕截图图像的分辨率为4k,则缩小比例(Scale)为0.25,即1/4,以将图像缩小至1080P。如果当前屏幕截图图像的分辨率为1080P,则缩小比例(Scale)为1。缩小比例(Scale)最大取值为1。
如果当前屏幕截图图像的分辨率小于1080P,则无需再确定缩小比例,可直接利用该图像进行后续处理。
由于缩小比例越小,图像压缩越大。而如果图像压缩太大就比较模糊,为满足图像清晰度的需求,可利用模糊半径来调节。例如,如果图像压缩太大,则通过减小模糊半径来调整清晰度;如果图像压缩太小,则通过增加模糊半径来调整清晰度。
为此,在确定图像的模糊半径时,模糊半径(Radius)与缩小比例(Scale)之间满足如下调节公式:
radius=defaultRadius*10/scale;(1)
defaultRadius=3*sigama;(2)
其中,defaultRadius为默认的高斯模糊半径;sigama为正太分布中的取值,本实施例取值3sigama。因此,按照正太分布原则,defaultRadius=0.9974。
在确定出图像的缩小比例和模糊半径后,即可对图像进行模糊处理,得到处理后的图像。
在获取到关机操作选项以及得到经过高斯模糊处理后的图像,即可生成关机选择界面,以将关机选择界面展示在显示器中,由关机选择界面对显示器中原用户界面中的内容进行遮挡,可避免显示器中在呈现关机操作选项时,下层用户界面中原呈现的内容被用户看到。
由于关机选择界面的底层界面为触发电源键时显示器中原呈现内容的截图并经过高斯模糊处理后的图像,因此,从视觉效果上,用户可以看到一张呈模糊状态的背景图。
图18示出了根据一些实施例的关机选择界面的效果示意图。参见图18,在用户预先选择的关机操作选项为关机、重启和AI Cloud时,用户触发遥控器电源键时用户界面中呈现的内容为视频画面,则关机选择界面的下层背景图为呈模糊状态的视频画面,并在背景图上显示关机选项、重启选项和AI Cloud选项。
在一些实施例中,控制器在执行基于关机操作选项和处理后的图像,生成关机选择界面,被进一步配置为:
步骤5221、在关机操作选项为关机选项时,为关机选项配置倒计时控件,倒计时控件用于在倒计时结束时触发关机选项。
步骤5222、将配置有倒计时控件的关机选项展示在处理后的图像中,生成关机选 择界面。
在关机操作选择包括关机选项时,可对显示设备执行关机进程的触发条件可为触发关机选项。而关机选项的触发可为用户主动触发,也可为设备自动触发。
在设备自动触发时,可为关机选项配置倒计时控件,在倒计时结束时可自动触发关机选项,此时,基于高斯模糊处理后的图像和配置有倒计时控件的关机选项,渲染成关机选择界面。
S53、将关机选择界面展示在显示器中,关机选择界面叠加在当前用户界面的上方展示。
在渲染得到关机选择界面后,即可将关机选择界面展示在显示器中。而为对显示器中原展示的用户界面进行遮挡,可由关机选择界面覆盖在显示器中原用户界面之上,可避免在显示器中呈现关机操作选项时,下层用户界面中原呈现的内容被用户看到。
在一些实施例中,在执行关机进程时,控制器被进一步配置为:接收对关机选择界面中的关机选项的操作,或者,在关机选项上的倒计时控件的倒计时结束时,执行关机进程。
在用户采用触发遥控器电源键的方式调起关机选择界面时,显示器中呈现关机选择界面,用户可通过遥控器方向键触发关机选择界面中的关机选项,启动关机进程;若用户触发电源键后并未触发任何关机操作选项,则在显示关机选择界面的同时,关机选项上的倒计时控件开始倒计时,在倒计时结束后,启动关机进程。
再次参见图18,关机选项上配置的倒计时可设定为20s,在20s倒计时结束后,用户未触发其他选项,则设备自动触发关机选项,执行关机操作。
在一些实施例中,在显示器中呈现包括关机操作选项的关机选择界面时,用户还可控制显示设备进入音箱模式,此时,控制器被进一步配置为:在关机操作选项为关屏选项时,接收对关屏选项的操作,切换显示器的使用状态为关屏状态,以使显示设备进入音箱模式,音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
图19示出了根据一些实施例的基于关机选择界面触发关屏选项的效果示意图。参见图19,显示设备在正常运行状态时,显示器的使用状态为开屏状态。如果用户触发遥控器电源键,显示器中呈现关机选择界面,此时,用户再次触发关屏选项,则可控制显示设备进入音箱模式。关屏选项用于控制显示器关屏,此时,显示设备主机正常运行,仅显示器关闭。
用户对关屏选项执行触发操作,可将显示器的使用状态由开屏状态切换为关屏状态,此时,显示设备进入音箱模式。如果需要显示设备再次开屏,正常使用,则可通过触发退出音箱模式(开屏)的应用来实现,触发开屏应用包括但不限定于红外语音、返回键、主页键、Power键;语音;推动亮屏;一触即播;视频通话等。
在一些实施例中,如图17,用户按下关机按键,控制器被进一步配置为:用户按下电源键,判断是否需要启动关机选择界面,如果是则获取系统配置信息,背景高斯模糊处理,如果需要做高斯处理,对截取的图像进行高斯模糊,生成模糊状态的关机界面及UI显示,如果不需要做高斯处理,则设置透明度,生成灰度状态的关机选择界面及UI显示。
而为对用户界面中原呈现内容进行遮挡,可为关机选择界面设置目标透明度,使 得关机选择界面并非完全透明状态,而是呈现一种灰度状态。目标透明度可根据用户实际使用情况自行定义,此处不进行具体限定。
在完成目标透明度的设置后,将具有目标透明度的关机选择界面展示在显示器中,显示器中原展示有用户界面,关机选择界面覆盖在用户界面上层。由于关机选择界面并非透明状态,而是呈灰度状态,因此,可对用户界面中原呈现的内容进行遮挡,便于用户能够清晰地查看到关机选择界面上展示的各个关机操作选项,用户体验好。
在一些实施例中,在显示设备进入音箱模式时,显示器处于关屏状态;而若要再次使用显示设备的普通电视功能,则需要显示设备退出音箱模式,控制显示器处于开屏状态。显示设备在进入音箱模式或退出音箱模式的区别仅在于,显示器的开关屏状态不同,其余状态均相同,例如主机一直处于运行状态,均可正常响应控制指令等。
通常情况下,显示设备在进行转场时,显示器直接关屏,后台执行信号源切换。但由于显示设备进入音箱模式的状态与显示设备关机的状态相似,从视觉效果上均为显示器呈关屏状态。在此场景下,用户极易对显示设备进行误操作,例如,若用户想要使用显示设备,则可能以关机状态执行对应的开机操作,但当前显示设备是处于音箱模式,对处于音箱模式的显示设备执行开机操作,可能导致显示设备无法响应,或响应,但因无法退出音箱模式,使得显示器并未开屏,导致用户误以为显示设备出现异常。
因此,为避免用户将进入音箱模式的显示设备误认为显示设备已被关机,并对进入音箱模式的显示设备产生误操作,本发明实施例提供一种显示设备,被配置为执行音箱模式下提示信息的展示方法,使得显示设备在进入音箱模式时,能够及时提示用户,以告知用户当前显示设备的状态是进入音箱模式,而非关机,并提示用户可实时开屏退出音箱模式,防止显示设备不响应用户的误操作,影响用户体验。
显示设备在进入音箱模式时,在显示器中呈现提示信息,提示信息包括过场动画和播报音语料。提示信息可告知用户显示设备的当前状态,还可提示用户当前显示设备作为智能音箱使用的操作流程,以使用户能够准确地操作显示设备,提高用户体验。
图20示出了根据一些实施例的音箱模式下提示信息的展示方法的流程图;图21示出了根据一些实施例的音箱模式下提示信息的展示方法的数据流图。本发明实施例提供一种显示设备,包括:显示器,被配置为呈现用户界面;与显示器连接的控制器,在执行图20和图21所示的音箱模式下提示信息的展示方法时,控制器被配置为执行下述步骤:
S71、响应于通过用户接口接收的进入音箱模式的控制指令,获取用于提示用户所操作的显示设备处于音箱模式下的过场动画和播报音语料,以及,启动与过场动画和播报音语料对应的过场倒计时,音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
在用户使用显示设备时,显示器中呈现对应的画面。如果用户需要控制显示设备进入音箱模式,则可通过触发关屏条件,触发的关屏条件包括图7所示的Power键、语音、音箱屏保、Hi音乐/DMP关屏等方式。用户通过任一种方式执行触发关屏条件的操作,产生对应的指令。
为便于及时告知用户显示设备即将进入音箱模式,并提示用户如何操作处于音箱模式下的显示设备的流程,可在显示设备进入音箱模式时,在显示器中呈现提示信息。
为此,控制器在接收到控制显示设备本端进入音箱模式的控制指令后,显示设备后台需要切换信号源,同时,获取用于提示用户所操作的显示设备处于音箱模式下的过场动画和播报音语料。过场动画为随机展示的一幅背景图片,该背景图片用于介绍在音箱模式下如何使用语音指令操作显示设备的步骤。播报音语料用于从听觉角度告知用户当前显示设备的状态和提示用户使用语音方式操作显示设备。
过场动画的展示具有时效性,播报音语料的播报也具有时效性,因此,需要在显示设备展示过场动画并播放播报音语料时,采用倒计时的形式进行展示和播报。在此场景下,基于过场动画和播报音语料,启动一个过场倒计时,过场倒计时是指为用户展示提示信息的时长,以倒计时形式进行展示。
图22示出了根据一些实施例的获取过场动画的方法流程图。参见图22中进程(1),在获取过场动画,显示设备需随机获取一张背景图片,以生成过场动画。具体地,控制器在执行获取过场动画,被进一步配置为执行下述步骤:
步骤711、获取用于实现过场动画的背景图片路径。
步骤712、如果背景图片路径不为空,则基于背景图片路径加载背景图片。
步骤713、基于背景图片生成过场动画。
在获取过场动画时,过场动画随机展示一张背景图片,相邻两次展示的背景图片不相同。而为避免网络异常等原因,导致本端无法及时获取到背景图片,影响过场动画的及时展示,可将背景图片提前存储到背景图片路径。
例如,显示设备可在本次获取过场动画时,利用前一次执行获取过场动画进程时所读取的背景图片,而本次读取的背景图片则可在下一次执行获取过场动画进程时所使用。
存储有前一次获取到的背景图片的背景图片路径可存储在本地,如果背景图片路径中存储有背景图片,说明前一次执行获取过场动画进程时有读取到背景图片,则背景图片路径不为空。此时,可直接基于背景图片路径加载背景图片,最后,基于背景图片生成过场动画。
如果背景图片路径中未存储有背景图片,说明前一次执行获取过场动画进程时并未读取到背景图片,则背景图片路径为空。
在一些实施例中,在背景图片路径为空时,控制器被进一步配置为:
步骤714、如果背景图片路径为空,则获取用于实现过场动画的广告路径。
步骤715、如果广告路径不为空,则加载广告,基于广告生成过场动画。
步骤716、如果广告路径为空,则加载本地默认图片,基于本地默认图片生成过场动画。
在背景图片路径为空时,说明前一次执行获取过场动画进程时并未读取到背景图片,此时,为保证过场动画的正常展示,可替代展示广告业务的界面。因此,可获取用于实现过场动画的广告路径。
若显示设备预先配置有广告业务,则本地存储有广告路径,且广告路径不为空,此时,可直接基于广告路径加载广告,以便基于广告生成过场动画。
若显示设备预先未配置有广告业务,则本地存储的广告路径为空,此时,为便于过场动画的及时展示,可加载本地默认图片。本地默认图片可存储在本地缓存路径,以便基于本地默认图片生成过场动画。
在一些实施例中,在生成过场动画时,除可展示背景图片、广告业务之外,还可展示一些当前时期热度较高的社交类应用,例如,AI健身,心率健康研究等。显示设备在进入音箱模式时所展示的过场动画,除可提升用户体验(提示用户各种处于音箱模式的显示设备的操作流程)之外,还可展示更为丰富的内容,向用户推荐更多有趣的内容,用户体验更好。
在一些实施例中,如果在执行当前次获取过场动画进程时,实时从服务器端获取云端动画数据,数据获取速度较慢,若存在网络异常,则将无法生成过场动画,导致显示设备在进入音箱模式时显示器中无法及时展示提示信息,影响用户体验。
因此,为保证显示设备在进入音箱模式时,显示器中能够及时展示过场动画,该显示设备可提前将所需的背景图片存储在本地,即显示设备在从本地获取背景图片(执行当前次获取过场动画进程)的同时,还可执行另一个进程,即向服务器云端获取云端动画数据,该实时获取的云端动画数据即为下一次执行获取过场动画进程时所需的背景图片。两个进程同步进行,互不干扰。
在一些实施例中,显示设备实时向服务器端请求的云端动画数据中包括背景图片,将背景图片存储在本地的背景图片路径,便于下一次执行获取过场动画进程时直接读取该路径下的背景图片,及时生成过场动画。因此,显示设备本次获取背景图片路径的执行过程等同于实时向服务器请求云端动画数据以存储至背景图片路径的过程。
具体地,控制器在执行步骤711,即获取用于实现过场动画的背景图片路径,被进一步配置为执行下述步骤:
步骤7111、检测本地系统网络是否处于连接状态。
步骤7112、在本地系统网络处于连接状态时,获取本次请求云端动画数据的本次时间戳和上一次请求云端动画数据的历史时间戳。
步骤7113、如果本次时间戳与历史时间戳不一致,则删除本地缓存路径中的背景图片,以及,将本次请求的云端动画数据中的背景图片存储至本地缓存路径中,本地缓存路径为下一次获取过场动画时所需的背景图片路径。
步骤7114、如果本次时间戳与历史时间戳一致,则将本次请求的云端动画数据中的背景图片存储至本地缓存路径中。
显示设备在执行图22中进程(1)的同时,同步执行图22中进程(2),即启动向服务器请求数据的服务进程(service),以随机存储图22中进程(1)所需的背景图片路径。
显示设备端在向服务器请求数据时,需要保证本端保持网络连接状态,不同的连接状态执行不同的保存背景图片路径的过程。因此,在启动service后,先判断本地系统网络是否处于连接状态。
在本地系统网络处于连接状态时,显示设备可实时向服务器发送数据请求,以获取云端动画数据。因此,在本地系统网络处于连接状态时,显示设备本端实时请求云端接口,发送数据请求至服务器的云端接口,服务器接收到数据请求后,将云端动画数据下发至显示设备。
显示设备在接收到云端动画数据后,对该云端动画数据进行解析,得到本次时间戳和背景图片。
在一些实施例中,如果系统后台未对背景图片进行更新,则时间戳不会发生变化; 若系统后台对背景图片进行更新,则时间戳会发生变化。在时间戳发生改变时,则需要更新本地存储的背景图片。因此,显示设备获取上一次请求云端动画数据对应的历史时间戳,将历史时间戳与本次时间戳进行对比。其中,本地用于存储背景图片的文件夹是本地缓存路径(les/tvbox)。
在一些实施例中,如果本次时间戳与历史时间戳不一致,说明系统后台已对云端存储的背景图片进行更新,此时,需删除本地缓存路径(les/tvbox)中的背景图片,删除是将本地缓存路径(les/tvbox)中的所有背景图片全部删除。
执行删除操作后本地缓存路径为空,然后再将本次请求的云端动画数据中的背景图片存储至本地缓存路径中,实现本地缓存路径中的背景图片的更新,以将本地缓存路径作为下一次获取过场动画时所需的背景图片路径。
在一些实施例中,如果本次时间戳与历史时间戳一致,说明系统后台未对云端存储的背景图片进行更新,则可直接将本次请求的云端动画数据中的背景图片存储至本地缓存路径。
在一些实施例中,在本地缓存路径存储背景图片时,如果本地缓存路径未执行删除操作,则本地缓存路径在存储新的背景图片之前已存储有历史背景图片。为避免相同背景图片的重复存储,需检测该新的背景图片是否已被存储过。
具体地,控制器在执行将本次请求的云端动画数据中的背景图片存储至本地缓存路径,被进一步配置为执行下述步骤:
步骤717、检测本地缓存路径中是否已经存储过本次请求的云端动画数据中的背景图片。
步骤718、如果已经存储过,则不将本次请求的云端动画数据中的背景图片存储至本地缓存路径中;
步骤719、如果未存储过,则将本次请求的云端数据中的背景图片存储至本地缓存路径中。
在本次时间戳与历史时间戳一致时,显示设备可将实时向服务器请求的云端动画数据中新的背景图片存储至本地缓存路径(les/tvbox)中。由于,此时本地缓存路径中可能存储有历史背景图片,因此,在存储新的背景图片之前,先判断本地缓存路径中是否已经存储过该新获取的背景图片。
如果该新的背景图片已经存储过,即本地缓存路径中已经存在该背景图片,为避免重复存储,则不再将本次请求的新的背景图片保存至本地缓存路径中。如果该新的背景图片未被存储过,即本地缓存路径中不存在该背景图片,则需要将本次请求的新的背景图片保存至本地缓存路径中。
可见,在本地系统网络处于连接状态时,显示设备可实时向服务器请求云端动画数据,经过解析后,利用本次时间戳与历史时间戳进行对比,来判断系统后台是否对背景图片进行更新。在对比不一致(存在更新)时,则先删除本地缓存的背景图片,重新下载,即将新获取的云端动画数据中新的背景图片存储至本地缓存路径中;若对比一致(未更新)时,则直接将新的背景图片存储至本地缓存路径中。在存储时,若该新的背景图片已被存储过,则不再进行存储;若该新的背景图片未被存储过,则需要存储。该方案可保证显示设备可实时获取到背景图片,并存储图22中进程(1)所需的背景图片路径,便于下一次执行获取过场动画进程时使用。
在一些实施例中,如果本地系统网络未处于连接状态,则显示设备无法实时向服务器请求数据。此时,可随机在本地缓存路径中选取任一张背景图片作为新的背景图片,并将该新的背景图片的访问路径作为下一次执行获取过场动画进程时使用的背景图片路径。
在一些实施例中,在本地系统网络未处于连接状态时,控制器被进一步配置为:
步骤71115、在本地系统网络未处于连接状态时,随机获取本地缓存路径中的背景图片。
步骤71116、如果背景图片已展示过,则重新随机获取本地缓存路径中的背景图片。
步骤71117、如果背景图片未展示过,则将背景图片所在的本地缓存路径确定为下一次获取过场动画时所需的背景图片路径。
在本地系统网络未处于连接状态时,为保证能够获取到新的背景图片,以保存新的背景图片路径,可随机在本地缓存路径中随机选取一张背景图片。
为避免在显示设备进入音箱模式时,显示器中相邻两次展示的过场动画相同,随机选取的背景图片需与上一次展示的背景图片不一致。因此,在随机获取到一张背景图片后,需判断该背景图片是否在上一次已经展示过。
如果该背景图片已在上一次展示过,则需要重新在本地缓存路径中获取另一张背景图片,依次循环,直至随机获取的下一张背景图片未在上一次展示过为止。
如果随机获取到的背景图片未在上一次展示过,则可将该背景图片所在本地缓存路径确定为下一次获取过场动画时所需的背景图片路径,以实现背景图片路径的更新,保证下一次执行获取过场动画进程时能够展示不同的背景图片。
图23示出了根据一些实施例的过场动画的效果示意图。参见图23中所示的四副过场动画,每一幅过场动画均利用不同的背景图片生成。显示设备在进入音箱模式时,显示器可随机展示任一副过场动画,且相邻两次展示的过场动画不同。
可见,在本地系统网络未处于连接状态时,为能够及时更新背景图片路径,以保证相邻两次执行获取过场动画进程时所需的背景图片不同,设备本端可在本地缓存路径中随机获取一张背景图片;如果该背景图片在上一次被展示过,则重新随机选取;如果该背景图片未在上一次展示过,则将该背景图片的路径作为背景图片路径,以更新下一次执行获取过场动画进程时所需的背景图片路径,避免相邻两次展示的过场动画相同。
在一些实施例中,显示设备在接收到控制显示设备本端进入音箱模式的指令后,可同步获取用于提示用户,其所操作的显示设备在处于音箱模式下的过场动画和播报音语料,以基于过场倒计时在显示器中展示过场动画时,设备能够同步以语音的方式播报,实现从视觉和听觉角度为用户提示如何操作进入音箱模式的显示设备的流程,提高用户体验。因此,在显示设备执行前述实施例提供的获取过场动画的过程时,还可同时执行获取播报音语料的过程。
图24示出了根据一些实施例的获取播报音语料和过场倒计时的方法流程图。在一些实施例中,参见图24中进程(1),控制器在执行步骤S1,即获取播报音语料,被进一步配置为执行下述步骤:
步骤7121、获取用于存储播报音语料的播报缓存。
步骤7122、如果播报缓存不为空,则获取播报缓存中存储的播报音语料。
步骤7123、如果播报缓存为空,则获取本地默认缓存中存储的播报音语料。
音箱模式下所需的播报音语料均可以由系统后台进行配置,不同机型的显示设备中可以配置不同的播报语音。其中,播报音语料与过场倒计时强相关,即过场倒计时的时长大小与播报音语料的文本长度正相关。
为避免网络异常等原因,导致本端无法及时获取到播报音语料,影响播报音语料的及时展示,可将播报音语料等信息提前存储到本地。在获取播报音语料时,显示设备本地用于存储播报音语料的位置为本地的播报缓存。
因此,在需要获取播报音语料时,可读取本地的播报缓存。如果播报缓存中存储有播报音语料,说明前一次执行获取播报音语料进程时有读取到相关数据,则播报缓存不为空。此时,可直接读取播报缓存中存储的播报音语料。
如果播报缓存中未存储有播报音语料,说明前一次执行获取播报音语料进程时未读取到相关数据,则播报缓存为空。此时,为保证播报音语料的正常及时展示,可获取本地默认缓存中存储的播报音语料。
在一些实施例中,如果在执行当前次获取播报音语料进程时,实时从服务器端获取云端播报数据,数据获取速度较慢,若存在网络异常,则将无法及时展示播报音语料,导致显示设备在进入音箱模式时显示器中无法及时展示提示信息,影响用户体验。
因此,为保证显示设备在进入音箱模式时,显示器中能够及时展示播报音语料,该显示设备可提前将所需的播报音语料存储在本地,即显示设备在从本地获取播报音语料(执行当前次获取播报音语料进程)的同时,还可执行另一个进程,即向服务器云端获取云端播报数据,该实时获取的云端播报数据即为下一次执行获取播报音语料进程时所需的数据。两个进程同步进行,互不干扰。
在一些实施例中,显示设备实时向服务器端请求的云端播报数据中包括播报音语料,将播报音语料存储在本地的播报缓存中,便于下一次执行获取播报音语料进程时直接读取该播报缓存下的播报音语料,及时播放播报音语料。因此,显示设备本次获取播报缓存的执行过程等同于实时向服务器请求云端播报数据以存储至播报缓存的过程。
具体地,参见图24中进程(2),控制器在执行步骤121,即获取用于存储播报音语料的播报缓存,被进一步配置为执行下述步骤:
步骤71211、在本地系统网络处于连接状态时,向服务器获取云端播报数据。
步骤71212、解析云端播报数据,得到播报音语料,将播报音语料存储至播报缓存。
显示设备在执行图24中进程(1)的同时,同步执行图24中进程(2),即启动向服务器请求数据的云端接口,以存储图24中进程(1)所需的播报缓存。
显示设备端在向服务器请求数据时,需要保证本端保持网络连接状态,如果本地系统网络未处于连接状态,则不请求云端播报数据。
如果本地系统网络处于连接状态,则向服务器获取云端播报数据。服务器接收到数据请求后,将云端播报数据下发至显示设备。显示设备在接收到云端播报数据后,对该云端播报数据进行解析,得到播报音语料,最后将实时获取到的播报音语料存储至本地的播报缓存,以便于下一次控制显示设备进入音箱模式时执行获取播报音语料 进程时直接读取,提高处理效率,用户体验好。
在一些实施例中,由于播报音语料与过场倒计时强相关,因此,为保证获取播报音语料与过场倒计时的同步机制,以保证播报音语料的播报时间与过场倒计时匹配,过场倒计时可基于播报音语料来确定。
在一些实施例中,控制器在执行启动与过场动画和播报音语料对应的过场倒计时,被进一步配置为执行下述步骤:
步骤71213、获取显示设备在转场时所需的转场消耗时长和播报音语料对应的文本字数,转场是指显示设备在实现进入音箱模式时切换信号源的过程。
步骤71214、基于播报音语料的文本字数和字均消耗时长,计算播放播报音语料时所需的播报消耗时长。
步骤71215、计算转场消耗时长和播报消耗时长的总时长,确定过场倒计时。
显示设备在进入音箱模式时需要转场,即实现信号源的切换,以将显示器关闭。转场时系统的声音将被静音,此时若进行播报音语料的播放,则会没有声音,导致无法成功播报。因此,为保证播报音语料的正常播放,需要在显示设备转场成功之后再进行语音播报。
由于在显示设备开始进行转场时,过场倒计时即开始计时,因此,过场倒计时为转场消耗时长和播报消耗时长的总和。而播报消耗时长与播报音语料对应的文本字数相关,不同文本长度的播报音语料对应不同的播报消耗时长。
在一些实施例中,过场倒计时的时长为过场动画的展示时长。
在一些实施例中,显示设备转场所需的转场消耗时长(timeSilo)通常在3s内。设定每播报一个“字”耗时405ms,即字均消耗时长(timeTts)为405ms。如果播报音语料的文本字数为N,则播放播报音语料时所需的播报消耗时长为N*timeTts。此时,总时长totalTime=timeSilo+N*timeTts,单位为ms。
在一些实施例中,过场倒计时以向上取整数为原则。此时,过场倒计时的时长timeCountDown=Math.Ceil(totalTime/1000),单位为s。
例如,在控制显示设备进入音箱模式时,获取到当前次转场消耗时长为2s,播报音语料的文本字数为8个文字,则总时长totalTime=2s+8*405ms=2s+3240ms=5s240ms。最后,确定过场倒计时的时长timeCountDown=Math.ceil(5.240)=6s。
可见,将过场倒计时配置为6s符合播报需求,即在确定过场倒计时的时长时,充分考虑转场消耗时长和播报消耗时长,并在显示设备转场成功之后再进行播报的原则,可以使得在过场倒计时完毕后,保证播报音语料能够完整播放。在播报音播放完毕之后,关闭显示器,使显示设备进入音箱模式。
S72、在过场倒计时开始后,将过场动画显示在显示器中,以及,调用音频输出接口播放播报音语料。
在接收到控制显示设备进入音箱模式的控制指令后,显示设备获取用于展示提示信息所需的过场动画、播报音语料和过场倒计时等信息。显示设备响应控制指令,开始进行过场倒计时的计时,同时,将过场动画展示在显示器中。过场动画中包括操作处于音箱模式下的显示设备的操作示意场景图、操作文案等信息。
为便于用户能够实时获知操作流程,可在转场成功之后同步播放播报音语料,以使得播报音语料能够完整播放,用户获知完整的提示信息可以提高操作体验。
在一些实施例中,为保证播报音语料能够完整播放,控制器在执行在过场倒计时开始后,将过场动画显示在显示器中,以及,调用音频输出接口播放播报音语料,被进一步配置为:
S721、在过场倒计时开始时,基于过场动画和过场倒计时控件,生成过场提示界面,展示在显示器中,过场倒计时控件是指基于过场倒计时生成的控件。
S722、在过场倒计时过程中,如果接收到显示设备转场结束后产生的广播,则调用音频输出接口开始播放播报音语料。
显示设备在进入音箱模式时进行转场时,为给用户展示提示信息,还可同步展示倒计时。此时,在过场倒计时开始倒计时时,同步根据过场倒计时生成过场倒计时控件,再根据过场动画和过场倒计时控件生成过场提示界面,以将过场提示界面展示在显示器中。
过场提示界面可如图23中任一副效果图所示,过场倒计时控件显示在过场动画的上层,且位于过场动画的一侧,避免对过场动画中的信息造成遮挡。
在一些实施例中,过场倒计时控件对应的时长依据系统时间的流逝而依次减少,在视觉效果上,过场提示界面中显示的时间以倒计时的形式逐渐减小。
在过场倒计时开始后,显示设备后台进行转场,为保证显示设备转场成功后能够及时播放播报音语料,显示设备可在转场成功后,发送成功广播。
在过场倒计时过程中,如果接收到显示设备本端转场结束后产生的广播,则调用音频输出接口开始播放播报音语料,此时,接收到广播的时间即为播报音语料的初始播放时间。
在一些实施例中,音频输出接口包括:本地默认播报接口和TTS播报接口。
显示设备内置TTS播报接口,以实现播报音语料的自动播报。TTS(Text To Speech,从文本到语音)是一种内置语音芯片的播报设备,TTS语音播报器能接收控制器下发的各类文字信息,自动语音方式朗读。
而该TTS功能需要依赖于网络,因此,在进行播报音语料播放时,需先检测本地系统网络是否处于连接状态,以准确地调用目标播报接口实现播报音语料的播放。
在一些实施例中,在显示设备播放播报音语料时,可根据本地系统网络状态调用不同的接口实现播放。
在本地系统网络处于连接状态时,可直接调用TTS播报接口播放播报音语料,实现自动播放。如果本地系统网络未处于连接状态,则无法调用TTS播报接口,为实现播报音语料的及时播放,可替换调用本地默认播报接口播放播报音语料。
默认播报接口为音频预置播报接口,此时,音频预置播报接口播放的播报音语料为固定音频文件,而非从播报缓存中获取的播报音语料。其中,固定音频文件也可为从本地默认缓存中获取的播报音语料。
可见,在控制显示设备进入音箱模式时,可在显示器中展示提示信息。在展示时,过场动画和过场倒计时在初始时刻进行展示;在显示设备转场成功后,开始播放播报音语料,使得播报音语料可以得到完整播放。此时,用户可以同视觉角度和听觉角度同步获知当前显示设备即将进入音箱模式,并获得操作处于音箱模式的显示设备的流程,用户体验好。
S73、在过场倒计时结束后,取消过场动画的显示,停止播放播报音语料,切换显 示器的使用状态为关屏状态,以使显示设备进入音箱模式。
在显示器中的提示信息展示完毕后,即可控制显示设备进入音箱模式。此时,即在过场倒计时结束后,显示器中取消过场动画的显示,显示设备取消音频输出接口的调用,以停止播放播报音语料,并切换显示器的使用状态为关屏状态,显示器黑屏,主机继续运行。
由于过场倒计时的时长大于或等于转场消耗时长和播报消耗时长的总时长,因此,可以保证在显示器关屏前,播报音语料可以被完整播放,用户体验好。
可见,本发明实施例提供的显示设备,在显示设备即将进入音箱模式时,可同步在显示器中展示提示信息,以告知用户当前显示设备的状态是进入音箱模式,而非关机,并提示用户可实时开屏退出音箱模式,防止显示设备不响应用户的误操作,影响用户体验。
具体实现中,本发明还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,该程序执行时可包括本发明提供的音箱模式下自动开关屏的方法的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。
本说明书中各个实施例之间相同相似的部分互相参见即可。尤其,对于音箱模式下自动开关屏的方法实施例而言,由于其基本相似于显示设备、智能终端实施例,所以描述的比较简单,相关之处参见显示设备、智能终端实施例中的说明即可。
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (10)

  1. 一种显示设备,其特征在于,包括:
    显示器,被配置为呈现用户界面;
    与所述显示器连接的控制器,所述控制器被配置为:
    响应于指定应用发送的显示器调用指令,判断所述显示设备本端是否处于音箱模式,所述指定应用是指在运行时需要将内容呈现在显示器中的应用,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式;
    在所述显示设备本端处于音箱模式时,切换所述显示器的使用状态为开屏状态,以使显示设备本端退出音箱模式,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,切换所述显示器的使用状态为关屏状态,以使显示设备本端进入音箱模式;
    在所述显示设备本端未处于音箱模式时,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,取消所述显示器中所述指定应用的内容的显示。
  2. 根据权利要求1所述的显示设备,其特征在于,所述控制器在执行所述判断显示设备本端是否处于音箱模式,被进一步配置为:
    获取本端系统属性值;
    如果所述显示设备本端系统属性值为1,则确定显示设备本端处于音箱模式;
    如果所述显示设备本端系统属性值为0,则确定显示设备本端未处于音箱模式。
  3. 根据权利要求1所述的显示设备,其特征在于,所述控制器在接收指定应用发送的显示器调用指令,被进一步配置为:
    在所述指定应用为视频通话应用时,接收对端设备在触发对端视频通话应用时发送的视频通话请求;
    响应于所述视频通话请求,启动显示设备本端视频通话应用,以及,产生显示器调用指令。
  4. 根据权利要求1所述的显示设备,其特征在于,所述控制器在执行所述将所述指定应用的内容呈现在处于开屏状态的显示器中,被进一步配置为:
    在所述指定应用为视频通话应用,以及,所述显示器处于开屏状态时,检测摄像头的运行状态,所述开屏状态用于表征本端未处于音箱模式;
    如果所述摄像头的运行状态为可调用状态,则将所述视频通话应用在运行时生成的视频通话界面展示在显示器中;
    如果所述摄像头的运行状态为不可调用状态,则生成摄像头故障提示,将所述摄像头故障提示展示在显示器中。
  5. 一种显示设备,其特征在于,包括:
    显示器,被配置为呈现用户界面;
    与所述显示器连接的控制器,所述控制器被配置为:
    响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有不同显示设备对应的设备账号;
    接收对所述视频通话列表中的一个设备账号的操作,生成视频通话请求;
    将所述视频通话请求发送至设备账号对应的对端显示设备,所述对端显示设备用于响应视频通话请求确定对端是否处于音箱模式,以切换对端显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
  6. 一种智能终端,其特征在于,包括:
    显示器,被配置为呈现用户界面;
    与所述显示器连接的控制器,所述控制器被配置为:
    响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有与所述智能终端本端进行绑定的不同显示设备;
    在基于所述视频通话列表选择目标显示设备后,触发视频通话按钮,生成视频通话请求;
    将所述视频通话请求发送至目标显示设备,所述目标显示设备用于响应视频通话请求确定是否处于音箱模式,以切换目标显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
  7. 根据权利要求6所述的智能终端,其特征在于,所述控制器被进一步配置为:
    基于所述视频通话列表选择目标显示设备后,获取本端登录账号和目标显示设备的登录账号;
    如果所述本端登录账号与目标显示设备的登录账号不一致,则基于目标显示设备的登录账号切换本端登录账号,切换后的本端账号与目标显示设备的登录账号一致。
  8. 一种设备控制方法,应用于显示设备,其特征在于,所述方法包括:
    响应于指定应用发送的显示器调用指令,判断所述显示设备本端是否处于音箱模式,所述指定应用是指在运行时需要将内容呈现在显示器中的应用,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式;
    在所述显示设备本端处于音箱模式时,切换所述显示器的使用状态为开屏状态,以使显示设备本端退出音箱模式,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,切换所述显示器的使用状态为关屏状态,以使显示设备本端进入音箱模式;
    在所述显示设备本端未处于音箱模式时,将所述指定应用的内容呈现在处于开屏状态的显示器中,以及,在所述指定应用运行结束后,取消所述显示器中所述指定应用的内容的显示。
  9. 一种设备控制方法,应用于显示设备,其特征在于,所述方法包括:
    响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表,所述视频通话列表中展示有不同显示设备对应的设备账号;
    接收对所述视频通话列表中的一个设备账号的操作,生成视频通话请求;
    将所述视频通话请求发送至设备账号对应的对端显示设备,所述对端显示设备用于响应视频通话请求确定对端是否处于音箱模式,以切换对端显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
  10. 一种设备控制方法,应用于智能终端,其特征在于,所述方法包括:
    响应于触发本端视频通话应用的启动指令,在所述显示器中展示视频通话列表, 所述视频通话列表中展示有与所述智能终端本端进行绑定的不同显示设备;
    在基于所述视频通话列表选择目标显示设备后,触发视频通话按钮,生成视频通话请求;
    将所述视频通话请求发送至目标显示设备,所述目标显示设备用于响应视频通话请求确定是否处于音箱模式,以切换目标显示器的开屏状态和关屏状态,所述音箱模式是指显示设备的控制器处于运行状态、显示器处于关屏状态的模式。
PCT/CN2021/118613 2021-03-30 2021-09-15 显示设备及设备控制方法 WO2022205793A1 (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202110340150.7A CN114302201B (zh) 2021-03-30 2021-03-30 一种音箱模式下自动开关屏的方法及智能终端、显示设备
CN202110340150.7 2021-03-30
CN202110412706.9 2021-04-16
CN202110413878.8 2021-04-16
CN202110413878.8A CN114339358A (zh) 2021-04-16 2021-04-16 一种关机选择界面的动态处理方法及显示设备
CN202110412706.9A CN114302238B (zh) 2021-04-16 2021-04-16 一种音箱模式下提示信息的展示方法及显示设备

Publications (1)

Publication Number Publication Date
WO2022205793A1 true WO2022205793A1 (zh) 2022-10-06

Family

ID=83455473

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/118613 WO2022205793A1 (zh) 2021-03-30 2021-09-15 显示设备及设备控制方法

Country Status (1)

Country Link
WO (1) WO2022205793A1 (zh)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153136A1 (en) * 2005-12-30 2007-07-05 Tatung Company LCD TV capable of being used as a music station only
KR20070076152A (ko) * 2006-01-18 2007-07-24 엘지전자 주식회사 홈 서버에서의 화상 전화 화면 보호방법
CN104581320A (zh) * 2013-10-16 2015-04-29 中兴通讯股份有限公司 一种切换播放模式的方法、装置和终端
CN105577947A (zh) * 2015-12-18 2016-05-11 联想(北京)有限公司 控制方法及电子设备
CN105635625A (zh) * 2014-10-31 2016-06-01 腾讯科技(深圳)有限公司 视频通话方法和装置
CN105812954A (zh) * 2014-12-30 2016-07-27 乐视致新电子科技(天津)有限公司 一种基于关屏的播放方法及装置
CN106101600A (zh) * 2016-07-27 2016-11-09 北京小米移动软件有限公司 视频通话的连接方法及装置
CN108551588A (zh) * 2018-05-17 2018-09-18 四川长虹电器股份有限公司 一种电视待机实现智能音箱的装置和方法
CN108566589A (zh) * 2018-04-26 2018-09-21 京东方科技集团股份有限公司 控制显示装置的方法、显示装置、电子设备及存储介质
CN111741372A (zh) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 一种视频通话的投屏方法、显示设备及终端设备
CN112261339A (zh) * 2020-10-15 2021-01-22 Oppo广东移动通信有限公司 视频通信方法、装置、电子设备和计算机可读存储介质
CN112543447A (zh) * 2019-09-19 2021-03-23 华为技术有限公司 基于通讯录的设备发现方法、音视频通信方法及电子设备

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153136A1 (en) * 2005-12-30 2007-07-05 Tatung Company LCD TV capable of being used as a music station only
KR20070076152A (ko) * 2006-01-18 2007-07-24 엘지전자 주식회사 홈 서버에서의 화상 전화 화면 보호방법
CN104581320A (zh) * 2013-10-16 2015-04-29 中兴通讯股份有限公司 一种切换播放模式的方法、装置和终端
CN105635625A (zh) * 2014-10-31 2016-06-01 腾讯科技(深圳)有限公司 视频通话方法和装置
CN105812954A (zh) * 2014-12-30 2016-07-27 乐视致新电子科技(天津)有限公司 一种基于关屏的播放方法及装置
CN105577947A (zh) * 2015-12-18 2016-05-11 联想(北京)有限公司 控制方法及电子设备
CN106101600A (zh) * 2016-07-27 2016-11-09 北京小米移动软件有限公司 视频通话的连接方法及装置
CN108566589A (zh) * 2018-04-26 2018-09-21 京东方科技集团股份有限公司 控制显示装置的方法、显示装置、电子设备及存储介质
CN108551588A (zh) * 2018-05-17 2018-09-18 四川长虹电器股份有限公司 一种电视待机实现智能音箱的装置和方法
CN112543447A (zh) * 2019-09-19 2021-03-23 华为技术有限公司 基于通讯录的设备发现方法、音视频通信方法及电子设备
CN111741372A (zh) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 一种视频通话的投屏方法、显示设备及终端设备
CN112261339A (zh) * 2020-10-15 2021-01-22 Oppo广东移动通信有限公司 视频通信方法、装置、电子设备和计算机可读存储介质

Similar Documents

Publication Publication Date Title
CN110022495B (zh) 一种移动终端向显示设备推送媒体文件的方法及显示设备
CN114302219B (zh) 一种显示设备及可变帧率显示方法
CN114302201B (zh) 一种音箱模式下自动开关屏的方法及智能终端、显示设备
CN114302238B (zh) 一种音箱模式下提示信息的展示方法及显示设备
WO2023077991A1 (zh) 显示设备及其显示方法
WO2022048203A1 (zh) 一种输入法控件的操控提示信息的显示方法及显示设备
WO2022105417A1 (zh) 显示设备及设备控制方法
CN112437334A (zh) 一种显示设备
CN113781957B (zh) 防止显示设备烧屏的方法及显示设备
WO2022028060A1 (zh) 一种显示设备及显示方法
CN113064645B (zh) 一种开机界面控制方法及显示设备
WO2022057322A1 (zh) 一种显示方法及显示设备
CN111866498B (zh) 一种摄像头异常处理方法及显示设备
WO2021184575A1 (zh) 显示设备和显示方法
WO2022205793A1 (zh) 显示设备及设备控制方法
CN113542878B (zh) 一种基于人脸识别与手势检测的唤醒方法及显示设备
CN114296679A (zh) 一种音箱模式下快速起播的方法及显示设备
CN114007119A (zh) 视频播放方法及显示设备
CN114286320A (zh) 一种显示设备、移动终端及蓝牙连接方法
CN114339359B (zh) 一种局部亮屏模式下防烧屏的方法及显示设备
WO2022001595A1 (zh) 显示设备
WO2023130967A1 (zh) 一种节目数据处理方法及显示设备
WO2022193732A1 (zh) 一种音频输出通道的切换控制方法及显示设备
US20240022780A1 (en) Display method and display device
CN113709557B (zh) 一种音频输出的控制方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21934430

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21934430

Country of ref document: EP

Kind code of ref document: A1