WO2021088326A1 - Display device and incoming call display method - Google Patents

Display device and incoming call display method Download PDF

Info

Publication number
WO2021088326A1
WO2021088326A1 PCT/CN2020/086461 CN2020086461W WO2021088326A1 WO 2021088326 A1 WO2021088326 A1 WO 2021088326A1 CN 2020086461 W CN2020086461 W CN 2020086461W WO 2021088326 A1 WO2021088326 A1 WO 2021088326A1
Authority
WO
WIPO (PCT)
Prior art keywords
controller
screen
display
user
video
Prior art date
Application number
PCT/CN2020/086461
Other languages
French (fr)
Chinese (zh)
Inventor
王学磊
丁佳一
穆聪聪
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2021088326A1 publication Critical patent/WO2021088326A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the embodiments of the present application relate to smart display device technology, and in particular, to a display device and a caller ID display method.
  • smart TVs based on the Internet have emerged.
  • smart TVs Based on Internet technology, smart TVs have an open operating system and chips, and an open application platform that can support multiple functions such as audio and video, entertainment, and data, so as to meet the diverse needs of users and bring users a brand-new experience.
  • smart TVs can support voice interaction, and users can control smart TVs through voice.
  • a smart TV includes a display.
  • the information that the smart TV needs to display to the user is displayed on the screen.
  • a boot animation will be played, and pictures of the boot animation are displayed on one display.
  • the embodiment of the present application provides a dual-screen display device and a caller ID display method.
  • the technical solution is as follows.
  • an embodiment of the present application provides a display device including: a first display screen, a second display screen, and a controller.
  • the controller is configured to: when the first display screen displays a video screen, receive an incoming call request, and display an incoming call reminder screen on the second display screen
  • an embodiment of the present application also provides a caller ID display method, including:
  • the controller receives the call request when the first display screen displays the video picture
  • the controller In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen.
  • An embodiment of the present application also provides a computing device, including:
  • Memory used to store program instructions
  • the processor is configured to call the program instructions stored in the memory, and execute the method described in the second aspect above according to the obtained program.
  • the controller when the first display screen is playing a video screen, the controller receives an incoming call request, and then displays an incoming call reminder screen on the second display screen, so that the first display screen is The displayed video screen is not blocked, which greatly improves the user experience.
  • FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device provided in an exemplary embodiment of this application;
  • FIG. 2 is a configuration block diagram of a control device 100 provided in an exemplary embodiment of this application;
  • FIG. 3a is a schematic diagram of the hardware structure of a hardware system in a display device 200 provided in an exemplary embodiment of this application;
  • 3b is a schematic diagram of the hardware structure of a hardware system in another display device 200 provided in an exemplary embodiment of this application;
  • FIG. 4 is a schematic diagram of the connection relationship between the power supply board and the load in the display device 200 provided in an exemplary embodiment of this application;
  • FIG. 5 is a block diagram of the hardware architecture of the display device 200 shown in FIG. 3 in an exemplary embodiment of this application;
  • FIG. 6 is a schematic diagram of a functional configuration of a display device provided in an exemplary embodiment of this application.
  • FIG. 7 is a configuration block diagram of a software system in a display device 200 provided in an exemplary embodiment of this application;
  • FIG. 8 is a schematic diagram of an application layer of a display device provided in an exemplary embodiment of this application.
  • FIG. 9 is a schematic diagram of a user interface in a display device 200 provided in an exemplary embodiment of this application.
  • 10-12 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • FIG. 13-15 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • Figure 16 is a schematic diagram of the interaction process between the first controller and the second controller
  • FIG. 17 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • FIG. 18 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • Figure 19 is a schematic diagram of the interaction process between the first controller and the second controller
  • FIG. 20 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • FIG. 21 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment
  • FIG. 22 is a schematic flowchart of a caller ID method provided by an embodiment of this application.
  • This application is mainly directed to a display device with a dual-system and dual-display structure, that is, a display device with a first controller (a first hardware system), a second controller (a second hardware system), a first display screen, and a second display screen.
  • a display device with a dual-system and dual-display structure that is, a display device with a first controller (a first hardware system), a second controller (a second hardware system), a first display screen, and a second display screen.
  • various external device interfaces are usually provided on the display device to facilitate the connection of different peripheral devices or cables to achieve corresponding functions.
  • a high-resolution camera When a high-resolution camera is connected to the interface of the display device, if the hardware system of the display device does not have the hardware interface of the high-pixel camera that receives the source code, it will cause the data received by the camera to be unable to present the data received by the camera to the display of the display device. On the screen.
  • the hardware system of traditional display devices only supports one hard decoding resource, and usually only supports 4K resolution video decoding. Therefore, when you want to realize the video chat while watching Internet TV, in order not to reduce
  • the definition of the network video picture requires the use of hard decoding resources (usually the GPU in the hardware system) to decode the network video.
  • the general-purpose processor such as CPU
  • the video chat screen is processed by soft decoding.
  • Using soft decoding to process the video chat screen will greatly increase the data processing burden on the CPU.
  • the data processing burden on the CPU is too heavy, the picture may freeze or become unsmooth.
  • the CPU soft decoding is used to process the video chat screen, it is usually impossible to achieve multi-channel video calls.
  • the user wants to simultaneously video chat with multiple other users in the same chat scene At times, access will be blocked.
  • this application discloses a dual hardware system architecture to implement multiple channels of video chat data (at least one local video).
  • module used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can execute related components Function.
  • remote control used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance.
  • This component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors.
  • RF radio frequency
  • a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hardware in a general remote control device.
  • gesture used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • the term "hardware system” used in the various embodiments of this application may refer to an integrated circuit (IC), printed circuit board (Printed circuit board, PCB) and other mechanical, optical, electrical, and magnetic devices with computing , Control, storage, input and output functions of the physical components.
  • the hardware system is usually also referred to as a motherboard or a chip.
  • Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.
  • the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods for wireless or other short-distance communication.
  • the display device 200 is controlled in a wired manner.
  • the user can control the display device 200 by inputting user instructions through keys, voice input, control panel input, etc. on the remote controller 100A.
  • the user can control the display device by inputting corresponding control commands through the volume up and down keys on the remote control 100A, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch machine keys, etc. 200 features.
  • the control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which may be connected through a local area network (LAN, Wide Area Network), a wide area network (WAN, Wide Area Network), and a wireless local area network (WLAN, Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200.
  • LAN Local area network
  • WAN Wide Area Network
  • WLAN Wireless Local Area Network
  • the application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.
  • UI User Interface
  • both the mobile terminal 100B and the display device 200 can be installed with software applications, so that the connection and communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be realized.
  • the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and control the user interface of the mobile terminal 100B to achieve the function of controlling the display device 200; or the mobile terminal 100B The audio and video content displayed on the screen is transmitted to the display device 200 to realize the synchronous display function.
  • the display device 200 can also communicate with the server 300 through multiple communication methods.
  • the display device 200 may be allowed to perform a wired communication connection or a wireless communication connection with the server 300 through a local area network, a wireless local area network, or other networks.
  • the server 300 may provide various contents and interactions to the display device 200.
  • the display device 200 transmits and receives information, interacts with an Electronic Program Guide (EPG, Electronic Program Guide), receives software program updates, or accesses a remotely stored digital media library.
  • EPG Electronic Program Guide
  • the server 300 may be a group or multiple groups, and may be one or more types of servers.
  • the server 300 provides other network service content such as video-on-demand and advertising services.
  • the display device 200 includes a first display screen 201 and a second display screen 202, wherein the first display screen 201 and the second display screen 202 are independent of each other, and the first display screen 201 and the second display screen 202 adopt dual hardware Control System.
  • the first display screen 201 and the second display screen 202 can be used to display different display pictures.
  • the first display screen 201 can be used for screen display of traditional television programs
  • the second display screen 202 can be used for screen display of auxiliary information such as notification messages and voice assistants.
  • the content displayed on the first display screen 201 and the content displayed on the second display screen 202 may be independent of each other without affecting each other.
  • the second display screen 202 may display information such as time, weather, temperature, and reminder messages that are not related to the TV program.
  • the second display screen 202 may display information such as the avatar and the chat duration of the user currently accessing the video chat.
  • part or all of the content displayed on the second display screen 202 can be adjusted to be displayed on the first display screen 201.
  • the time, weather, temperature, reminder message and other information displayed on the first display screen 201 can be adjusted to be displayed on the first display screen 201, and the second display screen 202 can be used to display other information.
  • the first display screen 201 displays a multi-party interactive screen while displaying a traditional TV program screen, and the multi-party interactive screen does not block the traditional TV program screen.
  • the present application does not limit the display mode of the traditional TV program screen and the multi-party interactive screen.
  • this application can set the position and size of the traditional TV program screen and the multi-party interactive screen according to the priority of the traditional TV program screen and the multi-party interactive screen.
  • the area of traditional TV program screens is larger than that of multi-party interactive screens, and the multi-party interactive screens can be located on one side of the traditional TV program screen or can be set floating In the corner of the multi-party interactive screen.
  • the display device 200 may be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or a projection display device; on the other hand, the display device may be a smart TV or a display system composed of a display and a set-top box.
  • OLED Organic Light Emitting Diode
  • the display device 200 may make some changes in performance and configuration as required.
  • the display device 200 may additionally provide a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and so on. In some embodiments, the display device may not have the function of broadcasting and receiving TV.
  • a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and so on.
  • IPTV Internet Protocol TV
  • the display device may not have the function of broadcasting and receiving TV.
  • a camera may be connected or provided on the display device 200 for presenting a picture captured by the camera on the display interface of the display device or other display devices, so as to realize interactive chats between users.
  • the image captured by the camera can be displayed on the display device in full screen, half screen, or in any selectable area.
  • the camera is connected to the rear shell of the display device through a connecting plate, and is fixedly installed on the upper middle of the rear shell of the display device.
  • it can be fixedly installed on the rear of the display device. Any position of the shell can ensure that the image capture area is not blocked by the rear shell. For example, the image capture area and the display device have the same orientation.
  • the camera can be connected to the rear shell of the display device through a connecting plate or other conceivable connectors.
  • a lifting motor is installed on the connector.
  • the camera used in this application may have 16 million pixels to achieve the purpose of ultra-high-definition display. In actual use, a camera with higher or lower than 16 million pixels can also be used.
  • the content displayed in different application scenarios of the display device can be merged in a variety of different ways, so as to achieve functions that cannot be achieved by traditional display devices.
  • the user can video chat with at least one other user while watching a video program.
  • the presentation of the video program can be used as the background screen, and the video chat window is displayed on the background screen.
  • At least one video chat is performed across terminals.
  • the user can video chat with at least one other user while entering the education application for learning.
  • students can realize remote interaction with teachers while learning content in educational applications. Visually, you can call this function "learning and chatting”.
  • a video chat is conducted with players entering the game.
  • players entering the game.
  • a player enters a game application to participate in a game, it can realize remote interaction with other players. Visually, you can call this function "watch and play".
  • the game scene and the video image are merged, and the portrait in the video image is cut out and displayed on the game image, which improves the user experience.
  • somatosensory games such as ball games, boxing games, running games, dancing games, etc.
  • human body postures and movements are acquired through a camera, limb detection and tracking, and key point data detection of human bones.
  • Animations are integrated in the game to realize games such as sports, dance and other scenes.
  • the user can interact with at least one other user in video and voice in the K song application. Visually, you can call this function "watch and sing".
  • this function "watch and sing".
  • multiple users can jointly complete the recording of a song.
  • the user can turn on the camera locally to obtain pictures and videos, which is vivid, and this function can be called "look in the mirror".
  • Fig. 2 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment.
  • the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.
  • the control device 100 is configured to control the display device 200, and can receive user input operation instructions, and convert the operation instructions into instructions that can be recognized and responded to by the display device 200, acting as an intermediary for the interaction between the user and the display device 200 effect.
  • the user operates the channel plus and minus key on the control device 100, and the display device 200 responds to the channel plus and minus operation.
  • control device 100 may be a smart device.
  • control device 100 can install various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing an application for controlling the display device 200.
  • the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other smart electronic devices by installing applications to realize the function of the physical keys of the control device 100.
  • the controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus.
  • the controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.
  • the communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200.
  • the communicator 130 may include at least one of communication modules such as a WIFI module 131, a Bluetooth module 132, and an NFC module 133.
  • the user input/output interface 140 where the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, a button 144, and a camera 145.
  • input interfaces such as a microphone 141, a touch panel 142, a sensor 143, a button 144, and a camera 145.
  • the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions.
  • the input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding instruction signal, and sends it to the display device 200.
  • the output interface includes an interface for sending the received user instruction to the display device 200.
  • it may be an infrared interface or a radio frequency interface.
  • the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module.
  • a radio frequency signal interface a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
  • control device 100 includes at least one of a communicator 130 and an output interface.
  • the control device 100 is equipped with a communicator 130, such as WIFI, Bluetooth, NFC and other modules, which can encode the user input command through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.
  • a communicator 130 such as WIFI, Bluetooth, NFC and other modules, which can encode the user input command through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.
  • the memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110.
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for the electrical components of the control device 100 under the control of the controller 110.
  • the power supply 180 can be powered by a battery and related control circuits.
  • FIG. 3a exemplarily shows a schematic diagram of the hardware structure of the hardware system in the display device 200 according to the exemplary embodiment.
  • the display device 200 in FIG. 3a uses a liquid crystal display as an example for illustration.
  • the display device 200 may include: a first panel 11, a first backlight assembly 12, a first rear case 13, a first controller 14, a second controller 15, a first display driving circuit 16, and a second panel 21.
  • the display device 200 may further include a base or a suspension bracket.
  • the display device 200 in FIG. 3a includes a base 41 for illustration, and the base 41 is used to support the display device 200. It is worth noting that only one form of base design is shown in the figure, and those skilled in the art can design different forms of bases according to product requirements.
  • the first panel 11 is used to present a picture of the first display screen 201 to the user.
  • the first panel 11 may be a liquid crystal panel.
  • a liquid crystal panel may include, from top to bottom, a horizontal polarizer, a color filter, a liquid crystal layer, a thin film transistor TFT, a vertical polarizer, a light guide plate, and a printed circuit board (PCB).
  • the printed circuit board Drive circuits such as a gate drive circuit and a source drive circuit are arranged on the PCB.
  • the gate driving circuit is connected to the gate of the thin film transistor TFT through a scan line
  • the source driving circuit is connected to the drain of the thin film transistor TFT through a data line.
  • the first backlight assembly 12 is located under the first panel 11, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the first panel 11 can display images normally.
  • the first backlight assembly 12 also includes a first back plate (not shown in the figure).
  • the first rear case 13 is covered on the first panel 11 to jointly hide the display devices such as the first backlight assembly 12, the first controller 14, the second controller 15, the first display driving circuit 16, the power supply assembly 30, etc. 200 parts, play a beautiful effect.
  • the first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are arranged on the first backplane, and some convex hull structures are usually stamped on the first backplane.
  • the first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are fixed on the convex hull by screws or hooks.
  • the first controller 14, the second controller 15, the first display driving circuit 16, and the power supply assembly 30 may be arranged on one board together, or may be arranged on different boards, such as the first controller. 14 is set on the main board, the second controller 15 is set on the interactive board, the first display drive circuit 16 is set on the first display drive board, and the power supply assembly 30 is set on the power supply board. It can also be combined on different boards. , It can also be set on a board together with the first backlight assembly 12, which can be set according to actual needs, which is not limited in this application.
  • the first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are all provided on one board in FIG. 3a for illustration.
  • the main function of the first display driving circuit 16 is to perform a thousand-level backlight partition control through the backlight driving signal transmitted by the first controller 14, such as a PWM signal and a local dimming signal. This part of the control is changed according to the image content. And after the handshake is established with the first controller 14, the VbyOne display signal sent by the first controller 14 is received, and the VbyOne display signal is converted into an LVDS signal to realize the image display of the first display screen 201.
  • the second panel 21 is used to present the screen of the second display screen 202 to the user.
  • the second panel 21 may be a liquid crystal panel, and the specific structure included can refer to the description of the foregoing content, which will not be repeated here.
  • the second backlight assembly 22 is located below the second panel 12, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the second panel 12 can display images normally.
  • the second backlight assembly 22 also includes a second back plate (not shown in the figure).
  • the second rear case 23 is covered on the second panel 21 to jointly hide the components of the display device 200 such as the second backlight assembly 22 and the second display driving circuit 24, which has a beautiful effect.
  • the second display driving circuit 24 is disposed on the second backplane, and some convex hull structures are usually stamped on the second backplane.
  • the second display driving circuit 24 is fixed on the convex hull by screws or hooks.
  • the second display driving circuit 24 can be separately arranged on a board, such as a second display driving board, or it can be arranged on the same board together with the second backlight assembly 22, which can be set according to actual needs. This application does not Make a limit.
  • the second display driving circuit 24 is separately provided on a board in FIG. 3a for illustration.
  • FIG. 3a also includes a key pad.
  • the key pad can be provided on the first backplane or the second backplane, which is not limited in this application.
  • a plurality of buttons and button circuits are provided on the button board, so that the first controller 14 or the second controller 15 can receive the button signal from the button board, and the first controller 14 or the second controller 15 can also send the button to the button.
  • the board sends control signals.
  • the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction.
  • an audio component such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction.
  • AMP power amplifier
  • Speaker speaker
  • audio components can achieve sound output of at least two channels; when the panoramic sound surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.
  • the display device 200 can also be an OLED display.
  • the template included in the display device 200 is changed accordingly.
  • the OLED display can realize self-luminescence, the OLED display does not require a backlight assembly ( Figure 3a)
  • the first backlight assembly 12 and the second backlight assembly 22) are not detailed here.
  • FIG. 3a a display device with dual display screens is taken as an exemplary illustration
  • FIG. 3b exemplarily shows a schematic diagram of the hardware structure of a hardware system in the display device according to an exemplary embodiment.
  • the display device includes: a panel 1, a backlight assembly 2, a rear housing 3, a controller 4, a power supply assembly 5, and a base 6.
  • the panel 1 is used to present images to the user;
  • the backlight assembly 2 is located under the panel 1, usually some optical components, used to supply sufficient brightness and uniformly distributed light sources, so that the panel 1 can display image content normally, and the backlight assembly 2 It also includes a backplane.
  • the controller 4 and the power supply assembly 5 are arranged on the backplane, and some convex structures are usually stamped on the backplane.
  • the controller 4 and the power supply assembly 5 are fixed on the convex hull by screws or hooks; the rear shell 3
  • the cover is arranged on the panel 1 to jointly hide the backlight assembly 2, the controller 4 and the power supply assembly 5 and other display device components, which has a beautiful effect; the base 6 is used to support the display device.
  • the controller 4 and the power supply assembly 5 can be separately arranged on a board, can also be arranged on the same board together, or can be arranged on the same board together with the backlight assembly, which can be set according to actual needs. Not limited.
  • the controller 4 and the power supply assembly 5 are jointly arranged on a board.
  • the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction.
  • an audio component such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction.
  • AMP power amplifier
  • Speaker speaker
  • audio components can achieve sound output of at least two channels; when the panoramic sound surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.
  • the display device 200 may also adopt an OLED display screen.
  • the template included in the display device 200 will be changed accordingly, and no further description will be given here.
  • FIG. 4 shows a schematic diagram of the connection relationship between the power board and the load.
  • the power supply assembly 30 includes an input terminal IN and an output terminal OUT (the figure shows the first output terminal OUT1, the second output terminal OUT2, and the third output terminal OUT2.
  • the output terminal OUT3, the fourth output terminal OUT4 and the fifth output terminal OUT5) wherein the input terminal IN is connected to an alternating current power supply AC (such as mains), and the output terminal OUT is connected to a load, for example, the first output terminal OUT1 and sound reproduction
  • the device is connected, the second output terminal OUT2 is connected to the first panel 11/the second panel 21, the third output terminal OUT3 is connected to the first backlight assembly 12/the second backlight assembly 22, and the fourth output terminal OUT4 is connected to the first controller 14.
  • /The second controller 15 is connected, and the fifth output terminal OUT5 is connected to the first display driving circuit 16/the second display driving circuit 24.
  • the power supply assembly 30 needs to convert AC mains power into DC power required by the load, and the DC power usually has different specifications, for example, the audio component requires 18V, the first controller 14 requires 12V/18V, and so on.
  • first hardware system one hardware system in the dual hardware system architecture
  • second hardware system the second controller
  • the first controller includes various processors of the first controller, various interfaces, and various modules connected to the first controller through various interfaces
  • the second controller includes various processors of the second controller , Various interfaces, and various modules connected to the second controller through various interfaces.
  • a relatively independent operating system may be installed in the first controller and the second controller, and the operating system of the first controller and the operating system of the second controller may communicate with each other through a communication protocol, for example: the first controller
  • the framework layer of the operating system of the second controller and the framework layer of the operating system of the second controller can communicate for command and data transmission, so that there are two independent but interrelated subsystems in the display device 200.
  • FIG. 5 is only an exemplary description of the dual hardware system architecture of the present application, and does not represent a limitation to the present application. In practical applications, both hardware systems can contain more or less hardware or interfaces as required.
  • FIG. 5 exemplarily shows a block diagram of the hardware architecture of the display device 200 shown in FIG. 3.
  • the hardware system of the display device 200 includes a first controller 210 and a second controller 310, and modules connected to the first controller 210 or the second controller 310 through various interfaces.
  • the second controller 310 may be used to receive instructions sent by the first controller 210 and control the second display screen 380 to display corresponding images.
  • the modules connected to the first controller 210 may include a tuner and demodulator 220, a communicator 230, an external device interface 25, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2,
  • the first display screen 280 (that is, the first display screen 201 in FIG. 1 ), the audio output interface 270, and the power supply module 240.
  • the first controller 210 may also be connected with more or fewer modules.
  • the tuner and demodulator 220 is used to perform modulation and demodulation processing such as amplification, mixing, and resonance on the broadcast and television signals received through wired or wireless methods, so as to demodulate the user’s information from multiple wireless or cable broadcast and television signals. Select the audio and video signals carried in the frequency of the TV channel, as well as additional information (such as EPG data signals).
  • the signal path of the tuner and demodulator 220 can have many kinds, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and according to different modulation types, the signal adjustment method can be digitally modulated The method may also be an analog modulation method; and according to different types of received television signals, the tuner demodulator 220 may demodulate analog signals and/or digital signals.
  • the tuner and demodulator 220 is also used to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency according to the user's selection and control by the first controller 210.
  • the tuner demodulator 220 may also be in an external device, such as an external set-top box.
  • the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the external device interface 250.
  • the communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules (not shown in the figure).
  • the display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230.
  • the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.
  • the external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices.
  • the external device interface 250 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG) and other data.
  • the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal is also called HDMI 251, a composite video blanking synchronization (CVBS) terminal is also called AV 252, and an analog or digital component terminal is also called component 253. , Any one or more of universal serial bus (USB) terminals 254, red, green and blue (RGB) terminals (not shown in the figure), etc. This application does not limit the number and types of external device interfaces.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • AV 253 an analog or digital component terminal
  • USB universal serial bus
  • RGB red, green and blue
  • the first controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and/or various application programs) stored on the memory 290.
  • various software control programs such as an operating system and/or various application programs
  • the first controller 210 includes a read-only memory RAM 213, a random access memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus.
  • the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.
  • the graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to the display attributes. It also includes a renderer, which generates various objects obtained based on the arithmetic unit, and displays the result of the rendering on the first display screen 280.
  • the CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various application programs, data and content, so as to finally display and play various audio and video content.
  • the CPU processor 212 may include multiple processors.
  • the multiple processors may include one main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode.
  • the communication interface 218 may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
  • the first controller 210 may control operations of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display screen 280, the first controller 210 may perform an operation related to the object selected by the user command.
  • the first controller 210 may control the operation of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display screen 380, the first controller 210 may perform an operation related to the object selected by the user command.
  • the object may be any one of the selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon.
  • the user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 290 includes storing various software modules used to drive and control the display device 200.
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure).
  • the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion, analysis and management.
  • the voice recognition module includes a voice analysis module and a voice command database module.
  • the display control module is a module for controlling the first display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces.
  • the communication module is a module used for control and data communication with external devices.
  • the browser module is a module used to perform data communication between browsing servers.
  • the service module is a module used to provide various services and various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.
  • the user input interface 260-3 is used to send a user's input signal to the first controller 210, or to transmit a signal output from the first controller 210 to the user.
  • the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the input signal to the user input interface 260-3.
  • the first controller 210; or, the control device may receive output signals such as audio, video, or data output from the user input interface 260-3 processed by the first controller 210, and display the received output signal or output the received output signal It is in the form of audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the first display screen 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 recognizes the sound or gesture through a sensor to receive the user input command.
  • the video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal is directly displayed or played on the first display screen 280.
  • the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).
  • the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator with the zoomed video image according to user input or by itself, so as to generate an image signal for display.
  • the frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source
  • the video stream is related, and the output frame rate can be related to the refresh rate of the display device.
  • the display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format of the display device, for example, format the signal output by the frame rate conversion module to output RGB data signals.
  • the first display screen 280 is used to receive the image signal input from the video processor 260-1, display video content and images, and the menu control interface.
  • the first display screen 280 includes a display screen component for presenting images and driving image display Drive components.
  • the displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the interface of an external device.
  • the first display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
  • the first display screen 280 also includes a driving component for driving the display.
  • the first display screen 280 is a projection display screen, it may also include a projection device and a projection screen.
  • the audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be played in the speaker 272 Audio signal.
  • the audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210.
  • the audio output interface may include a speaker 272, or output to an external audio output terminal 274 of a generator of an external device , Such as: external audio terminal or headphone output terminal, etc.
  • the video processor 260-1 may include one or more chips.
  • the audio processor 260-2 may also include one or more chips.
  • the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the first controller 210 in one or more chips.
  • the power supply module 240 is configured to provide power supply support for the display device 200 with power input from an external power supply under the control of the first controller 210.
  • the power supply module 240 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
  • the modules connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, and a second display screen 380 (that is, the second display in FIG. 1 Display 202). In some embodiments, it may also include a user input interface, a video processor, an audio processor, a display screen, and an audio output interface (not shown in the figure). In some embodiments, there may also be a power supply module (not shown in the figure) that independently supplies power to the second controller 310.
  • the communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules (not shown in the figure).
  • the communicator 330 and the communicator 230 of the first controller 210 also interact with each other.
  • the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network, and to generate network communication with an external server or the like.
  • the WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without direct connection with the external network, etc., and the second controller 310 connects to the external network through the first controller 210 . Therefore, for the user, a display device as in the above embodiment may display a WiFi account to the outside.
  • the detector 340 is a component used by the second controller 310 to collect signals from the external environment or interact with the outside.
  • the detector 340 may include a light receiver 342, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 341, such as a camera, a camera, etc., which can be used to collect external
  • the environment scene, as well as the user's attributes or gestures used to interact with the user can adaptively change the display parameters, and can also recognize the user's gestures to achieve the function of interaction with the user.
  • the external device interface 350 provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices.
  • the external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc., in a wired/wireless manner.
  • the video processor 360 is used to process related video signals.
  • the second controller 310 controls the work of the display device 200 and responds to the user by running various software control programs (such as installed third-party applications, etc.) stored on the memory 390 and interacting with the first controller 210. Operation.
  • software control programs such as installed third-party applications, etc.
  • the second controller 310 includes a read-only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus.
  • the ROM 313 and the RAM 314, the graphics processor 316, the CPU processor 312, and the communication interface 318 are connected by a bus.
  • the CPU processor 312 runs the system startup instruction in the ROM, and copies the operating system stored in the memory 390 to the RAM 314 to start the operating system. After the operating system is started, the CPU processor 312 copies the various application programs in the memory 390 to the RAM 314, and then starts to run and start the various application programs.
  • the CPU processor 312 is used to execute operating system and application instructions stored in the memory 390, communicate with the first controller 210, transmit and interact with signals, data, instructions, etc., and receive various interactive instructions from external inputs. , To execute a variety of applications, data and content, in order to finally display and play a variety of audio and video content.
  • the second controller 310 may control operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display screen 380, the second controller 310 may perform an operation related to the object selected by the user command.
  • the second controller 310 may control the operation of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display screen 280, the first controller 210 may perform an operation related to the object selected by the user command.
  • the graphics processor 316 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to the display attributes. It also includes a renderer, which generates various objects obtained based on the arithmetic unit, and displays the result of the rendering on the second display screen 380.
  • Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphics objects. Differentily, if application 1 is installed in the second controller 310 and application 2 is installed in the first controller 210, when the user is on the interface of application 1, and the user inputs instructions in the application 1, the second controller The graphics processor 316 of 310 generates graphics objects. When the user is on the interface of the application 2 and performs the user-input instruction in the application 2, the graphics processor 216 of the first controller 210 generates a graphic object.
  • Fig. 6 exemplarily shows a schematic diagram of a functional configuration of a display device according to an exemplary embodiment.
  • the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are respectively used to store an operating system, application programs, content, and user data. Under the control of 210, the system operation of driving the first display screen 280 and the second display screen 380 and responding to various operations of the user are executed.
  • the memory 390 and the memory 290 may include volatile and/or non-volatile memory.
  • the memory 290 is specifically used to store the operating program that drives the first controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and application related programs. A variety of graphical user interfaces, and various objects related to the graphical user interface, user data information, and various internal data supporting applications.
  • the memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
  • OS operating system
  • the memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the first display screen 280, the communicator 230, the tuner and demodulator 220, and the input/output interface.
  • the memory 290 may store software and/or programs.
  • the software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs.
  • OS operating system
  • the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , In order to achieve control or management of system resources.
  • the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command recognition module 2907, a communication control module 2908, The light receiving module 2909, the power control module 2910, the operating system 2911, and other application programs 2912, the browser module 2913, and so on.
  • the first controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.
  • various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.
  • the memory 390 includes storing various software modules used to drive and control the display device 200.
  • various software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are relatively similar, please refer to the memory 290 for related parts, which will not be repeated here.
  • the memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, an optical receiving module 3909, an operating system 3911, and other application programs 3912, a browser module 3913, etc. .
  • the first controller 210 executes various software programs in the memory 290 such as: image control function, display control function, audio control function, external command recognition function, communication control function, light signal receiving function, power control function, support Various functions such as software control platform and browser functions.
  • the external command recognition module 2907 of the first controller 210 and the external command recognition module 3907 of the second controller 310 can recognize different commands.
  • the external command recognition module 3907 of the second controller 310 may include a graphic recognition module 2907-1, and the graphic recognition module 3907-1 stores a graphic database.
  • the camera receives the graphics instruction from the outside world, it will correspond to the instruction in the graphics database to control the display device.
  • the voice receiving device and the remote controller are connected to the first controller 210
  • the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2, and the voice recognition module 2907-2 stores a voice database.
  • the voice receiving device or the like receives a voice instruction from the outside world, it corresponds to the instruction in the voice database to control the display device.
  • the control device 100 such as a remote controller is connected to the first controller 210, and the key instruction recognition module 2907-3 interacts with the control device 100 in instructions.
  • FIG. 7 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.
  • the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as an application program and completing data processing between hardware components Medium.
  • part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.
  • part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device.
  • the drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.
  • the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.
  • the communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.
  • the user interface module 2911-3 is used to provide objects that display user interfaces for access by various applications, and can realize user operability.
  • the control application 2911-4 is used to control process management, including runtime applications.
  • the event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.
  • the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
  • the event recognition module 2914-2 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute their corresponding one or more sets of processing procedures .
  • the event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.).
  • an external control device such as the control device 100, etc.
  • various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices include multiple forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key.
  • non-physical keys such as moving, pressing, and releasing.
  • the interface layout management module 2913 which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container
  • the size, position, level, etc. of the interface are related to the various execution operations of the interface layout.
  • the application layer of the display device includes various application programs that can be executed on the display device 200.
  • the application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications, such as: video-on-demand application, application center, game application, and so on.
  • the application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications, such as a live TV application, a media center application, and so on. It should be noted that the application programs included in the second controller 310 and the first controller 210 are determined according to the operating system and other designs. This application does not need to determine the application programs included in the second controller 310 and the first controller 210.
  • the application program is specifically defined and divided.
  • Live TV applications can provide live TV through different sources.
  • a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services.
  • the live TV application can display the video of the live TV signal on the display device 200.
  • Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.
  • Media center applications can provide various multimedia content playback applications.
  • the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.
  • Application center can provide storage of various applications.
  • the application program can be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device.
  • the application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.
  • both the second controller 310 and the first controller 210 may be respectively installed with independent operating systems, there are two independent but related sub-systems in the display device 200.
  • both the second controller 310 and the first controller 210 can be independently installed with Android (Android) and various APPs, both of which can realize certain functions, and the second controller 310 and the first controller 210 can cooperate to realize certain functions. Item function.
  • FIG. 9 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment.
  • the user interface includes a first view display area 2011 and a second view display area 2021.
  • the functions of the first view display area 2011 and the second view display area 2021 are basically the same. The following only focuses on the first view display area 2011.
  • the first view display area 2011 includes one or more different items in the layout.
  • the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.
  • the first view display area 2011 is a zoomable view display.
  • Scalable may indicate that the size or proportion of the first view display area 2011 on the screen is scalable, or that the size or proportion of the items in the view display 201 on the screen is scalable.
  • Items refer to visual objects displayed in the view display area of the user interface in the display device 200 to represent corresponding content such as icons, thumbnails, and video clips.
  • an item can represent image content or video clips of movies, TV series, audio content of music, applications, or other user access content history information.
  • the item may indicate an interface or a set display of interfaces connected to the display device 200 and an external device, or may indicate the name of an external device connected to the display device, or the like.
  • the view display area can present the content of the video chat project or the content of the application layer project (for example, webpage video, video on demand (VOD) display, application program screen, etc.).
  • the application layer project for example, webpage video, video on demand (VOD) display, application program screen, etc.
  • “Selector” is used to indicate that any item has been selected, such as cursor or focus object.
  • the selection information input is positioned according to the icon or menu position touched by the user in the display device 200, and the movement of the focus object displayed in the display device 200 can be used to select the control item, and one or more items can be selected or controlled.
  • the focus object refers to the object that moves between items based on user input. For example, draw a thick line on the edge of the item to realize or identify the position of the focus object.
  • the focus form is not limited to examples, it can be a tangible or intangible form that can be recognized by the user such as a cursor, such as a 3D deformation of the item, and the border line and size of the text or image of the focused item can also be changed. , Color, transparency and outline and/or font.
  • the event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provide the interface layout management module 2913 with the control of the recognized event or sub-event.
  • the interface layout management module 2913 is used to monitor the state of the user interface (including the position and/or size, change process, etc. of the view partition, item, focus or cursor object, etc.), and according to the event or sub-event, the view display area can be modified
  • modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.
  • the user input interface is used to send the user's input signal to the controller, or to transmit the signal output from the controller to the user.
  • the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the user input interface to the controller;
  • the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal in the form of audio or vibration.
  • the user may input a user command on the user interface displayed on the display device 200, and the user input interface receives the user input command through the user interface.
  • the user may input a user command by inputting a specific voice or gesture, and the user input interface recognizes the voice or gesture through the sensor to receive the user input command.
  • User interface is a medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users.
  • the commonly used form of the user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device.
  • the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. Visual interface elements.
  • 10-12 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment.
  • the first display screen (specifically, the first view display area 2011) displays a video screen, which can be the image content of a movie, a TV series, a video clip, or a video screen in an application, etc. .
  • the controller receives the incoming call request, and in response to the incoming call request, the controller displays the incoming call reminder screen on the second display screen (specifically, the second view display area 2021).
  • the incoming call reminder screen includes a tab for instructing to connect the incoming call request and a tab for rejecting the incoming call request.
  • the controller After the controller displays the incoming call reminder screen on the second display screen, it can execute it in any of the following two optional ways.
  • the controller displays the chat screen on the first display screen in response to the tab of the call connection request input by the user. Further, the controller may also display a small window video call screen on the second display screen or in the target area of the first display screen in response to the user's small window video call instruction.
  • the option card of the request to connect to the incoming call input by the user may also be referred to as the indication of the request to connect to the incoming call input by the user.
  • the controller controls the second display screen to present the chat screen in response to the tab for the call connection request input by the user. Further, the controller can also control the chat screen to switch from the second display screen to the first display screen in response to the user's selection of the chat screen.
  • the incoming call connection request may refer to answering a video call, for example, and the chat screen may refer to a video call screen, for example.
  • the number of controllers may be one or multiple.
  • the one controller receives the incoming call request when the first display screen displays the video image, and displays the incoming call reminder image on the second display screen.
  • the call reminder screen is displayed on the second screen when the video screen is displayed on the first screen through collaboration and interaction between the controllers.
  • the controller may include a first controller and a second controller.
  • the first controller is configured to receive an incoming call request when the video screen is displayed on the first display screen and send an incoming call indication to the second controller.
  • the controller is used to receive the incoming call indication and display the incoming call reminder screen on the second display screen.
  • the incoming call reminder screen displayed in the second view display area 2021 by the second controller may include the caller's portrait, name, and incoming call prompt. , Answer video button, answer voice only button, hang up button, etc.
  • the second controller positions the focus object on the answer video button.
  • the incoming call reminder screen displayed in the second view display area 2021 by the second controller may include the caller's portrait, name, incoming call reminder, answer voice button, and hang up button. Wait for items, and at the same time, the second controller positions the focus object on the answer voice button. The user can move the focus object by operating the left and right keys on the remote control to select a button, and press the OK key to confirm.
  • the first display screen and the second display screen can display FIG. 13 or The screen shown in Figure 14.
  • Figure 13 is a schematic diagram of six parties in a video call
  • Figure 14 is a schematic diagram of two parties in a video call.
  • the user can press the floating window button and the screen can be switched.
  • the screen can be switched to the screen shown in Figure 18.
  • the first display screen and the second display screen can display the screen shown in Figure 17 or Figure 18. The user can press a specific menu key, such as the OK key, and the screen can be switched to Figure 13 or The screen shown in Figure 14.
  • the first display screen and the second display screen can display the screen shown in FIG. 15. As shown in FIG. 15, the first display screen can continue to display video images. In some embodiments, the video can be paused at this time.
  • the second display screen may display portraits of participants other than the current user among the parties in the voice call. It should be understood that the current user described in the embodiment of the present application refers to a user corresponding to the display device. At the same time, the position corresponding to the current user in the second display screen is displayed as a black screen, and a sign indicating that the video is not started is superimposed on the black screen.
  • a voice logo may be displayed on the second display screen to identify that a voice call is currently in progress.
  • the first display screen and the second display screen can display the screen shown in FIG. 12.
  • the picture shown in FIG. 12 is the picture after not receiving the incoming call request and ending the voice call or video call.
  • the first display screen can continue to play video, while the second display screen can display information such as voice assistant, weather, date, and time.
  • Fig. 13 and Fig. 14 are schematic diagrams of a video call, which will be described separately below.
  • the video call screen is displayed in the first view display area 2011.
  • the video call screen displays the video of each of the six participants participating in the video call, and the video of each participant occupies the first view. Part of district 2011.
  • the lower left corner of the area where the video of each participant is located displays the name of the participant, and the lower right corner displays whether the participant is muted or non-muted.
  • the video of user A is displayed in the upper left corner of the display area of the first view.
  • the image of user A fills the entire area.
  • the lower left corner of the area superimposes and displays the name of user A, and the lower right corner of the area superimposes the sign that user A is currently muting.
  • the items for the user to operate and the duration of the video call are displayed in a semi-transparent form. These items can include floating small window buttons, switch layout buttons, invite new participants button, hang up button, video off button, microphone off button, screen sharing button, etc.
  • the displayed items can be different for different call types.
  • the focus object can be positioned on one of the items.
  • the call reminder screen is no longer displayed on the second display screen.
  • the second display screen may be in a state where the backlight is turned off, or the second display screen may display information such as weather and time.
  • An example of the interface after the user presses the floating window button, the layout switch button, and the invite new participant button will be described in the following embodiments.
  • the interface displays the screen shown in Figure 12 above.
  • the user presses the video off button the user's corresponding video is in a black screen state, and the current user's video is no longer displayed.
  • the microphone off button a mute sign is displayed in the area where the user's video is located.
  • the user is user A in FIG. 13, and when the user presses the microphone off button, the sign of the sitting corner of the area where user A is located is displayed as a mute sign.
  • a video call screen is displayed in the first view display area 2011, and the video call screen displays videos of two participants participating in the video call, and the video of each participant occupies half of the first view display area 2011.
  • the items for users to operate are displayed in a semi-transparent form. These items can include floating small window buttons, beauty filter buttons, invite friends buttons, hang up buttons, video off buttons, microphone off buttons, and switch layout buttons.
  • the focus object can be positioned on one of the items, for example, positioned on the floating window button.
  • the second display screen may be in a state where the backlight is turned off, or the second display screen may display information such as weather and time.
  • the interface After the user presses the hang up button, the interface displays the screen shown in Figure 12 above.
  • the user presses the video off button the user's corresponding video is in a black screen state, and the current user's video is no longer displayed.
  • the microphone off button a mute sign is displayed in the area where the user's video is located.
  • the user is user A in FIG. 13, and when the user presses the microphone off button, the sign of the sitting corner of the area where user A is located is displayed as a mute sign.
  • FIG. 16 is a schematic diagram of the interaction process between the first controller and the second controller. As shown in FIG. 16, the interaction process between the first controller and the second controller includes:
  • the first controller displays a video image on the first display screen.
  • the video screen may be the image content of a movie, a TV series, a video clip, or a video screen in an application.
  • the first controller also simultaneously plays the audio information corresponding to the video picture.
  • the first controller receives an incoming call request.
  • the incoming call request may be a video call request, a voice call request, a game invitation, etc.
  • the first controller sends an incoming call indication to the second controller.
  • the first controller determines that the video screen is currently being displayed on the first display screen, and can send an incoming call indication to the second controller through a serial port transmission mode.
  • the incoming call indication may include the type of the incoming call and the information of the caller, and the second controller selects the item to be displayed accordingly.
  • the incoming call indication may include both the type of the incoming call and the information of the caller, as well as the items to be displayed on the second display screen by the second controller, and the second controller directly displays the items based on the incoming call indication.
  • the types of incoming calls can include video calls, voice calls, game invitations, and so on.
  • the information of the caller may include the portrait, name, etc. of the caller.
  • the second controller receives the above-mentioned incoming call indication.
  • the second controller displays an incoming call reminder screen on the second display screen.
  • the second controller displays the incoming call reminder screen in the second view display area of the second display screen.
  • the incoming call reminder screen includes the caller's portrait, name, incoming call reminder, answer video button, answer voice only button, hang up button, etc. . If the type of the incoming call is a video-based incoming call such as a video call or game invitation, the second controller can position the focus object on the answer video button. If the type of the incoming call is a voice call, the second controller will position the focus object on the Only after answering the voice button.
  • the user can move the focus object by operating the left key and the right key on the remote control to select a button, and press the OK key to confirm. Alternatively, the user can directly press the OK key to confirm.
  • the second controller receives the user's instruction to answer the video call.
  • the second controller sends a video call instruction to the first controller.
  • the second controller After the user presses the OK key, the second controller recognizes the user's instruction based on the item currently located by the focus object. If the focus object is positioned on the hang-up button, the second controller confirms that it receives the hang-up instruction and sends the hang-up instruction to the first controller. After the first controller receives the hang-up instruction, it instructs the second controller to shut down Incoming call reminder screen, no longer perform the following steps. If the focus object is positioned on the voice-only button, the second controller confirms that it has received the voice call instruction and sends the voice call instruction to the first controller.
  • the first controller After the first controller receives the voice call instruction, it executes the voice call control , Such as playing the caller’s voice, receiving the receiver’s voice and sending it to the caller’s device, etc. At the same time, the first controller can instruct the second controller to close the call reminder screen and instruct the second controller to be on the second display Shows the items that are in a voice call. And, do not perform the following steps.
  • the second controller confirms that the instruction to answer the video call is received, and sends the video call instruction to the first controller.
  • the first controller receives the video call instruction and executes the following steps.
  • the first controller displays a video call screen on the first display screen.
  • the above-mentioned video call screen may include videos of the video call participants and items for the user to operate. Among them, the items for the user to operate can be displayed on the video of the video call participants.
  • the first controller may determine the video display position of each participant according to the number of participants in the video call. For example, assuming that the video call is a two-party video call, the video of the caller and the caller respectively occupy half of the screen of the first display screen. For another example, assuming that the video call is a six-party video call, each participant in the call occupies one-sixth of the first display.
  • the first controller displays items for the user to operate on the video of the video call participants. These items may include a floating window button, a switch layout button, a button for inviting new parties, a hangup button, and a video Off button, microphone off button, screen sharing button, etc.
  • the displayed items can be different for different call types.
  • the focus object can be positioned on one of the items, such as a floating window button. The user can move the focus object by operating the left and right keys on the remote control to select other items, and confirm by operating the OK key on the remote control.
  • the second controller closes the incoming call reminder screen.
  • the second controller may execute this step after executing the above-mentioned step S1306.
  • This step and the execution order of S1607 may be in no particular order.
  • the second controller After the second controller closes the call reminder screen, it can display information such as time, weather, temperature, and reminder messages on the second display screen, or the second controller can turn off the backlight of the second display screen.
  • the first controller when the first controller receives the incoming call request while the first display screen is playing a video screen, it displays the incoming call reminder screen on the second display screen, so that the video screen being displayed on the first display screen is not blocked. , Which greatly improves the user experience. After the user chooses to answer the video call, the video call screen is displayed on the first display screen, so that the user can view the videos of all parties to the video call.
  • the information transmission between the first controller and the second controller may be transmitted through a serial port.
  • the user can choose to make a small window video call.
  • the first controller uses the small window to display the video call screen according to the user's selection.
  • the user may press the floating small window button in FIG. 13 or FIG. 14, or the user may press the switch layout button in FIG. 13 or FIG. 14 to make a small window video call.
  • FIG. 17 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment.
  • the video call screen in the first view display area 2011 is closed, and the video screen before the video call continues to be displayed.
  • the small window video call instruction is input by the user pressing the above floating small window button.
  • a small window video call screen is displayed in the second view display area 2021, and the video of each video participant in the small window video call screen is displayed.
  • the name of the participant is displayed in the lower left corner of the area where the video of each participant is located, and the lower right corner shows that the participant is in a silent state or a non-muted state.
  • a line of prompt text (not shown in the figure) can be superimposed on the video of each participant in the second view display area 2021, such as "press the menu key to switch windows", so that the user can follow the prompt text
  • the execution returns to the display screen shown in Fig. 13 or Fig. 14.
  • the user can press a specific button (for example, the return button) on the remote control, and the display device will return to that shown in FIG. 13 or FIG. 14. Display screen shown.
  • a return button may be displayed in the second view display area. The user selects the button by operating the remote control and confirms that the display device returns to the display screen shown in FIG. 13 or FIG. 14 again.
  • FIG. 18 exemplarily shows a schematic diagram of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment.
  • the display area in the first view display area 2011 The video call screen is closed, and the video screen before the video call continues to be displayed.
  • the small window video call instruction is input by the user pressing the above-mentioned switch layout button.
  • a small window video call screen is displayed below the first view display area 2011 near the lower edge of the first display screen, and the video of each video participant in the small window video call screen.
  • the name of the participant is displayed in the lower left corner of the area where the video of each participant is located, and the lower right corner shows that the participant is in a silent state or a non-muted state.
  • the user can press a specific button (for example, the return button) on the remote control, and the display device will return to that shown in FIG. 13 or FIG. 14. Display screen shown.
  • a return button may be displayed below the first view display area 2011 near the lower edge of the first display screen. The user selects this button by operating the remote control and confirms that the display device returns to the display shown in FIG. 13 or FIG. 14 Picture.
  • Figure 19 is a schematic diagram of the interaction process between the first controller and the second controller. As shown in Figure 19, after the video call screen is displayed on the first display screen, the user can select the small window to display the video call screen, and the first controller can Notifying the second controller to display the small window video call screen on the second display screen, the interaction process between the first controller and the second controller includes:
  • the first controller receives a small window video call instruction input by the user.
  • the user can select the floating small window button displayed on the first display screen and confirm that the first controller receives the small window video call instruction.
  • the first controller sends a small window video call instruction to the second controller.
  • the small window video call indication is used to instruct the second controller to display a small window video call picture on the second display screen.
  • the first controller may carry the number of participants in the video call, the names of the parties, etc. in the instruction.
  • the second controller receives the small window video call instruction.
  • the first controller closes the video call screen and displays the video screen before the video call.
  • the second controller displays a small window video call screen on the second display screen.
  • the second controller After receiving the small window video call instruction, the second controller displays the video and name of each participant in multiple areas on the second display screen based on the number and names of the participants in the call.
  • the execution order of the above steps S1903 and S1904 may be in no particular order.
  • the user can press a specific button (for example, the return button) on the remote control, or select the small window video call through the remote control
  • the return button in the screen and confirm that the first controller receives the user's return instruction based on the user's operation.
  • the first controller sends the second controller an instruction to close the small window video call screen, and the second
  • the controller closes the video call screen in the small window, and at the same time, the first controller displays the above-mentioned video call screen on the first display screen again.
  • the information transmission between the first controller and the second controller may be transmitted through a serial port.
  • the first controller closes the video call screen after receiving the small window video call instruction input by the user, and displays the small window in the target area of the first display screen. Window video call screen.
  • the first controller may determine the size of the target area according to the number of participants in the video call, and display a small window video call picture on the target area.
  • the user can press a specific button (such as the return button) on the remote control, or select the small window through the remote control.
  • the return button in the window video call screen and confirm that the first controller receives the user’s return instruction based on the user’s operation.
  • the first controller closes the small window video call screen.
  • the first controller The above-mentioned video call screen is displayed on the first display screen again.
  • FIG. 20 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment.
  • a list of friends available for invitation is displayed.
  • the invitation instruction is input by the user pressing the aforementioned invite new participant button or invite friend button.
  • the friend list may be displayed above the first view display area 2011 near the upper edge of the first display screen, and each friend's portrait and name may be displayed in the friend list. After the user selects a friend's portrait or name and presses the OK button, the friend joins the video call, and the friend's video is added to the display area of the first view.
  • FIG. 21 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment.
  • the first view display area 2011 displays the beautification filter options on the displayed video call screen.
  • the beauty filter options can include backgrounds, stickers, and filters. Under the background option, the user can choose any of a variety of backgrounds. Under the sticker option, users can choose any one of a variety of stickers. Under the filter options, the user can choose any filter method. Under the beautification option, the user can select any beautification method.
  • the beauty filter option may be displayed at a position near the lower edge of the first display screen under the first view display area 2011. At this time, other buttons originally displayed at this position are temporarily hidden.
  • the foregoing describes the interaction processing process and the interface display process of the first controller and the second controller by taking the foregoing first optional manner as an example.
  • the corresponding processing and display process can be used.
  • the second controller receives the instruction to answer the video call input by the user, it displays the video call screen on the second display screen in the same manner as the first controller in the above-mentioned first optional method, and when the user presses After the confirmation key, the first controller displays the video call screen on the first display screen.
  • the specific implementation process will not be repeated here.
  • FIG. 22 is a schematic flowchart of a caller ID method provided by an embodiment of the application. The method is mainly executed by the aforementioned controller, as shown in FIG. 22, including:
  • S2201 Receive an incoming call request when a video screen is displayed on the first display screen.
  • S2202 in response to the aforementioned call request, display an incoming call reminder screen on the second display screen.
  • the controller when the first display screen is playing a video screen, the controller receives an incoming call request, and then displays the incoming call reminder screen on the second display screen, so that the video screen being displayed on the first display screen is not blocked. Greatly enhance the user experience.
  • the controller includes a first controller and a second controller.
  • the controller receiving an incoming call request when a video screen is displayed on the first display screen includes:
  • the first controller receives an incoming call request when the first display screen displays a video image.
  • the controller displays an incoming call reminder screen on the second display screen in response to the incoming call request, including:
  • the first controller sends an incoming call indication to the second controller in response to the incoming call request;
  • the second controller receives the incoming call indication, and in response to the incoming call indication, displays an incoming call reminder screen on the second display screen.
  • the above method further includes:
  • the incoming call reminder screen is displayed on the second display screen, in response to the user input for the tab request to connect to the incoming call, control the second display screen to present a chat screen.
  • the above method further includes:
  • controlling the chat screen In response to the user's selection of the chat screen, controlling the chat screen to switch from the second display screen to the first display screen.
  • the above method further includes:
  • the second controller receives the instruction for answering the video call input by the user, and in response to the instruction for answering the video call, sends a video call instruction to the first controller, and closes the incoming call reminder screen.
  • the first controller receives the video call instruction sent by the second controller, and in response to the video call instruction, displays a video call picture on the first display screen.
  • the above method further includes:
  • the first controller receives the small window video call instruction input by the user, responds to the small window video call instruction, closes the video call screen, and sends the small window video call instruction to the second controller.
  • the second controller displays a small window video call screen on the second display screen.
  • the above method further includes:
  • the first controller receives the small window video call instruction input by the user, and in response to the small window video call instruction, closes the video call screen, and displays the small window video call screen in the target area of the first display screen.
  • the method further includes:
  • the first controller displays the video screen on the first display screen.
  • the embodiments of the present application further provide a storage medium, which stores instructions in the storage medium, which when run on a computer, causes the computer to execute the method in the above method embodiment.
  • the embodiment of the present application further provides a chip for executing instructions, and the chip is used to execute the method in the above method embodiment.
  • An embodiment of the present application also provides a program product, the program product includes a computer program, the computer program is stored in a storage medium, at least one processor can read the computer program from the storage medium, and the at least one When the processor executes the computer program, the method in the foregoing method embodiment can be implemented.
  • At least one refers to one or more, and “multiple” refers to two or more.
  • “And/or” describes the association relationship of the associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone, where A, B can be singular or plural.
  • the character “/” generally indicates that the associated objects before and after are in an “or” relationship; in the formula, the character “/” indicates that the associated objects before and after are in a “division” relationship.
  • “The following at least one item (a)” or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a).
  • at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple A.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

Embodiments of the present application provide a display device, comprising a first display screen, a second display screen, and a controller. The controller is configured to receive an incoming call request when the first display screen displays video pictures, and display an incoming call alert picture on the second display screen. If the controller receives an incoming call request when the first display screen is displaying video pictures, an incoming call alert picture is displayed on the second display screen, so that the video pictures being displayed on the first display screen are not blocked.

Description

一种显示设备及来电显示方法Display device and caller ID display method
本申请要求于2019年11月4日提交中国专利局、申请号为2019110673655、申请名称为“显示设备、显示方法及计算设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 2019110673655, and the application name is "display device, display method, and computing device" on November 4, 2019, the entire content of which is incorporated into this application by reference in.
技术领域Technical field
本申请实施例涉及智能显示设备技术,尤其涉及一种显示设备及来电显示方法。The embodiments of the present application relate to smart display device technology, and in particular, to a display device and a caller ID display method.
背景技术Background technique
随着电视技术以及互联网技术的不断发展,出现了基于互联网的智能电视。智能电视基于互联网技术,具备开放式操作系统与芯片,并具有开放式应用平台,能够支持影音、娱乐、数据等多种功能,从而满足用户的多样化需求,为用户带来全新的使用体验。在用户交互方面,智能电视能够支持语音交互方式,用户可以通过语音对智能电视进行控制。With the continuous development of TV technology and Internet technology, smart TVs based on the Internet have emerged. Based on Internet technology, smart TVs have an open operating system and chips, and an open application platform that can support multiple functions such as audio and video, entertainment, and data, so as to meet the diverse needs of users and bring users a brand-new experience. In terms of user interaction, smart TVs can support voice interaction, and users can control smart TVs through voice.
现有技术中,智能电视包括一个显示器。智能电视需要向用户显示的信息均在该屏幕上显示。例如,智能电视在开机过程中,会播放开机动画,开机动画的画面均在一个显示器上显示。In the prior art, a smart TV includes a display. The information that the smart TV needs to display to the user is displayed on the screen. For example, during the boot process of a smart TV, a boot animation will be played, and pictures of the boot animation are displayed on one display.
发明内容Summary of the invention
本申请实施例提供一种双屏显示设备及来电显示方法,所述技术方案如下。The embodiment of the present application provides a dual-screen display device and a caller ID display method. The technical solution is as follows.
一方面,本申请实施例提供一种显示设备,包括:第一显示屏、第二显示屏和控制器。On the one hand, an embodiment of the present application provides a display device including: a first display screen, a second display screen, and a controller.
所述控制器被配置为:在所述第一显示屏显示视频画面时,接收来电请求,并在所述第二显示屏上显示来电提醒画面The controller is configured to: when the first display screen displays a video screen, receive an incoming call request, and display an incoming call reminder screen on the second display screen
另一方面,本申请实施例还提供一种来电显示方法,包括:On the other hand, an embodiment of the present application also provides a caller ID display method, including:
控制器在第一显示屏显示视频画面时接收来电请求;The controller receives the call request when the first display screen displays the video picture;
所述控制器响应于所述来电请求,在第二显示屏上显示来电提醒画面。In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen.
本申请实施例还提供一种计算设备,包括:An embodiment of the present application also provides a computing device, including:
存储器,用于存储程序指令;Memory, used to store program instructions;
处理器,用于调用所述存储器中存储的程序指令,按照获得的程序执行上述第二方面所述的方法。The processor is configured to call the program instructions stored in the memory, and execute the method described in the second aspect above according to the obtained program.
本申请实施例所提供的显示设备及来电显示方法,当第一显示屏正在播放视频画面时控制器接收到来电请求,则在第二显示屏上显示来电提醒画面,从而使得第一显示屏正在显示的视频画面不被遮挡,极大提升用户体验。In the display device and the caller ID display method provided by the embodiments of the present application, when the first display screen is playing a video screen, the controller receives an incoming call request, and then displays an incoming call reminder screen on the second display screen, so that the first display screen is The displayed video screen is not blocked, which greatly improves the user experience.
附图说明Description of the drawings
为了更清楚地说明本申请或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly explain the technical solutions in the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are of the present invention. For some of the embodiments of the application, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.
图1为本申请示例性实施例中提供的显示设备与控制装置之间操作场景的示意图;FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device provided in an exemplary embodiment of this application;
图2为本申请示例性实施例中提供的控制装置100的配置框图;FIG. 2 is a configuration block diagram of a control device 100 provided in an exemplary embodiment of this application;
图3a为本申请示例性实施例中提供的一种显示设备200中硬件系统的硬件 结构示意图;FIG. 3a is a schematic diagram of the hardware structure of a hardware system in a display device 200 provided in an exemplary embodiment of this application;
图3b为本申请示例性实施例中提供的另一种显示设备200中硬件系统的硬件结构示意图;3b is a schematic diagram of the hardware structure of a hardware system in another display device 200 provided in an exemplary embodiment of this application;
图4为本申请示例性实施例中提供的显示设备200中电源板与负载的连接关系示意图;4 is a schematic diagram of the connection relationship between the power supply board and the load in the display device 200 provided in an exemplary embodiment of this application;
图5为本申请示例性实施例中根据图3所示显示设备200的硬件架构框图;FIG. 5 is a block diagram of the hardware architecture of the display device 200 shown in FIG. 3 in an exemplary embodiment of this application;
图6为本申请示例性实施例中提供的显示设备的功能配置示意图;FIG. 6 is a schematic diagram of a functional configuration of a display device provided in an exemplary embodiment of this application;
图7为本申请示例性实施例中提供的显示设备200中软件系统的配置框图;FIG. 7 is a configuration block diagram of a software system in a display device 200 provided in an exemplary embodiment of this application;
图8为本申请示例性实施例中提供的显示设备的应用程序层示意图;FIG. 8 is a schematic diagram of an application layer of a display device provided in an exemplary embodiment of this application;
图9为本申请示例性实施例中提供的显示设备200中用户界面的示意图;FIG. 9 is a schematic diagram of a user interface in a display device 200 provided in an exemplary embodiment of this application;
图10-图12示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;10-12 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图13-图15示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;13-15 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图16为第一控制器和第二控制器的交互过程示意图;Figure 16 is a schematic diagram of the interaction process between the first controller and the second controller;
图17示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;FIG. 17 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图18示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;FIG. 18 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图19为第一控制器和第二控制器的交互过程示意图;Figure 19 is a schematic diagram of the interaction process between the first controller and the second controller;
图20示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;FIG. 20 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图21示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图;FIG. 21 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment;
图22为本申请实施例提供的来电显示方法的流程示意图。FIG. 22 is a schematic flowchart of a caller ID method provided by an embodiment of this application.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整的描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments These are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
本申请的说明书、权利要求书及附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。The terms "first" and "second" in the specification, claims, and drawings of this application are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.
本申请主要针对具有双系统、双显示屏结构的显示设备,即具有第一控制器(第一硬件系统)、第二控制器(第二硬件系统)、第一显示屏和第二显示屏的显示设备的音画同步处理,下面首先对具有双系统硬件结构的显示设备的结构、功能和实现方式等方面进行详细说明。This application is mainly directed to a display device with a dual-system and dual-display structure, that is, a display device with a first controller (a first hardware system), a second controller (a second hardware system), a first display screen, and a second display screen. For the audio-visual synchronization processing of the display device, the structure, function, and implementation manner of the display device with a dual-system hardware structure will be described in detail below.
为便于用户使用,显示设备上通常会设置各种外部装置接口,以便于连接不同的外设设备或线缆以实现相应的功能。而在显示设备的接口上连接有高清晰度的摄像头时,如果显示设备的硬件系统没有接收源码的高像素摄像头的硬件接口,那么就会导致无法将摄像头接收到的数据呈现到显示设备的显示屏上。For the convenience of users, various external device interfaces are usually provided on the display device to facilitate the connection of different peripheral devices or cables to achieve corresponding functions. When a high-resolution camera is connected to the interface of the display device, if the hardware system of the display device does not have the hardware interface of the high-pixel camera that receives the source code, it will cause the data received by the camera to be unable to present the data received by the camera to the display of the display device. On the screen.
并且,受制于硬件结构,传统显示设备的硬件系统仅支持一路硬解码资源,且通常最大仅能支持4K分辨率的视频解码,因此当要实现边观看网络电视边进 行视频聊天时,为了不降低网络视频画面清晰度,就需要使用硬解码资源(通常是硬件系统中的GPU)对网络视频进行解码,而在此情况下,只能采取由硬件系统中的通用处理器(例如CPU)对视频进行软解码的方式处理视频聊天画面。Moreover, due to the hardware structure, the hardware system of traditional display devices only supports one hard decoding resource, and usually only supports 4K resolution video decoding. Therefore, when you want to realize the video chat while watching Internet TV, in order not to reduce The definition of the network video picture requires the use of hard decoding resources (usually the GPU in the hardware system) to decode the network video. In this case, the general-purpose processor (such as CPU) in the hardware system can only be used to decode the video. The video chat screen is processed by soft decoding.
采用软解码处理视频聊天画面,会大大增加CPU的数据处理负担,当CPU的数据处理负担过重时,可能会出现画面卡顿或者不流畅的问题。在一些实施例中,受制于CPU的数据处理能力,当采用CPU软解码处理视频聊天画面时,通常无法实现多路视频通话,当用户想要再同一聊天场景同时与多个其他用户进行视频聊天时,会出现接入受阻的情况。Using soft decoding to process the video chat screen will greatly increase the data processing burden on the CPU. When the data processing burden on the CPU is too heavy, the picture may freeze or become unsmooth. In some embodiments, due to the data processing capability of the CPU, when the CPU soft decoding is used to process the video chat screen, it is usually impossible to achieve multi-channel video calls. When the user wants to simultaneously video chat with multiple other users in the same chat scene At times, access will be blocked.
基于上述各方面的考虑,为克服上述缺陷,本申请公开了一种双硬件系统架构,以实现多路视频聊天数据(至少一路本地视频)。Based on the above considerations, in order to overcome the above shortcomings, this application discloses a dual hardware system architecture to implement multiple channels of video chat data (at least one local video).
下面首先结合附图对本申请所涉及的概念进行说明。在此需要指出的是,以下对各个概念的说明,仅为了使本申请的内容更加容易理解,并不表示对本申请保护范围的限定。The concepts involved in the present application will be described below in conjunction with the drawings. It should be pointed out here that the following description of each concept is only to make the content of this application easier to understand, and does not mean to limit the scope of protection of this application.
本申请各实施例中使用的术语“模块”,可以是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。The term "module" used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can execute related components Function.
本申请各实施例中使用的术语“遥控器”,是指电子设备(如本申请中公开的显示设备)的一个组件,该组件通常可在较短的距离范围内无线控制电子设备。该组件一般可以使用红外线和/或射频(RF)信号和/或蓝牙与电子设备连接,也可以包括WiFi、无线USB、蓝牙、动作传感器等功能模块。例如:手持式触摸遥控器,是以触摸屏中用户界面取代一般遥控装置中的大部分物理内置硬件。The term "remote control" used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. This component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hardware in a general remote control device.
本申请各实施例中使用的术语“手势”,是指用户通过一种手型的变化或手部运动等动作,用于表达预期想法、动作、目的/或结果的用户行为。The term "gesture" used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
本申请各实施例中使用的术语“硬件系统”,可以是指由集成电路(Integrated Circuit,IC)、印刷电路板(Printed circuit board,PCB)等机械、光、电、磁器件构成的具有计算、控制、存储、输入和输出功能的实体部件。在本申请各个实施例中,硬件系统通常也会被称为主板(motherboard)或芯片。The term "hardware system" used in the various embodiments of this application may refer to an integrated circuit (IC), printed circuit board (Printed circuit board, PCB) and other mechanical, optical, electrical, and magnetic devices with computing , Control, storage, input and output functions of the physical components. In the various embodiments of the present application, the hardware system is usually also referred to as a motherboard or a chip.
图1中示例性示出了根据实施例中显示设备与控制装置之间操作场景的示意图。如图1所示,用户可通过控制装置100来操作显示设备200。Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.
其中,控制装置100可以是遥控器100A,其可与显示设备200之间通过红外协议通信、蓝牙协议通信、紫蜂(ZigBee)协议通信或其他短距离通信方式进行通信,用于通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器100A上按键、语音输入、控制面板输入等输入用户指令,来控制显示设备200。如:用户可以通过遥控器100A上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制显示设备200的功能。Wherein, the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods for wireless or other short-distance communication. The display device 200 is controlled in a wired manner. The user can control the display device 200 by inputting user instructions through keys, voice input, control panel input, etc. on the remote controller 100A. For example: the user can control the display device by inputting corresponding control commands through the volume up and down keys on the remote control 100A, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch machine keys, etc. 200 features.
控制装置100也可以是智能设备,如移动终端100B、平板电脑、计算机、笔记本电脑等,其可以通过本地网(LAN,Local Area Network)、广域网(WAN,Wide Area Network)、无线局域网(WLAN,Wireless Local Area Network)或其他网络与显示设备200之间通信,并通过与显示设备200相应的应用程序实现对显示设备200的控制。例如,使用在智能设备上运行的应用程序控制显示设备200。该应用程序可以在与智能设备关联的屏幕上通过直观的用户界面(UI,User Interface)为用户提供各种控制。The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which may be connected through a local area network (LAN, Wide Area Network), a wide area network (WAN, Wide Area Network), and a wireless local area network (WLAN, Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200. For example, an application program running on a smart device is used to control the display device 200. The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.
示例的,移动终端100B与显示设备200均可安装软件应用,从而可通过网络通信协议实现二者之间的连接通信,进而实现一对一控制操作的和数据通信的目的。如:可以使移动终端100B与显示设备200建立控制指令协议,将遥控控制键盘同步到移动终端100B上,通过控制移动终端100B上用户界面,实现控制显示设备200的功能;也可以将移动终端100B上显示的音视频内容传输到显示设备200上,实现同步显示功能。For example, both the mobile terminal 100B and the display device 200 can be installed with software applications, so that the connection and communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be realized. For example, the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and control the user interface of the mobile terminal 100B to achieve the function of controlling the display device 200; or the mobile terminal 100B The audio and video content displayed on the screen is transmitted to the display device 200 to realize the synchronous display function.
如图1所示,显示设备200还可与服务器300通过多种通信方式进行数据通信。在本申请各个实施例中,可允许显示设备200通过局域网、无线局域网或其他网络与服务器300进行有线通信连接或无线通信连接。服务器300可以向显示设备200提供各种内容和互动。As shown in FIG. 1, the display device 200 can also communicate with the server 300 through multiple communication methods. In various embodiments of the present application, the display device 200 may be allowed to perform a wired communication connection or a wireless communication connection with the server 300 through a local area network, a wireless local area network, or other networks. The server 300 may provide various contents and interactions to the display device 200.
示例的,显示设备200通过发送和接收信息,以及电子节目指南(EPG,Electronic Program Guide)互动,接收软件程序更新,或访问远程储存的数字媒体库。服务器300可以是一组,也可以是多组,可以是一类或多类服务器。通过服务器300提供视频点播和广告服务等其他网络服务内容。Illustratively, the display device 200 transmits and receives information, interacts with an Electronic Program Guide (EPG, Electronic Program Guide), receives software program updates, or accesses a remotely stored digital media library. The server 300 may be a group or multiple groups, and may be one or more types of servers. The server 300 provides other network service content such as video-on-demand and advertising services.
显示设备200包括第一显示屏201与第二显示屏202,其中,第一显示屏201与第二显示屏202之间相互独立,第一显示屏201与第二显示屏202之间采用双硬件控制系统。The display device 200 includes a first display screen 201 and a second display screen 202, wherein the first display screen 201 and the second display screen 202 are independent of each other, and the first display screen 201 and the second display screen 202 adopt dual hardware Control System.
其中,第一显示屏201和第二显示屏202可以用于显示不同的显示画面。如,第一显示屏201可以用于传统电视节目的画面显示,第二显示屏202用于通知类消息、语音助手等辅助信息的画面显示。Among them, the first display screen 201 and the second display screen 202 can be used to display different display pictures. For example, the first display screen 201 can be used for screen display of traditional television programs, and the second display screen 202 can be used for screen display of auxiliary information such as notification messages and voice assistants.
在一些实施例中,第一显示屏201显示的内容与第二显示屏202显示的内容之间可以相互独立,互不影响。例如,在第一显示屏201播放电视节目时, 第二显示屏202可以显示与电视节目无关的时间、天气、气温、提醒消息等信息。In some embodiments, the content displayed on the first display screen 201 and the content displayed on the second display screen 202 may be independent of each other without affecting each other. For example, when a TV program is played on the first display screen 201, the second display screen 202 may display information such as time, weather, temperature, and reminder messages that are not related to the TV program.
在一些实施例中,第一显示屏201显示的内容与第二显示屏202显示的内容之间也可以存在关联关系。例如,在第一显示屏201播放视频聊天的主画面时,第二显示屏202可以显示当前接入视频聊天的用户的头像、聊天时长等信息。In some embodiments, there may also be an association relationship between the content displayed on the first display screen 201 and the content displayed on the second display screen 202. For example, when the main screen of the video chat is played on the first display screen 201, the second display screen 202 may display information such as the avatar and the chat duration of the user currently accessing the video chat.
在一些实施例中,第二显示屏202显示的部分或全部内容可以调整至第一显示屏201显示。例如,可以将第一显示屏201显示的时间、天气、气温、提醒消息等信息调整到第一显示屏201显示,而用第二显示屏202显示其它的信息。In some embodiments, part or all of the content displayed on the second display screen 202 can be adjusted to be displayed on the first display screen 201. For example, the time, weather, temperature, reminder message and other information displayed on the first display screen 201 can be adjusted to be displayed on the first display screen 201, and the second display screen 202 can be used to display other information.
另外,第一显示屏201在显示传统电视节目画面的同时,还显示多方交互画面,且多方交互画面不会遮挡传统电视节目画面。其中,本申请对传统电视节目画面和多方交互画面的显示方式不做限定。例如,本申请可以根据传统电视节目画面和多方交互画面的优先级,设置传统电视节目画面和多方交互画面的位置和大小。In addition, the first display screen 201 displays a multi-party interactive screen while displaying a traditional TV program screen, and the multi-party interactive screen does not block the traditional TV program screen. Among them, the present application does not limit the display mode of the traditional TV program screen and the multi-party interactive screen. For example, this application can set the position and size of the traditional TV program screen and the multi-party interactive screen according to the priority of the traditional TV program screen and the multi-party interactive screen.
以传统电视节目画面的优先级高于多方交互画面的优先级为例,传统电视节目画面的面积大于多方交互画面的面积,且多方交互画面可以位于传统电视节目画面的一侧,也可以悬浮设置在多方交互画面的一角。Taking the priority of traditional TV program screens higher than the priority of multi-party interactive screens as an example, the area of traditional TV program screens is larger than that of multi-party interactive screens, and the multi-party interactive screens can be located on one side of the traditional TV program screen or can be set floating In the corner of the multi-party interactive screen.
显示设备200,一方面讲,可以是液晶显示器、OLED(Organic Light Emitting Diode)显示器、投影显示设备;另一方面讲,显示设备被可以是智能电视或显示器和机顶盒组成的显示系统。具体显示设备类型,尺寸大小和分辨率等不作限定,本领技术人员可以理解的是,显示设备200可以根据需要做性能和配置 上的一些改变。The display device 200, on the one hand, may be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or a projection display device; on the other hand, the display device may be a smart TV or a display system composed of a display and a set-top box. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
显示设备200除了提供广播接收电视功能之外,还可以附加提供计算机支持功能的智能网络电视功能。示例的包括,网络电视、智能电视、互联网协议电视(IPTV)等。在一些实施例中,显示设备可以不具备广播接收电视功能。In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV), and so on. In some embodiments, the display device may not have the function of broadcasting and receiving TV.
如图1所示,显示设备200上可以连接或设置有摄像头,用于将摄像头拍摄到的画面呈现在本显示设备或其他显示设备的显示界面上,以实现用户之间的交互聊天。具体的,摄像头拍摄到的画面可在显示设备上全屏显示、半屏显示、或者显示任意可选区域。As shown in FIG. 1, a camera may be connected or provided on the display device 200 for presenting a picture captured by the camera on the display interface of the display device or other display devices, so as to realize interactive chats between users. Specifically, the image captured by the camera can be displayed on the display device in full screen, half screen, or in any selectable area.
作为一种在一些实施例中连接方式,摄像头通过连接板与显示设备的后壳连接,固定安装在显示设备的后壳的上侧中部,作为可安装的方式,可以固定安装在显示设备的后壳的任意位置,能保证其图像采集区域不被后壳遮挡即可,例如,图像采集区域与显示设备的显示朝向相同。As a connection method in some embodiments, the camera is connected to the rear shell of the display device through a connecting plate, and is fixedly installed on the upper middle of the rear shell of the display device. As an installable method, it can be fixedly installed on the rear of the display device. Any position of the shell can ensure that the image capture area is not blocked by the rear shell. For example, the image capture area and the display device have the same orientation.
作为另一种在一些实施例中连接方式,摄像头通过连接板或者其他可想到的连接器可升降的与显示设备后壳连接,连接器上安装有升降马达,当用户要使用摄像头或者有应用程序要使用摄像头时,再升出显示设备之上,当不需要使用摄像头时,其可内嵌到后壳之后,以达到保护摄像头免受损坏和保护用户的隐私安全。As another connection method in some embodiments, the camera can be connected to the rear shell of the display device through a connecting plate or other conceivable connectors. A lifting motor is installed on the connector. When the user wants to use the camera or has an application When the camera is to be used, it is raised above the display device. When the camera is not needed, it can be embedded behind the back shell to protect the camera from damage and protect the privacy of the user.
作为一种实施例,本申请所采用的摄像头可以为1600万像素,以达到超高清显示目的。在实际使用中,也可采用比1600万像素更高或更低的摄像头。As an embodiment, the camera used in this application may have 16 million pixels to achieve the purpose of ultra-high-definition display. In actual use, a camera with higher or lower than 16 million pixels can also be used.
当显示设备上安装有摄像头以后,显示设备不同应用场景所显示的内容可得到多种不同方式的融合,从而达到传统显示设备无法实现的功能。When a camera is installed on the display device, the content displayed in different application scenarios of the display device can be merged in a variety of different ways, so as to achieve functions that cannot be achieved by traditional display devices.
示例性的,用户可以在边观看视频节目的同时,与至少一位其他用户进行 视频聊天。视频节目的呈现可作为背景画面,视频聊天的窗口显示在背景画面之上。形象的,可以称该功能为“边看边聊”。Exemplarily, the user can video chat with at least one other user while watching a video program. The presentation of the video program can be used as the background screen, and the video chat window is displayed on the background screen. Visually, you can call this function "watch and chat".
在一些实施例中,在“边看边聊”的场景中,在观看直播视频或网络视频的同时,跨终端的进行至少一路的视频聊天。In some embodiments, in the scenario of “watching while chatting”, while watching live video or online video, at least one video chat is performed across terminals.
另一示例中,用户可以在边进入教育应用学习的同时,与至少一位其他用户进行视频聊天。例如,学生在学习教育应用程序中内容的同时,可实现与老师的远程互动。形象的,可以称该功能为“边学边聊”。In another example, the user can video chat with at least one other user while entering the education application for learning. For example, students can realize remote interaction with teachers while learning content in educational applications. Visually, you can call this function "learning and chatting".
另一示例中,用户在玩纸牌游戏时,与进入游戏的玩家进行视频聊天。例如,玩家在进入游戏应用参与游戏时,可实现与其他玩家的远程互动。形象的,可以称该功能为“边看边玩”。In another example, when the user is playing a card game, a video chat is conducted with players entering the game. For example, when a player enters a game application to participate in a game, it can realize remote interaction with other players. Visually, you can call this function "watch and play".
在一些实施例中,游戏场景与视频画面进行融合,将视频画面中人像进行抠图,显示在游戏画面中,提升用户体验。In some embodiments, the game scene and the video image are merged, and the portrait in the video image is cut out and displayed on the game image, which improves the user experience.
在一些实施例中,在体感类游戏中(如打球类、拳击类、跑步类、跳舞类等),通过摄像头获取人体姿势和动作,肢体检测和追踪、人体骨骼关键点数据的检测,再与游戏中动画进行融合,实现如体育、舞蹈等场景的游戏。In some embodiments, in somatosensory games (such as ball games, boxing games, running games, dancing games, etc.), human body postures and movements are acquired through a camera, limb detection and tracking, and key point data detection of human bones. Animations are integrated in the game to realize games such as sports, dance and other scenes.
另一示例中,用户可以在K歌应用中,与至少一位其他用户进行视频和语音的交互。形象的,可以称该功能为“边看边唱”。在一些实施例中,当至少一位用户在聊天场景进入该应用时,可多个用户共同完成一首歌的录制。In another example, the user can interact with at least one other user in video and voice in the K song application. Visually, you can call this function "watch and sing". In some embodiments, when at least one user enters the application in a chat scene, multiple users can jointly complete the recording of a song.
另一个示例中,用户可在本地打开摄像头获取图片和视频,形象的,可以称该功能为“照镜子”。In another example, the user can turn on the camera locally to obtain pictures and videos, which is vivid, and this function can be called "look in the mirror".
在另一些示例中,还可以再增加更多功能或减少上述功能。本申请对该显示设备的功能不作具体限定。In other examples, more functions can be added or the aforementioned functions can be reduced. This application does not specifically limit the function of the display device.
图2中示例性示出了根据示例性实施例中控制装置100的配置框图。如图2所示,控制装置100包括控制器110、通信器130、用户输入/输出接口140、存储器190、供电电源180。Fig. 2 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in FIG. 2, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.
控制装置100被配置为可控制所述显示设备200,以及可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起到用户与显示设备200之间交互中介作用。如:用户通过操作控制装置100上频道加减键,显示设备200响应频道加减的操作。The control device 100 is configured to control the display device 200, and can receive user input operation instructions, and convert the operation instructions into instructions that can be recognized and responded to by the display device 200, acting as an intermediary for the interaction between the user and the display device 200 effect. For example, the user operates the channel plus and minus key on the control device 100, and the display device 200 responds to the channel plus and minus operation.
在一些实施例中,控制装置100可是一种智能设备。如:控制装置100可根据用户需求安装控制显示设备200的各种应用。In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the display device 200 according to user requirements.
在一些实施例中,如图1所示,移动终端100B或其他智能电子设备,可在安装操控显示设备200的应用之后,起到控制装置100类似功能。如:用户可以通过安装应用,在移动终端100B或其他智能电子设备上可提供的图形用户界面的各种功能键或虚拟按钮,以实现控制装置100实体按键的功能。In some embodiments, as shown in FIG. 1, the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing an application for controlling the display device 200. For example, the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 100B or other smart electronic devices by installing applications to realize the function of the physical keys of the control device 100.
控制器110包括处理器112、RAM 113和ROM 114、通信接口以及通信总线。控制器110用于控制控制装置100的运行和操作,以及内部各部件之间通信协作以及外部和内部的数据处理功能。The controller 110 includes a processor 112, a RAM 113 and a ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.
通信器130在控制器110的控制下,实现与显示设备200之间控制信号和数据信号的通信。如:将接收到的用户输入信号发送至显示设备200上。通信器130可包括WIFI模块131、蓝牙模块132、NFC模块133等通信模块中至少一种。The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the received user input signal is sent to the display device 200. The communicator 130 may include at least one of communication modules such as a WIFI module 131, a Bluetooth module 132, and an NFC module 133.
用户输入/输出接口140,其中,输入接口包括麦克风141、触摸板142、传感器143、按键144、摄像头145等输入接口中至少一者。如:用户可以通 过语音、触摸、手势、按压等动作实现用户指令输入功能,输入接口通过将接收的模拟信号转换为数字信号,以及数字信号转换为相应指令信号,发送至显示设备200。The user input/output interface 140, where the input interface includes at least one of input interfaces such as a microphone 141, a touch panel 142, a sensor 143, a button 144, and a camera 145. For example, the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding instruction signal, and sends it to the display device 200.
输出接口包括将接收的用户指令发送至显示设备200的接口。在一些实施例中,可以是红外接口,也可以是射频接口。如:红外信号接口时,需要将用户输入指令按照红外控制协议转化为红外控制信号,经红外发送模块进行发送至显示设备200。再如:射频信号接口时,需将用户输入指令转化为数字信号,然后按照射频控制信号调制协议进行调制后,由射频发送端子发送至显示设备200。The output interface includes an interface for sending the received user instruction to the display device 200. In some embodiments, it may be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module. For another example: in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, which is then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency sending terminal.
在一些实施例中,控制装置100包括通信器130和输出接口中至少一者。控制装置100中配置通信器130,如:WIFI、蓝牙、NFC等模块,可将用户输入指令通过WIFI协议、或蓝牙协议、或NFC协议编码,发送至显示设备200。In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The control device 100 is equipped with a communicator 130, such as WIFI, Bluetooth, NFC and other modules, which can encode the user input command through the WIFI protocol, or the Bluetooth protocol, or the NFC protocol, and send it to the display device 200.
存储器190,用于在控制器110的控制下存储驱动和控制控制装置100的各种运行程序、数据和应用。存储器190,可以存储用户输入的各类控制信号指令。The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.
供电电源180,用于在控制器110的控制下为控制装置100各电器元件提供运行电力支持。供电电源180可以采用电池及相关控制电路实现供电。The power supply 180 is used to provide operating power support for the electrical components of the control device 100 under the control of the controller 110. The power supply 180 can be powered by a battery and related control circuits.
在一些实施例中,图3a中示例性示出了根据示例性实施例中显示设备200中硬件系统的硬件结构示意图。为了便于说明,图3a中显示设备200以液晶显示器为例进行示意。In some embodiments, FIG. 3a exemplarily shows a schematic diagram of the hardware structure of the hardware system in the display device 200 according to the exemplary embodiment. For ease of description, the display device 200 in FIG. 3a uses a liquid crystal display as an example for illustration.
图3a所示,显示设备200可以包括:第一面板11、第一背光组件12、第一后壳13、第一控制器14、第二控制器15、第一显示驱动电路16、第二面板 21、第二背光组件22、第二后壳23、第二显示驱动电路24和电源组件30。另外,在一些实施例中,显示设备200还可以包括:底座或者悬挂支架。为了便于说明,图3a中显示设备200中以包含底座41进行举例示意,该底座41用于支撑显示设备200。值得说明的是,图中仅示出一种形式的底座设计,本领域技术人员可以根据产品需求设计不同形式的底座。As shown in FIG. 3a, the display device 200 may include: a first panel 11, a first backlight assembly 12, a first rear case 13, a first controller 14, a second controller 15, a first display driving circuit 16, and a second panel 21. The second backlight assembly 22, the second rear case 23, the second display driving circuit 24, and the power supply assembly 30. In addition, in some embodiments, the display device 200 may further include a base or a suspension bracket. For ease of description, the display device 200 in FIG. 3a includes a base 41 for illustration, and the base 41 is used to support the display device 200. It is worth noting that only one form of base design is shown in the figure, and those skilled in the art can design different forms of bases according to product requirements.
其中,第一面板11用于给用户呈现第一显示屏201的画面。在一些实施例中,第一面板11可以为液晶面板。例如,液晶面板可以从上到下依次包括:水平偏光板、彩色滤光片、液晶层、薄膜晶体管TFT、垂直偏光板、导光板和印刷电路板(printed circuit board,PCB),该印刷电路板PCB上设置有栅极驱动电路、源极驱动电路等驱动电路。其中,栅极驱动电路通过扫描线与薄膜晶体管TFT的栅极连接,源极驱动电路通过数据线与薄膜晶体管TFT的漏极连接。Among them, the first panel 11 is used to present a picture of the first display screen 201 to the user. In some embodiments, the first panel 11 may be a liquid crystal panel. For example, a liquid crystal panel may include, from top to bottom, a horizontal polarizer, a color filter, a liquid crystal layer, a thin film transistor TFT, a vertical polarizer, a light guide plate, and a printed circuit board (PCB). The printed circuit board Drive circuits such as a gate drive circuit and a source drive circuit are arranged on the PCB. Wherein, the gate driving circuit is connected to the gate of the thin film transistor TFT through a scan line, and the source driving circuit is connected to the drain of the thin film transistor TFT through a data line.
其中,第一背光组件12位于第一面板11的下方,通常是一些光学组件,用于供应充足的亮度与分布均匀的光源,使第一面板11能正常显示影像。第一背光组件12还包括第一背板(图中未示出)。Wherein, the first backlight assembly 12 is located under the first panel 11, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the first panel 11 can display images normally. The first backlight assembly 12 also includes a first back plate (not shown in the figure).
其中,第一后壳13盖设在第一面板11上,以共同隐藏第一背光组件12、第一控制器14、第二控制器15和第一显示驱动电路16和电源组件30等显示设备200的零部件,起到美观的效果。Wherein, the first rear case 13 is covered on the first panel 11 to jointly hide the display devices such as the first backlight assembly 12, the first controller 14, the second controller 15, the first display driving circuit 16, the power supply assembly 30, etc. 200 parts, play a beautiful effect.
其中,第一控制器14、第二控制器15和第一显示驱动电路16和电源组件30设置于第一背板上,通常在第一背板上冲压形成一些凸包结构。第一控制器14、第二控制器15和第一显示驱动电路16和电源组件30通过螺钉或者挂钩固定在凸包上。Among them, the first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are arranged on the first backplane, and some convex hull structures are usually stamped on the first backplane. The first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are fixed on the convex hull by screws or hooks.
在一些实施例中,第一控制器14、第二控制器15、第一显示驱动电路16 和电源组件30可以共同设置在一个板子上,也可以分别设置不同的板子上,如第一控制器14设置在主板上,第二控制器15设置在交互板上,第一显示驱动电路16设置在第一显示驱动板上,电源组件30设置在电源板上,也可以组合设置在不同的板子上,也可以与第一背光组件12共同设置在一个板子上,具体可以根据实际需求进行设置,本申请对此不做限定。In some embodiments, the first controller 14, the second controller 15, the first display driving circuit 16, and the power supply assembly 30 may be arranged on one board together, or may be arranged on different boards, such as the first controller. 14 is set on the main board, the second controller 15 is set on the interactive board, the first display drive circuit 16 is set on the first display drive board, and the power supply assembly 30 is set on the power supply board. It can also be combined on different boards. , It can also be set on a board together with the first backlight assembly 12, which can be set according to actual needs, which is not limited in this application.
为了便于说明,图3a中将第一控制器14、第二控制器15和第一显示驱动电路16和电源组件30共设在一个板子上进行举例示意。For ease of description, the first controller 14, the second controller 15, the first display driving circuit 16 and the power supply assembly 30 are all provided on one board in FIG. 3a for illustration.
其中,第一显示驱动电路16主要的功能是:通过第一控制器14传输的背光驱动信号,如PWM信号以及Local dimming信号,进行千级背光分区控制,此部分控制是根据图像内容变化的,以及在与第一控制器14之间建立握手后,接收第一控制器14发送的VbyOne显示信号,并将VbyOne显示信号转换为LVDS信号,实现第一显示屏201的图像画面显示。Among them, the main function of the first display driving circuit 16 is to perform a thousand-level backlight partition control through the backlight driving signal transmitted by the first controller 14, such as a PWM signal and a local dimming signal. This part of the control is changed according to the image content. And after the handshake is established with the first controller 14, the VbyOne display signal sent by the first controller 14 is received, and the VbyOne display signal is converted into an LVDS signal to realize the image display of the first display screen 201.
其中,第二面板21用于给用户呈现第二显示屏202的画面。在一些实施例中,第二面板21可以为液晶面板,具体包含的结构可以参见前述内容的描述,此处不做赘述。Among them, the second panel 21 is used to present the screen of the second display screen 202 to the user. In some embodiments, the second panel 21 may be a liquid crystal panel, and the specific structure included can refer to the description of the foregoing content, which will not be repeated here.
其中,第二背光组件22位于第二面板12的下方,通常是一些光学组件,用于供应充足的亮度与分布均匀的光源,使第二面板12能正常显示影像。第二背光组件22还包括第二背板(图中未示出)。Wherein, the second backlight assembly 22 is located below the second panel 12, and is usually some optical components for supplying sufficient brightness and uniformly distributed light sources, so that the second panel 12 can display images normally. The second backlight assembly 22 also includes a second back plate (not shown in the figure).
其中,第二后壳23盖设在第二面板21上,以共同隐藏第二背光组件22和第二显示驱动电路24等显示设备200的零部件,起到美观的效果。Wherein, the second rear case 23 is covered on the second panel 21 to jointly hide the components of the display device 200 such as the second backlight assembly 22 and the second display driving circuit 24, which has a beautiful effect.
其中,第二显示驱动电路24设置于第二背板上,通常在第二背板上冲压形成一些凸包结构。第二显示驱动电路24通过螺钉或者挂钩固定在凸包上。第二 显示驱动电路24可以单独设置在一个板子上,如第二显示驱动板上,也可以与第二背光组件22共同设置在一个板子上,具体可以根据实际需求进行设置,本申请对此不做限定。为了便于说明,图3a中将第二显示驱动电路24单独设在一个板子上进行举例示意。Wherein, the second display driving circuit 24 is disposed on the second backplane, and some convex hull structures are usually stamped on the second backplane. The second display driving circuit 24 is fixed on the convex hull by screws or hooks. The second display driving circuit 24 can be separately arranged on a board, such as a second display driving board, or it can be arranged on the same board together with the second backlight assembly 22, which can be set according to actual needs. This application does not Make a limit. For ease of description, the second display driving circuit 24 is separately provided on a board in FIG. 3a for illustration.
在一些实施例中,图3a中还包括按键板,按键板可以设置在第一背板上,也可以设置在第二背板上,本申请对此不做限定。且按键板上设置有多个按键和按键电路,使得第一控制器14或者第二控制器15可以从按键板上接收按键信号,也使得第一控制器14或者第二控制器15可以向按键板发送控制信号。In some embodiments, FIG. 3a also includes a key pad. The key pad can be provided on the first backplane or the second backplane, which is not limited in this application. And a plurality of buttons and button circuits are provided on the button board, so that the first controller 14 or the second controller 15 can receive the button signal from the button board, and the first controller 14 or the second controller 15 can also send the button to the button. The board sends control signals.
另外,显示设备200还包括声音再现装置(图中未示出)例如音响组件,如包括功率放大器(Amplifier,AMP)及扬声器(Speaker)的I2S接口等,用于实现声音的再现。通常音响组件至少能够实现两个声道的声音输出;当要实现全景声环绕的效果,则需要设置多个音响组件,输出多个声道的声音,这里不再具体展开说明。In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction. Generally, audio components can achieve sound output of at least two channels; when the panoramic sound surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.
需要说明的是,显示设备200还可以为OLED显示器,对应的,显示设备200所包含的模板发生相应的改变,如由于OLED显示器可以实现自发光,因此,OLED显示器中不需要背光组件(图3a中的第一背光组件12和第二背光组件22),此处不做过多说明。It should be noted that the display device 200 can also be an OLED display. Correspondingly, the template included in the display device 200 is changed accordingly. For example, since the OLED display can realize self-luminescence, the OLED display does not require a backlight assembly (Figure 3a) The first backlight assembly 12 and the second backlight assembly 22) are not detailed here.
或者,如图3a所示以具有双显示屏的显示设备作为示例性说明,而在图3b中示例性示出了根据示例性实施例中显示设备中硬件系统的硬件结构示意图。Or, as shown in FIG. 3a, a display device with dual display screens is taken as an exemplary illustration, and FIG. 3b exemplarily shows a schematic diagram of the hardware structure of a hardware system in the display device according to an exemplary embodiment.
其中,如图3b所示的具有单显示屏的显示设备中,该显示设备包括:面板1、背光组件2、后壳3、控制器4、电源组件5和底座6。其中,面板1用于给用户呈现画面;背光组件2位于面板1的下方,通常是一些光学组件,用于供 应充足的亮度与分布均匀的光源,使面板1能正常显示图像内容,背光组件2还包括背板,控制器4和电源组件5设置于背板上,通常在背板上冲压形成一些凸包结构,控制器4和电源组件5通过螺钉或者挂钩固定在凸包上;后壳3盖设在面板1上,以共同隐藏背光组件2、控制器4和电源组件5等显示设备的零部件,起到美观的效果;底座6,用于支撑显示设备。Among them, in the display device with a single display screen as shown in FIG. 3b, the display device includes: a panel 1, a backlight assembly 2, a rear housing 3, a controller 4, a power supply assembly 5, and a base 6. Among them, the panel 1 is used to present images to the user; the backlight assembly 2 is located under the panel 1, usually some optical components, used to supply sufficient brightness and uniformly distributed light sources, so that the panel 1 can display image content normally, and the backlight assembly 2 It also includes a backplane. The controller 4 and the power supply assembly 5 are arranged on the backplane, and some convex structures are usually stamped on the backplane. The controller 4 and the power supply assembly 5 are fixed on the convex hull by screws or hooks; the rear shell 3 The cover is arranged on the panel 1 to jointly hide the backlight assembly 2, the controller 4 and the power supply assembly 5 and other display device components, which has a beautiful effect; the base 6 is used to support the display device.
其中,控制器4和电源组件5可以单独设置在一个板子上,也可以共同设置在一个板子上,也可以与背光组件共同设置在一个板子上,具体可以根据实际需求进行设置,本申请对此不做限定。为了便于说明,图3b中,控制器4和电源组件5共同设置在一个板上。Among them, the controller 4 and the power supply assembly 5 can be separately arranged on a board, can also be arranged on the same board together, or can be arranged on the same board together with the backlight assembly, which can be set according to actual needs. Not limited. For ease of description, in FIG. 3b, the controller 4 and the power supply assembly 5 are jointly arranged on a board.
另外,显示设备200还包括声音再现装置(图中未示出)例如音响组件,如包括功率放大器(Amplifier,AMP)及扬声器(Speaker)的I2S接口等,用于实现声音的再现。通常音响组件至少能够实现两个声道的声音输出;当要实现全景声环绕的效果,则需要设置多个音响组件,输出多个声道的声音,这里不再具体展开说明。In addition, the display device 200 also includes a sound reproduction device (not shown in the figure), such as an audio component, such as an I2S interface including a power amplifier (AMP) and a speaker (Speaker), for realizing sound reproduction. Generally, audio components can achieve sound output of at least two channels; when the panoramic sound surround effect is to be achieved, multiple audio components need to be set to output multiple channels of sound, which will not be described in detail here.
需要说明的是,显示设备200还可以采用OLED显示屏,这样,显示设备200所包含的模板发生相应的改变,此处不做过多说明。It should be noted that the display device 200 may also adopt an OLED display screen. In this way, the template included in the display device 200 will be changed accordingly, and no further description will be given here.
图4示出了电源板与负载的连接关系示意图,如图4所示,电源组件30包括输入端IN和输出端OUT(图中示出第一输出端OUT1、第二输出端OUT2、第三输出端OUT3、第四输出端OUT4和第五输出端OUT5),其中,输入端IN与交流电源AC(如市电)相连,输出端OUT与负载相连,比如,第一输出端OUT1和声音再现装置相连,第二输出端OUT2和第一面板11/第二面板21相连,第三输出端OUT3和第一背光组件12/第二背光组件22相连,第四输出端 OUT4和第一控制器14/第二控制器15相连,第五输出端OUT5和第一显示驱动电路16/第二显示驱动电路24相连。其中,电源组件30需要将交流市电转换为负载所需求的直流电,并且,该直流电通常具有不同的规格,例如音响组件需要18V,第一控制器14需要12V/18V等。FIG. 4 shows a schematic diagram of the connection relationship between the power board and the load. As shown in FIG. 4, the power supply assembly 30 includes an input terminal IN and an output terminal OUT (the figure shows the first output terminal OUT1, the second output terminal OUT2, and the third output terminal OUT2. The output terminal OUT3, the fourth output terminal OUT4 and the fifth output terminal OUT5), wherein the input terminal IN is connected to an alternating current power supply AC (such as mains), and the output terminal OUT is connected to a load, for example, the first output terminal OUT1 and sound reproduction The device is connected, the second output terminal OUT2 is connected to the first panel 11/the second panel 21, the third output terminal OUT3 is connected to the first backlight assembly 12/the second backlight assembly 22, and the fourth output terminal OUT4 is connected to the first controller 14. /The second controller 15 is connected, and the fifth output terminal OUT5 is connected to the first display driving circuit 16/the second display driving circuit 24. Among them, the power supply assembly 30 needs to convert AC mains power into DC power required by the load, and the DC power usually has different specifications, for example, the audio component requires 18V, the first controller 14 requires 12V/18V, and so on.
为便于表述,以下将双硬件系统架构中的一个硬件系统称为第一硬件系统或第一控制器,并将另一个硬件系统称为第二硬件系统或第二控制器。第一控制器包含第一控制器的各类处理器、各类接口,及通过各类接口与第一控制器相连的各类模块,第二控制器则包含第二控制器的各类处理器、各类接口,及通过各类接口与第二控制器相连的各类模块。For ease of description, in the following, one hardware system in the dual hardware system architecture is referred to as the first hardware system or the first controller, and the other hardware system is referred to as the second hardware system or the second controller. The first controller includes various processors of the first controller, various interfaces, and various modules connected to the first controller through various interfaces, and the second controller includes various processors of the second controller , Various interfaces, and various modules connected to the second controller through various interfaces.
第一控制器及第二控制器中可以各自安装有相对独立的操作系统,第一控制器的操作系统和第二控制器的操作系统可以通过通信协议相互通信,示例性的:第一控制器的操作系统的framework层和第二控制器的操作系统的framework层可以进行通信进行命令和数据的传输,从而使显示设备200中存在两个在独立但又存在相互关联的子系统。A relatively independent operating system may be installed in the first controller and the second controller, and the operating system of the first controller and the operating system of the second controller may communicate with each other through a communication protocol, for example: the first controller The framework layer of the operating system of the second controller and the framework layer of the operating system of the second controller can communicate for command and data transmission, so that there are two independent but interrelated subsystems in the display device 200.
下面结合图5对本申请双硬件系统架构进行在一些实施例中说明。需要说明的是图5仅仅是对本申请双硬件系统架构的一个示例性说明,并不表示对本申请的限定。在实际应用中,两个硬件系统均可根据需要包含更多或更少的硬件或接口。The following describes the dual hardware system architecture of the present application in some embodiments with reference to FIG. 5. It should be noted that FIG. 5 is only an exemplary description of the dual hardware system architecture of the present application, and does not represent a limitation to the present application. In practical applications, both hardware systems can contain more or less hardware or interfaces as required.
图5中示例性示出了根据图3所示显示设备200的硬件架构框图。如图5所示,显示设备200的硬件系统以包括第一控制器210和第二控制器310,以及通过各类接口与第一控制器210或第二控制器310相连接的模块。FIG. 5 exemplarily shows a block diagram of the hardware architecture of the display device 200 shown in FIG. 3. As shown in FIG. 5, the hardware system of the display device 200 includes a first controller 210 and a second controller 310, and modules connected to the first controller 210 or the second controller 310 through various interfaces.
在一些实施例中:第二控制器310可以用于接收第一控制器210发送的指 令,并控制第二显示屏380显示相应的图像。In some embodiments, the second controller 310 may be used to receive instructions sent by the first controller 210 and control the second display screen 380 to display corresponding images.
与第一控制器210连接的模块可以包括调谐解调器220、通信器230、外部装置接口25、存储器290、用户输入接口260-3、视频处理器260-1、音频处理器260-2、第一显示屏280(即图1中的第一显示屏201)、音频输出接口270、供电模块240。在其他实施例中,第一控制器210也可以连接更多或更少的模块。The modules connected to the first controller 210 may include a tuner and demodulator 220, a communicator 230, an external device interface 25, a memory 290, a user input interface 260-3, a video processor 260-1, an audio processor 260-2, The first display screen 280 (that is, the first display screen 201 in FIG. 1 ), the audio output interface 270, and the power supply module 240. In other embodiments, the first controller 210 may also be connected with more or fewer modules.
其中,调谐解调器220,用于对通过有线或无线方式接收广播电视信号,进行放大、混频和谐振等调制解调处理,从而从多个无线或有线广播电视信号中解调出用户所选择电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据信号)。根据电视信号广播制式不同,调谐解调器220的信号途径可以有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,所述信号的调整方式可以数字调制方式,也可以模拟调制方式;以及根据接收电视信号种类不同,调谐解调器220可以解调模拟信号和/或数字信号。Among them, the tuner and demodulator 220 is used to perform modulation and demodulation processing such as amplification, mixing, and resonance on the broadcast and television signals received through wired or wireless methods, so as to demodulate the user’s information from multiple wireless or cable broadcast and television signals. Select the audio and video signals carried in the frequency of the TV channel, as well as additional information (such as EPG data signals). According to different television signal broadcasting systems, the signal path of the tuner and demodulator 220 can have many kinds, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and according to different modulation types, the signal adjustment method can be digitally modulated The method may also be an analog modulation method; and according to different types of received television signals, the tuner demodulator 220 may demodulate analog signals and/or digital signals.
调谐解调器220,还用于根据用户选择,以及由第一控制器210控制,响应用户选择的电视频道频率以及该频率所携带的电视信号。The tuner and demodulator 220 is also used to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency according to the user's selection and control by the first controller 210.
在其他一些示例性实施例中,调谐解调器220也可在外置设备中,如外置机顶盒等。这样,机顶盒通过调制解调后输出电视音视频信号,经过外部装置接口250输入至显示设备200中。In some other exemplary embodiments, the tuner demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the external device interface 250.
通信器230是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信器230可以包括WIFI模块231,蓝牙通信协议模块232,有线以太网通信协议模块233,及红外通信协议模块等其他网络通信协议模块 或近场通信协议模块(图中未示出)。The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules (not shown in the figure).
显示设备200可以通过通信器230与外部控制设备或内容提供设备之间建立控制信号和数据信号的连接。例如,通信器可根据第一控制器210的控制接收遥控器100的控制信号。The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive a control signal of the remote controller 100 according to the control of the first controller 210.
外部装置接口250,是提供第一控制器210和外部其他设备间数据传输的组件。外部装置接口250可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等的外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。The external device interface 250 is a component that provides data transmission between the first controller 210 and other external devices. The external device interface 250 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG) and other data.
其中,外部装置接口250可以包括:高清多媒体接口(HDMI)端子也称之为HDMI 251、复合视频消隐同步(CVBS)端子也称之为AV 252、模拟或数字分量端子也称之为分量253、通用串行总线(USB)端子254、红绿蓝(RGB)端子(图中未示出)等任一个或多个。本申请不对外部装置接口的数量和类型进行限制。Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal is also called HDMI 251, a composite video blanking synchronization (CVBS) terminal is also called AV 252, and an analog or digital component terminal is also called component 253. , Any one or more of universal serial bus (USB) terminals 254, red, green and blue (RGB) terminals (not shown in the figure), etc. This application does not limit the number and types of external device interfaces.
第一控制器210,通过运行存储在存储器290上的各种软件控制程序(如操作系统和/或各种应用程序),来控制显示设备200的工作和响应用户的操作。The first controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and/or various application programs) stored on the memory 290.
如图5所示,第一控制器210包括只读存储器RAM 213、随机存取存储器ROM 214、图形处理器216、CPU处理器212、通信接口218、以及通信总线。其中,RAM 213和ROM 214以及图形处理器216、CPU处理器212、通信接口218通过总线相连接。As shown in FIG. 5, the first controller 210 includes a read-only memory RAM 213, a random access memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, the RAM 213 and the ROM 214, the graphics processor 216, the CPU processor 212, and the communication interface 218 are connected by a bus.
ROM 213,用于存储各种系统启动的指令。如在收到开机信号时,显示设备200电源开始启动,CPU处理器212运行ROM中系统启动指令,将存储在存储器290的操作系统拷贝至RAM 214中,以开始运行启动操作系统。当操作 系统启动完成后,CPU处理器212再将存储器290中各种应用程序拷贝至RAM 214中,然后,开始运行启动各种应用程序。 ROM 213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the operating system. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.
图形处理器216,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在第一显示屏280上。The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to the display attributes. It also includes a renderer, which generates various objects obtained based on the arithmetic unit, and displays the result of the rendering on the first display screen 280.
CPU处理器212,用于执行存储在存储器290中操作系统和应用程序指令。以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various application programs, data and content, so as to finally display and play various audio and video content.
在一些示例性实施例中,CPU处理器212,可以包括多个处理器。所述多个处理器中可包括一个主处理器以及多个或一个子处理器。主处理器,用于在预加电模式中执行显示设备200一些操作,和/或在正常模式下显示画面的操作。多个或一个子处理器,用于执行在待机模式等状态下的一种操作。In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include one main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.
通信接口218,可包括第一接口218-1到第n接口218-n。这些接口可以是经由网络被连接到外部设备的网络接口。The communication interface 218 may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
第一控制器210可以控制显示设备200与第一显示屏280相关的操作。例如:响应于接收到用于选择在第一显示屏280上显示UI对象的用户命令,第一控制器210便可以执行与由用户命令选择的对象有关的操作。The first controller 210 may control operations of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display screen 280, the first controller 210 may perform an operation related to the object selected by the user command.
第一控制器210可以控制显示设备200与第二显示屏380相关的操作。例如:响应于接收到用于选择在第二显示屏380上显示UI对象的用户命令,第一控制器210便可以执行与由用户命令选择的对象有关的操作。The first controller 210 may control the operation of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display screen 380, the first controller 210 may perform an operation related to the object selected by the user command.
其中,所述对象可以是可选对象中的任何一个,例如超链接或图标。与所 选择的对象有关操作,例如:显示连接到超链接页面、文档、图像等操作,或者执行与图标相对应程序的操作。用于选择UI对象用户命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
存储器290,包括存储用于驱动和控制显示设备200的各种软件模块。如:存储器290中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等(图中未示出)。The memory 290 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure).
其中,基础模块是用于显示设备200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。检测模块是用于从各种传感器或用户输入接口中收集各种信息,并进行数模转换以及分析管理的管理模块。语音识别模块中包括语音解析模块和语音指令数据库模块。显示控制模块是用于控制第一显示屏280进行显示图像内容的模块,可以用于播放多媒体图像内容和UI界面等信息。通信模块,是用于与外部设备之间进行控制和数据通信的模块。浏览器模块,是用于执行浏览服务器之间数据通信的模块。服务模块,是用于提供各种服务以及各类应用程序在内的模块。Among them, the basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion, analysis and management. The voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the first display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.
同时,存储器290还用于存储接收外部数据和用户数据、各种用户界面中各个项目的图像以及焦点对象的视觉效果图等。At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.
用户输入接口260-3,用于将用户的输入信号发送给第一控制器210,或者,将从第一控制器210输出的信号传送给用户。示例性的,控制装置(例如移动终端或遥控器)可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户输入接口,再由用户输入接口260-3转送至第一控制器210;或者,控制装置可接收经第一控制器210处理从用户输入接口260-3 输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。The user input interface 260-3 is used to send a user's input signal to the first controller 210, or to transmit a signal output from the first controller 210 to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the input signal to the user input interface 260-3. The first controller 210; or, the control device may receive output signals such as audio, video, or data output from the user input interface 260-3 processed by the first controller 210, and display the received output signal or output the received output signal It is in the form of audio or vibration.
在一些实施例中,用户可在第一显示屏280上显示的图形用户界面(GUI)输入用户命令,则用户输入接口260-3通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口260-3通过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the first display screen 280, and the user input interface 260-3 receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface 260-3 recognizes the sound or gesture through a sensor to receive the user input command.
视频处理器260-1,用于接收视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在第一显示屏280上显示或播放的视频信号。The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal is directly displayed or played on the first display screen 280.
示例的,视频处理器260-1,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等(图中未示出)。Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc. (not shown in the figure).
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2,则解复用模块进行解复用成视频信号和音频信号等。Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频画面进行叠加混合处理,以生成可供显示的图像信号。An image synthesis module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator with the zoomed video image according to user input or by itself, so as to generate an image signal for display.
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的24Hz、25Hz、30Hz、60Hz视频的帧率转换为60Hz、120Hz或240Hz的帧率,其中,输入帧率可以与源视频流有关,输出帧率可以与显示设备的刷新率有关。显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示设备显示格式 的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be the same as the source The video stream is related, and the output frame rate can be related to the refresh rate of the display device. The display formatting module is used to change the signal output by the frame rate conversion module to a signal conforming to the display format of the display device, for example, format the signal output by the frame rate conversion module to output RGB data signals.
第一显示屏280,用于接收源自视频处理器260-1输入的图像信号,进行显示视频内容和图像以及菜单操控界面第一显示屏280包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。显示视频内容,可以来自调谐解调器220接收的广播信号中的视频,也可以来自通信器或外部设备接口输入的视频内容。第一显示屏280,同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。The first display screen 280 is used to receive the image signal input from the video processor 260-1, display video content and images, and the menu control interface. The first display screen 280 includes a display screen component for presenting images and driving image display Drive components. The displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the interface of an external device. The first display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
以及,根据第一显示屏280类型不同,还包括用于驱动显示的驱动组件。或者,倘若第一显示屏280为一种投影显示屏,还可以包括一种投影装置和投影屏幕。And, depending on the type of the first display screen 280, it also includes a driving component for driving the display. Alternatively, if the first display screen 280 is a projection display screen, it may also include a projection device and a projection screen.
音频处理器260-2,用于接收音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换和放大处理等音频数据处理,得到可以在扬声器272中播放的音频信号。The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be played in the speaker 272 Audio signal.
音频输出接口270,用于在第一控制器210的控制下接收音频处理器260-2输出的音频信号,音频输出接口可包括扬声器272,或输出至外接设备的发生装置的外接音响输出端子274,如:外接音响端子或耳机输出端子等。The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the first controller 210. The audio output interface may include a speaker 272, or output to an external audio output terminal 274 of a generator of an external device , Such as: external audio terminal or headphone output terminal, etc.
在其他一些示例性实施例中,视频处理器260-1可以包括一个或多个芯片组成。音频处理器260-2,也可以包括一个或多个芯片组成。In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.
以及,在其他一些示例性实施例中,视频处理器260-1和音频处理器260-2,可以为单独的芯片,也可以与第一控制器210一起集成在一个或多个芯片中。And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the first controller 210 in one or more chips.
供电模块240,用于在第一控制器210控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电模块240可以包括安装显示设备200内 部的内置电源电路,也可以是安装在显示设备200外部的电源,如在显示设备200中提供外接电源的电源接口。The power supply module 240 is configured to provide power supply support for the display device 200 with power input from an external power supply under the control of the first controller 210. The power supply module 240 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
与第一控制器210相类似,如图5所示,与第二控制器310连接的模块可以包括通信器330、检测器340、存储器390、第二显示屏380(即图1中的第二显示屏202)。在某些实施例中还可以包括用户输入接口、视频处理器、音频处理器、显示屏、音频输出接口(图中未示出)。在某些实施例中,也可以存在独立为第二控制器310供电的供电模块(图中未示出)。Similar to the first controller 210, as shown in FIG. 5, the modules connected to the second controller 310 may include a communicator 330, a detector 340, a memory 390, and a second display screen 380 (that is, the second display in FIG. 1 Display 202). In some embodiments, it may also include a user input interface, a video processor, an audio processor, a display screen, and an audio output interface (not shown in the figure). In some embodiments, there may also be a power supply module (not shown in the figure) that independently supplies power to the second controller 310.
通信器330是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信器330可以包括WIFI模块331,蓝牙通信协议模块332,有线以太网通信协议模块333,及红外通信协议模块等其他网络通信协议模块或近场通信协议模块(图中未示出)。The communicator 330 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and an infrared communication protocol module and other network communication protocol modules or near field communication protocol modules (not shown in the figure).
通信器330和第一控制器210的通信器230也有相互交互。例如,第一控制器210硬件系统内的WiFi模块231用于连接外部网络,与外部服务器等产生网络通信。第二控制器310硬件系统内的WiFi模块331用于连接至第一控制器210的WiFi模块231,而不与外界网络等产生直接连接,第二控制器310通过第一控制器210连接外部网络。因此,对于用户而言,一个如上述实施例中的显示设备至对外显示一个WiFi账号。The communicator 330 and the communicator 230 of the first controller 210 also interact with each other. For example, the WiFi module 231 in the hardware system of the first controller 210 is used to connect to an external network, and to generate network communication with an external server or the like. The WiFi module 331 in the hardware system of the second controller 310 is used to connect to the WiFi module 231 of the first controller 210 without direct connection with the external network, etc., and the second controller 310 connects to the external network through the first controller 210 . Therefore, for the user, a display device as in the above embodiment may display a WiFi account to the outside.
检测器340,是第二控制器310用于采集外部环境或与外部交互的信号的组件。检测器340可以包括光接收器342,用于采集环境光线强度的传感器,可以通过采集环境光来自适应显示参数变化等;还可以包括图像采集器341,如相机、摄像头等,可以用于采集外部环境场景,以及用于采集用户的属性或与用户交互手势,可以自适应变化显示参数,也可以识别用户手势,以实现与 用户之间互动的功能。The detector 340 is a component used by the second controller 310 to collect signals from the external environment or interact with the outside. The detector 340 may include a light receiver 342, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 341, such as a camera, a camera, etc., which can be used to collect external The environment scene, as well as the user's attributes or gestures used to interact with the user, can adaptively change the display parameters, and can also recognize the user's gestures to achieve the function of interaction with the user.
外部装置接口350,提供第二控制器310与第一控制器210或外部其他设备间数据传输的组件。外部装置接口可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等的外部设备连接。The external device interface 350 provides a component for data transmission between the second controller 310 and the first controller 210 or other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc., in a wired/wireless manner.
视频处理器360,用于处理相关视频信号。The video processor 360 is used to process related video signals.
第二控制器310,通过运行存储在存储器390上的各种软件控制程序(如用安装的第三方应用等),以及与第一控制器210的交互,来控制显示设备200的工作和响应用户的操作。The second controller 310 controls the work of the display device 200 and responds to the user by running various software control programs (such as installed third-party applications, etc.) stored on the memory 390 and interacting with the first controller 210. Operation.
如图5所示,第二控制器310包括只读存储器ROM 313、随机存取存储器RAM 314、图形处理器316、CPU处理器312、通信接口318、以及通信总线。其中,ROM 313和RAM 314以及图形处理器316、CPU处理器312、通信接口318通过总线相连接。As shown in FIG. 5, the second controller 310 includes a read-only memory ROM 313, a random access memory RAM 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. Among them, the ROM 313 and the RAM 314, the graphics processor 316, the CPU processor 312, and the communication interface 318 are connected by a bus.
ROM 313,用于存储各种系统启动的指令。CPU处理器312运行ROM中系统启动指令,将存储在存储器390的操作系统拷贝至RAM 314中,以开始运行启动操作系统。当操作系统启动完成后,CPU处理器312再将存储器390中各种应用程序拷贝至RAM 314中,然后,开始运行启动各种应用程序。 ROM 313, used to store various system startup instructions. The CPU processor 312 runs the system startup instruction in the ROM, and copies the operating system stored in the memory 390 to the RAM 314 to start the operating system. After the operating system is started, the CPU processor 312 copies the various application programs in the memory 390 to the RAM 314, and then starts to run and start the various application programs.
CPU处理器312,用于执行存储在存储器390中操作系统和应用程序指令,和与第一控制器210进行通信、信号、数据、指令等传输与交互,以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。The CPU processor 312 is used to execute operating system and application instructions stored in the memory 390, communicate with the first controller 210, transmit and interact with signals, data, instructions, etc., and receive various interactive instructions from external inputs. , To execute a variety of applications, data and content, in order to finally display and play a variety of audio and video content.
通信接口318为多个,可包括第一接口318-1到第n接口318-n。这些接口可以是经由网络被连接到外部设备的网络接口,也可以是经由网络被连接到 第一控制器210的网络接口。There are multiple communication interfaces 318, which may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or network interfaces connected to the first controller 210 via a network.
第二控制器310可以控制显示设备200与第二显示屏380相关的操作。例如:响应于接收到用于选择在第二显示屏380上显示UI对象的用户命令,第二控制器310便可以执行与由用户命令选择的对象有关的操作。The second controller 310 may control operations of the display device 200 related to the second display screen 380. For example, in response to receiving a user command for selecting a UI object to be displayed on the second display screen 380, the second controller 310 may perform an operation related to the object selected by the user command.
第二控制器310可以控制显示设备200与第一显示屏280相关的操作。例如:响应于接收到用于选择在第一显示屏280上显示UI对象的用户命令,第一控制器210便可以执行与由用户命令选择的对象有关的操作。The second controller 310 may control the operation of the display device 200 related to the first display screen 280. For example, in response to receiving a user command for selecting a UI object to be displayed on the first display screen 280, the first controller 210 may perform an operation related to the object selected by the user command.
图形处理器316,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在第二显示屏380上。The graphics processor 316 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to the display attributes. It also includes a renderer, which generates various objects obtained based on the arithmetic unit, and displays the result of the rendering on the second display screen 380.
第二控制器310的图形处理器316与第一控制器210的图形处理器216均能产生各种图形对象。区别性的,若应用1安装于第二控制器310,应用2安装在第一控制器210,当用户在应用1的界面,且在应用1内进行用户输入的指令时,由第二控制器310的图形处理器316产生图形对象。当用户在应用2的界面,且在应用2内进行用户输入的指令时,由第一控制器210的图形处理器216产生图形对象。Both the graphics processor 316 of the second controller 310 and the graphics processor 216 of the first controller 210 can generate various graphics objects. Differentily, if application 1 is installed in the second controller 310 and application 2 is installed in the first controller 210, when the user is on the interface of application 1, and the user inputs instructions in the application 1, the second controller The graphics processor 316 of 310 generates graphics objects. When the user is on the interface of the application 2 and performs the user-input instruction in the application 2, the graphics processor 216 of the first controller 210 generates a graphic object.
图6中示例性示出了根据示例性实施例中显示设备的功能配置示意图。Fig. 6 exemplarily shows a schematic diagram of a functional configuration of a display device according to an exemplary embodiment.
如图6所示,第二控制器310的存储器390和第一控制器210的存储器290分别用于存储操作系统、应用程序、内容和用户数据等,在第二控制器310和第一控制器210的控制下执行驱动第一显示屏280和第二显示屏380的系统运行以及响应用户的各种操作。存储器390和存储器290可以包括易失性和/或非 易失性存储器。As shown in FIG. 6, the memory 390 of the second controller 310 and the memory 290 of the first controller 210 are respectively used to store an operating system, application programs, content, and user data. Under the control of 210, the system operation of driving the first display screen 280 and the second display screen 380 and responding to various operations of the user are executed. The memory 390 and the memory 290 may include volatile and/or non-volatile memory.
对于存储器290,具体用于存储驱动显示设备200中第一控制器210的运行程序,以及存储显示设备200内置各种应用程序,以及用户从外部设备下载的各种应用程序、以及与应用程序相关的各种图形用户界面,以及与图形用户界面相关的各种对象,用户数据信息,以及各种支持应用程序的内部数据。存储器290用于存储操作系统(OS)内核、中间件和应用等系统软件,以及存储输入的视频数据和音频数据、及其他用户数据。The memory 290 is specifically used to store the operating program that drives the first controller 210 in the display device 200, and store various application programs built in the display device 200, various application programs downloaded by the user from an external device, and application related programs. A variety of graphical user interfaces, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as an operating system (OS) kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
存储器290,具体用于存储视频处理器260-1和音频处理器260-2、第一显示屏280、通信器230、调谐解调器220、输入/输出接口等驱动程序和相关数据。The memory 290 is specifically used to store driver programs and related data such as the video processor 260-1 and the audio processor 260-2, the first display screen 280, the communicator 230, the tuner and demodulator 220, and the input/output interface.
在一些实施例中,存储器290可以存储软件和/或程序,用于表示操作系统(OS)的软件程序包括,例如:内核、中间件、应用编程接口(API)和/或应用程序。示例性的,内核可控制或管理系统资源,或其它程序所实施的功能(如所述中间件、API或应用程序),以及内核可以提供接口,以允许中间件和API,或应用访问控制器,以实现控制或管理系统资源。In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , In order to achieve control or management of system resources.
示例的,存储器290,包括广播接收模块2901、频道控制模块2902、音量控制模块2903、图像控制模块2904、显示控制模块2905、第一音频控制模块2906、外部指令识别模块2907、通信控制模块2908、光接收模块2909、电力控制模块2910、操作系统2911、以及其他应用程序2912、浏览器模块2913等等。第一控制器210通过运行存储器290中各种软件程序,来执行诸如:广播电视信号接收解调功能、电视频道选择控制功能、音量选择控制功能、图像控制功能、显示控制功能、音频控制功能、外部指令识别功能、通信控制功能、 光信号接收功能、电力控制功能、支持各种功能的软件操控平台、以及浏览器功能等各类功能。For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, a first audio control module 2906, an external command recognition module 2907, a communication control module 2908, The light receiving module 2909, the power control module 2910, the operating system 2911, and other application programs 2912, the browser module 2913, and so on. The first controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, Various functions such as external command recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, and browser function.
存储器390,包括存储用于驱动和控制显示设备200的各种软件模块。如:存储器390中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等(图中未示出)。由于存储器390与存储器290的功能比较相似,相关之处参见存储器290即可,在此就不再赘述。The memory 390 includes storing various software modules used to drive and control the display device 200. For example, various software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules (not shown in the figure). Since the functions of the memory 390 and the memory 290 are relatively similar, please refer to the memory 290 for related parts, which will not be repeated here.
示例的,存储器390,包括图像控制模块3904、第二音频控制模块3906、外部指令识别模块3907、通信控制模块3908、光接收模块3909、操作系统3911、以及其他应用程序3912、浏览器模块3913等。第一控制器210通过运行存储器290中各种软件程序,来执行诸如:图像控制功能、显示控制功能、音频控制功能、外部指令识别功能、通信控制功能、光信号接收功能、电力控制功能、支持各种功能的软件操控平台、以及浏览器功能等各类功能。For example, the memory 390 includes an image control module 3904, a second audio control module 3906, an external command recognition module 3907, a communication control module 3908, an optical receiving module 3909, an operating system 3911, and other application programs 3912, a browser module 3913, etc. . The first controller 210 executes various software programs in the memory 290 such as: image control function, display control function, audio control function, external command recognition function, communication control function, light signal receiving function, power control function, support Various functions such as software control platform and browser functions.
区别性的,第一控制器210的外部指令识别模块2907和第二控制器310的外部指令识别模块3907可识别不同的指令。Differently, the external command recognition module 2907 of the first controller 210 and the external command recognition module 3907 of the second controller 310 can recognize different commands.
示例性的,在摄像头等图像接收设备与第二控制器310连接时,第二控制器310的外部指令识别模块3907可包括图形识别模块2907-1,图形识别模块3907-1内存储有图形数据库,摄像头接收到外界的图形指令时,与图形数据库中的指令进行对应关系,以对显示设备作出指令控制。而由于语音接收设备以及遥控器与第一控制器210连接,因此,第一控制器210的外部指令识别模块2907可包括语音识别模块2907-2,语音识别模块2907-2内存储有语音数据库,语音接收设备等接收到外界的语音指令或时,与语音数据库中的指令进行对应 关系,以对显示设备作出指令控制。同样的,遥控器等控制装置100与第一控制器210连接,由按键指令识别模块2907-3与控制装置100进行指令交互。Exemplarily, when an image receiving device such as a camera is connected to the second controller 310, the external command recognition module 3907 of the second controller 310 may include a graphic recognition module 2907-1, and the graphic recognition module 3907-1 stores a graphic database. , When the camera receives the graphics instruction from the outside world, it will correspond to the instruction in the graphics database to control the display device. Since the voice receiving device and the remote controller are connected to the first controller 210, the external command recognition module 2907 of the first controller 210 may include a voice recognition module 2907-2, and the voice recognition module 2907-2 stores a voice database. When the voice receiving device or the like receives a voice instruction from the outside world, it corresponds to the instruction in the voice database to control the display device. Similarly, the control device 100 such as a remote controller is connected to the first controller 210, and the key instruction recognition module 2907-3 interacts with the control device 100 in instructions.
图7中示例性示出了根据示例性实施例中显示设备200中软件系统的配置框图。FIG. 7 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.
对于第一控制器210,如图7中所示,操作系统2911,包括用于处理各种基础系统服务和用于实施硬件相关任务的执行操作软件,充当应用程序和硬件组件之间完成数据处理的媒介。For the first controller 210, as shown in FIG. 7, the operating system 2911 includes operating software for processing various basic system services and for implementing hardware-related tasks, acting as an application program and completing data processing between hardware components Medium.
一些实施例中,部分操作系统内核可以包含一系列软件,用以管理显示设备硬件资源,并为其他程序或软件代码提供服务。In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.
其他一些实施例中,部分操作系统内核可包含一个或多个设备驱动器,设备驱动器可以是操作系统中的一组软件代码,帮助操作或控制显示设备关联的设备或硬件。驱动器可以包含操作视频、音频和/或其他多媒体组件的代码。示例的,包括显示屏、摄像头、Flash、WiFi和音频驱动器。In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.
其中,可访问性模块2911-1,用于修改或访问应用程序,以实现应用程序的可访问性和对其显示内容的可操作性。Among them, the accessibility module 2911-1 is used to modify or access the application program to realize the accessibility of the application program and the operability of its display content.
通信模块2911-2,用于经由相关通信接口和通信网络与其他外设的连接。The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.
用户界面模块2911-3,用于提供显示用户界面的对象,以供各应用程序访问,可实现用户可操作性。The user interface module 2911-3 is used to provide objects that display user interfaces for access by various applications, and can realize user operability.
控制应用程序2911-4,用于控制进程管理,包括运行时间应用程序等。The control application 2911-4 is used to control process management, including runtime applications.
事件传输系统2914,可在操作系统2911内或应用程序2912中实现。一些实施例中,一方面在在操作系统2911内实现,同时在应用程序2912中实现,用于监听各种用户输入事件,将根据各种事件指代响应各类事件或子事件的识 别结果,而实施一组或多组预定义的操作的处理程序。The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.
其中,事件监听模块2914-1,用于监听用户输入接口输入事件或子事件。Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
事件识别模块2914-2,用于对各种用户输入接口输入各类事件的定义,识别出各种事件或子事件,且将其传输给处理用以执行其相应一组或多组的处理程序。The event recognition module 2914-2 is used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute their corresponding one or more sets of processing procedures .
其中,事件或子事件,是指显示设备200中一个或多个传感器检测的输入,以及外界控制设备(如控制装置100等)的输入。如:语音输入各种子事件,手势识别的手势输入子事件,以及控制装置的遥控按键指令输入的子事件等。示例的,遥控器中一个或多个子事件包括多种形式,包括但不限于按键按上/下/左右/、确定键、按键按住等中一个或组合。以及非实体按键的操作,如移动、按住、释放等操作。The event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100, etc.). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key. And the operations of non-physical keys, such as moving, pressing, and releasing.
界面布局管理模块2913,直接或间接接收来自于事件传输系统2914监听到各用户输入事件或子事件,用于更新用户界面的布局,包括但不限于界面中各控件或子控件的位置,以及容器的大小或位置、层级等与界面布局相关各种执行操作。The interface layout management module 2913, which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size, position, level, etc. of the interface are related to the various execution operations of the interface layout.
由于第而控制器310的操作系统3911与第一控制器210的操作系统2911的功能比较相似,相关之处参见操作系统2911即可,在此就不再赘述。Since the functions of the operating system 3911 of the first controller 310 and the operating system 2911 of the first controller 210 are relatively similar, please refer to the operating system 2911 for related details, which will not be repeated here.
如图8中所示,显示设备的应用程序层包含可在显示设备200执行的各种应用程序。As shown in FIG. 8, the application layer of the display device includes various application programs that can be executed on the display device 200.
第一控制器210的应用程序层2912可包含但不限于一个或多个应用程序,如:视频点播应用程序、应用程序中心、游戏应用等。第二控制器310的应用程序层3912可包含但不限于一个或多个应用程序,如:直播电视应用程序、媒 体中心应用程序等。需要说明的是,第二控制器310和第一控制器210上分别包含什么应用程序是根据操作系统和其他设计确定的,本申请无需对第二控制器310和第一控制器210上所包含的应用程序做具体的限定和划分。The application layer 2912 of the first controller 210 may include, but is not limited to, one or more applications, such as: video-on-demand application, application center, game application, and so on. The application layer 3912 of the second controller 310 may include, but is not limited to, one or more applications, such as a live TV application, a media center application, and so on. It should be noted that the application programs included in the second controller 310 and the first controller 210 are determined according to the operating system and other designs. This application does not need to determine the application programs included in the second controller 310 and the first controller 210. The application program is specifically defined and divided.
直播电视应用程序,可以通过不同的信号源提供直播电视。例如,直播电视应用程可以使用来自有线电视、无线广播、卫星服务或其他类型的直播电视服务的输入提供电视信号。以及,直播电视应用程序可在显示设备200上显示直播电视信号的视频。Live TV applications can provide live TV through different sources. For example, a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the display device 200.
视频点播应用程序,可以提供来自不同存储源的视频。不同于直播电视应用程序,视频点播提供来自某些存储源的视频显示。例如,视频点播可以来自云存储的服务器端、来自包含已存视频节目的本地硬盘储存器。Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.
媒体中心应用程序,可以提供各种多媒体内容播放的应用程序。例如,媒体中心,可以为不同于直播电视或视频点播,用户可通过媒体中心应用程序访问各种图像或音频所提供服务。Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.
应用程序中心,可以提供储存各种应用程序。应用程序可以是一种游戏、应用程序,或某些和计算机系统或其他设备相关但可以在显示设备中运行的其他应用程序。应用程序中心可从不同来源获得这些应用程序,将它们储存在本地储存器中,然后在显示设备200上可运行。Application center, can provide storage of various applications. The application program can be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.
由于第二控制器310及第一控制器210中可能分别安装有独立的操作系统,从而使显示设备200中存在两个在独立但又存在相互关联的子系统。例如,第二控制器310与第一控制器210均可以独立安装有安卓(Android)及各类APP,均可以实现一定的功能,并且使第二控制器310与第一控制器210协同实现某项功能。Since the second controller 310 and the first controller 210 may be respectively installed with independent operating systems, there are two independent but related sub-systems in the display device 200. For example, both the second controller 310 and the first controller 210 can be independently installed with Android (Android) and various APPs, both of which can realize certain functions, and the second controller 310 and the first controller 210 can cooperate to realize certain functions. Item function.
图9中示例性示出了根据示例性实施例中显示设备200中用户界面的示意图。如图9所示,用户界面包括视第一视图显示区2011和第二图显示区2021。第一视图显示区2011和第二视图显示区2021的功能实现基本相同,下面仅对第一视图显示区2011进行重点说明。示例的,其中,第一视图显示区2011包括布局一个或多个不同项目。以及,用户界面中还包括指示项目被选择的选择器,可通过用户输入而移动选择器的位置,以改变选择不同的项目。FIG. 9 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 9, the user interface includes a first view display area 2011 and a second view display area 2021. The functions of the first view display area 2011 and the second view display area 2021 are basically the same. The following only focuses on the first view display area 2011. For example, the first view display area 2011 includes one or more different items in the layout. And, the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.
一些实施例中,第一视图显示区2011为可缩放视图显示。“可缩放”,可以表示第一视图显示区2011在屏幕上尺寸或占比是可缩放的,或视图显示201中项目在屏幕上尺寸或占比是可缩放的。In some embodiments, the first view display area 2011 is a zoomable view display. "Scalable" may indicate that the size or proportion of the first view display area 2011 on the screen is scalable, or that the size or proportion of the items in the view display 201 on the screen is scalable.
“项目”是指在显示设备200中用户界面的视图显示区中显示以表示,诸如图标、缩略图、视频剪辑等对应内容的视觉对象。例如:项目可以表示电影、电视剧的图像内容或视频剪辑、音乐的音频内容、应用程序,或其他用户访问内容历史信息。"Items" refer to visual objects displayed in the view display area of the user interface in the display device 200 to represent corresponding content such as icons, thumbnails, and video clips. For example, an item can represent image content or video clips of movies, TV series, audio content of music, applications, or other user access content history information.
此外,项目可以表示显示设备200与外接设备连接的接口或接口集合显示,或可表示连接至显示设备的外部设备名称等。如:信号源输入接口集合、或高清多媒体接口(High Definition Multimedia Interface,HDMI)、USB接口、PC端子接口等。In addition, the item may indicate an interface or a set display of interfaces connected to the display device 200 and an external device, or may indicate the name of an external device connected to the display device, or the like. Such as: signal source input interface collection, or high-definition multimedia interface (High Definition Multimedia Interface, HDMI), USB interface, PC terminal interface, etc.
需要说明的是:视图显示区可呈现视频聊天项目内容,或者呈现应用层项目内容(如,网页视频、云点播(Video on Demand,VOD)展示、应用程序画面等)。It should be noted that: the view display area can present the content of the video chat project or the content of the application layer project (for example, webpage video, video on demand (VOD) display, application program screen, etc.).
“选择器”用于指示其中任意项目已被选择,如:光标或焦点对象。根据用户在显示设备200中触摸的图标或菜单位置来定位选择信息输入,可使显示设 备200中显示焦点对象的移动来选择控制项目,可选择或控制其中一个或多个项目。"Selector" is used to indicate that any item has been selected, such as cursor or focus object. The selection information input is positioned according to the icon or menu position touched by the user in the display device 200, and the movement of the focus object displayed in the display device 200 can be used to select the control item, and one or more items can be selected or controlled.
焦点对象指根据用户输入在项目之间移动的对象。示例的,通过项目边缘绘制粗线来实现或标识焦点对象位置。在其他实施例中,焦点形式不限于示例,可以是光标等有形或无形可被用户识别的形态,如可以项目的3D变形等形式,也可以改变聚焦的项目的文本或图像的边框线、尺寸、颜色、透明度和轮廓和/或字体等标识。The focus object refers to the object that moves between items based on user input. For example, draw a thick line on the edge of the item to realize or identify the position of the focus object. In other embodiments, the focus form is not limited to examples, it can be a tangible or intangible form that can be recognized by the user such as a cursor, such as a 3D deformation of the item, and the border line and size of the text or image of the focused item can also be changed. , Color, transparency and outline and/or font.
事件传输系统2914,可监听到的各预定义的事件或子事件的用户输入,将识别出事件或子事件的控制直接或间接提供给界面布局管理模块2913。The event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provide the interface layout management module 2913 with the control of the recognized event or sub-event.
界面布局管理模块2913,用于用户界面状态(包括视图分区、项目、焦点或光标对象等位置和/或大小、变化过程等)的监控,以及根据该事件或子事件,可执行修改视图显示区的大小和位置、层级等布局,和/或,调整或修改视图显示区各类项目布局的大小或/和位置、数量、类型、内容等布局。一些实施例中,修改和调整布局,包括在屏幕上显示或不显示各视图分区或视图分区中项目内容。The interface layout management module 2913 is used to monitor the state of the user interface (including the position and/or size, change process, etc. of the view partition, item, focus or cursor object, etc.), and according to the event or sub-event, the view display area can be modified The size, position, and level of the layout, and/or, adjust or modify the size or/and position, quantity, type, content, etc. of the layout of various items in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.
用户输入接口,用于将用户的输入信号发送给控制器,或者,将从控制器输出的信号传送给用户。示例性的,控制装置(例如移动终端或遥控器)可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户输入接口,再由用户输入接口转送至控制器;或者,控制装置可接收经控制器处理从用户输入接口输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。The user input interface is used to send the user's input signal to the controller, or to transmit the signal output from the controller to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then forward the user input interface to the controller; Alternatively, the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal in the form of audio or vibration.
在一些实施例中,用户可在显示设备200上显示的用户界面输入用户命令, 则用户输入接口通过用户界面接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the user may input a user command on the user interface displayed on the display device 200, and the user input interface receives the user input command through the user interface. Alternatively, the user may input a user command by inputting a specific voice or gesture, and the user input interface recognizes the voice or gesture through the sensor to receive the user input command.
“用户界面”,是应用程序或操作系统与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(graphicuserinterface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、控件等界面元素,其中控件可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。"User interface" is a medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of the user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of an electronic device. The control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc. Visual interface elements.
图10-图12示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图。10-12 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment.
如图10至图11所示,第一显示屏(具体为第一视图显示区2011)中显示视频画面,该视频画面可以是电影、电视剧的图像内容、视频剪辑或者应用程序中的视频画面等。同时,控制器接收到来电请求,控制器响应于来电请求,在第二显示屏(具体为第二视图显示区2021)上显示来电提醒画面。该来电提醒画面包括用于指示接通来电请求的选项卡和用于拒绝来电请求的选项卡。As shown in Figures 10 to 11, the first display screen (specifically, the first view display area 2011) displays a video screen, which can be the image content of a movie, a TV series, a video clip, or a video screen in an application, etc. . At the same time, the controller receives the incoming call request, and in response to the incoming call request, the controller displays the incoming call reminder screen on the second display screen (specifically, the second view display area 2021). The incoming call reminder screen includes a tab for instructing to connect the incoming call request and a tab for rejecting the incoming call request.
控制器在第二显示屏上显示来电提醒画面后,可以按照以下两种可选方式中的任意一种执行。After the controller displays the incoming call reminder screen on the second display screen, it can execute it in any of the following two optional ways.
第一种可选方式中,控制器响应于用户输入的接通来电请求的选项卡,在第一显示屏显示聊天画面。进一步的,控制器还可以响应于用户的小窗视频通话指示,在第二显示屏,或者在第一显示屏的目标区域显示小窗视频通话画面。In the first optional manner, the controller displays the chat screen on the first display screen in response to the tab of the call connection request input by the user. Further, the controller may also display a small window video call screen on the second display screen or in the target area of the first display screen in response to the user's small window video call instruction.
其中,用户输入的接通来电请求的选项卡,也可以称为用户输入的接通来 电请求的指示。Among them, the option card of the request to connect to the incoming call input by the user may also be referred to as the indication of the request to connect to the incoming call input by the user.
第二种可选方式中,控制器响应于用户输入的接通来电请求的选项卡,控制第二显示屏呈现聊天画面。进一步的,控制器还可以响应于用户对聊天画面的选择,控制聊天画面从第二显示屏切换至第一显示屏。In the second optional manner, the controller controls the second display screen to present the chat screen in response to the tab for the call connection request input by the user. Further, the controller can also control the chat screen to switch from the second display screen to the first display screen in response to the user's selection of the chat screen.
上述两种方式中,接通来电请求例如可以指接听视频来电,聊天画面例如可以指视频通话画面。In the above two methods, the incoming call connection request may refer to answering a video call, for example, and the chat screen may refer to a video call screen, for example.
值得说明的是,本申请实施例中,控制器的数量可以为一个,也可以为多个。控制器为一个时,由该一个控制器在第一显示屏显示视频画面时接收来电请求,并在第二显示屏显示来电提醒画面。控制器为多个时,通过各控制器之间协作交互完成第一显示屏显示视频画面时在第二显示屏显示来电提醒画面。一种实施例中,控制器可以包括第一控制器和第二控制器,第一控制器用于在第一显示屏显示视频画面时接收来电请求,并向第二控制器发送来电指示,第二控制器用于接收来电指示,并在第二显示屏显示来电提醒画面。本申请以下实施例均以控制器包括第一控制器和第二控制器为例进行说明,但这并不能作为对本申请的限制。It is worth noting that, in the embodiment of the present application, the number of controllers may be one or multiple. When there is one controller, the one controller receives the incoming call request when the first display screen displays the video image, and displays the incoming call reminder image on the second display screen. When there are multiple controllers, the call reminder screen is displayed on the second screen when the video screen is displayed on the first screen through collaboration and interaction between the controllers. In an embodiment, the controller may include a first controller and a second controller. The first controller is configured to receive an incoming call request when the video screen is displayed on the first display screen and send an incoming call indication to the second controller. The controller is used to receive the incoming call indication and display the incoming call reminder screen on the second display screen. The following embodiments of the present application are all described by taking the controller including the first controller and the second controller as an example, but this should not be regarded as a limitation to the present application.
参照图10,如果来电的类型为视频通话、游戏邀请等基于视频的来电,则第二控制器在第二视图显示区2021中显示的来电提醒画面中可以包括来电者肖像、姓名、来电提示语、接听视频按钮、仅接听语音按钮、挂断按钮等项目,同时,第二控制器将焦点对象定位在接听视频按钮上。10, if the type of the incoming call is a video-based incoming call such as a video call, a game invitation, etc., the incoming call reminder screen displayed in the second view display area 2021 by the second controller may include the caller's portrait, name, and incoming call prompt. , Answer video button, answer voice only button, hang up button, etc. At the same time, the second controller positions the focus object on the answer video button.
参照图11,如果来电的类型为语音通话,则第二控制器在第二视图显示区2021中显示的来电提醒画面中可以包括来电者肖像、姓名、来电提示语、接听语音按钮、挂断按钮等项目,同时,第二控制器将焦点对象定位在接听语音按 钮上。用户可以通过操作遥控器上的向左键、向右键移动焦点对象,以选择按钮,并按下OK键以进行确认。11, if the type of the incoming call is a voice call, the incoming call reminder screen displayed in the second view display area 2021 by the second controller may include the caller's portrait, name, incoming call reminder, answer voice button, and hang up button. Wait for items, and at the same time, the second controller positions the focus object on the answer voice button. The user can move the focus object by operating the left and right keys on the remote control to select a button, and press the OK key to confirm.
以上述第一种可选方式为例,如果焦点对象定位在图10的接听视频按钮时用户按下OK键,则一种实施例中,第一显示屏和第二显示屏可以显示图13或图14所示的画面。其中,图13为视频通话参与方为六方的示意图,图14为视频通话参与方为两方的示意图,在图13或图14所示画面中,用户可以按下悬浮小窗按钮,画面可以切换至图17所示的画面,或者,用户可以按下切换布局按钮,画面可以切换至图18所示的画面。另一种可选方式中,第一显示屏和第二显示屏可以显示图17或图18所示的画面,用户可以按下某个特定菜单键,例如OK键,画面可以切换至图13或图14所示的画面。Taking the above-mentioned first alternative method as an example, if the user presses the OK key when the focus object is positioned on the answer video button in FIG. 10, then in an embodiment, the first display screen and the second display screen can display FIG. 13 or The screen shown in Figure 14. Among them, Figure 13 is a schematic diagram of six parties in a video call, and Figure 14 is a schematic diagram of two parties in a video call. In the screen shown in Figure 13 or Figure 14, the user can press the floating window button and the screen can be switched. To the screen shown in Figure 17, or the user can press the switch layout button, the screen can be switched to the screen shown in Figure 18. In another alternative, the first display screen and the second display screen can display the screen shown in Figure 17 or Figure 18. The user can press a specific menu key, such as the OK key, and the screen can be switched to Figure 13 or The screen shown in Figure 14.
如果焦点对象定位在图10的仅接听语音按钮上,则第一显示屏和第二显示屏可以显示图15所示的画面。如图15所示,第一显示屏可以继续显示视频画面,在一些实施例中,此时可以暂停播放视频。第二显示屏可以显示语音通话的各方中除了当前用户的参与者的肖像。应理解,本申请实施例所述的当前用户是指显示设备对应的用户。同时,第二显示屏中在当前用户对应的位置显示为黑屏,并在黑屏之上叠加一个未开启视频的标志。If the focus object is positioned on the voice-only answer button in FIG. 10, the first display screen and the second display screen can display the screen shown in FIG. 15. As shown in FIG. 15, the first display screen can continue to display video images. In some embodiments, the video can be paused at this time. The second display screen may display portraits of participants other than the current user among the parties in the voice call. It should be understood that the current user described in the embodiment of the present application refers to a user corresponding to the display device. At the same time, the position corresponding to the current user in the second display screen is displayed as a black screen, and a sign indicating that the video is not started is superimposed on the black screen.
如果焦点对象定位在图11的接听按钮上,则第二显示屏上可以显示一个语音标志,用来标识当前正在进行语音通话。If the focus object is positioned on the answer button in FIG. 11, a voice logo may be displayed on the second display screen to identify that a voice call is currently in progress.
如果焦点对象定位在图10或图11的挂断按钮时用户按下OK键,则第一显示屏和第二显示屏可以显示图12所示的画面。图12显示的画面为未接收到来电请求以及结束语音通话或视频通话后的画面。如图12所示,第一显示屏可以继续播放视频,同时,第二显示屏可以显示语音助手、天气、日期以及时间 等信息。If the user presses the OK key when the focus object is positioned on the hang-up button of FIG. 10 or FIG. 11, the first display screen and the second display screen can display the screen shown in FIG. 12. The picture shown in FIG. 12 is the picture after not receiving the incoming call request and ending the voice call or video call. As shown in Figure 12, the first display screen can continue to play video, while the second display screen can display information such as voice assistant, weather, date, and time.
如前所述,图13和图14为视频通话时的示意图,以下分别说明。As mentioned above, Fig. 13 and Fig. 14 are schematic diagrams of a video call, which will be described separately below.
如图13所示,第一视图显示区2011中显示视频通话画面,视频通话画面中显示参与视频通话的六个参与方中每个参与方的视频,每个参与方的视频占据第一视图显示区2011的一部分区域。每个参与方的视频所在区域的左下角显示参与方的姓名,右下角显示参与方为静音状态或非静音状态。As shown in Figure 13, the video call screen is displayed in the first view display area 2011. The video call screen displays the video of each of the six participants participating in the video call, and the video of each participant occupies the first view. Part of district 2011. The lower left corner of the area where the video of each participant is located displays the name of the participant, and the lower right corner displays whether the participant is muted or non-muted.
示例性的,用户A的视频显示在第一视图显示区的左上角的区域。在用户A对应的区域中,用户A的图像填充整个区域,同时,在图像之上,区域的左下角叠加显示用户A的姓名,区域的右下角叠加显示用户A当前正在静音的标志。同时,在各参与方的视频之上,以半透明形式显示供用户操作的项目以及视频通话时长。这些项目可以包括悬浮小窗按钮、切换布局按钮、邀请新参与方按钮、挂断按钮、视频关按钮、麦克风关按钮以及屏幕共享按钮等。不同的通话类型所显示的项目可以不同。焦点对象可以定位在其中一个项目上。Exemplarily, the video of user A is displayed in the upper left corner of the display area of the first view. In the area corresponding to user A, the image of user A fills the entire area. At the same time, on top of the image, the lower left corner of the area superimposes and displays the name of user A, and the lower right corner of the area superimposes the sign that user A is currently muting. At the same time, on the video of each participant, the items for the user to operate and the duration of the video call are displayed in a semi-transparent form. These items can include floating small window buttons, switch layout buttons, invite new participants button, hang up button, video off button, microphone off button, screen sharing button, etc. The displayed items can be different for different call types. The focus object can be positioned on one of the items.
同时,第二显示屏上不再显示来电提醒画面。具体的,第二显示屏可以为关闭背光的状态,或者,第二显示屏上可以显示天气、时间等信息。用户按下悬浮小窗按钮、切换布局按钮以及邀请新参与方按钮之后的界面示例将下述实施例中说明。用户按下挂断按钮后,界面显示上述图12所示的画面。用户按下视频关按钮后,用户对应的视频为黑屏状态,不再显示当前用户的视频。用户按下麦克风关按钮后,用户的视频所在的区域中显示静音标志。At the same time, the call reminder screen is no longer displayed on the second display screen. Specifically, the second display screen may be in a state where the backlight is turned off, or the second display screen may display information such as weather and time. An example of the interface after the user presses the floating window button, the layout switch button, and the invite new participant button will be described in the following embodiments. After the user presses the hang up button, the interface displays the screen shown in Figure 12 above. After the user presses the video off button, the user's corresponding video is in a black screen state, and the current user's video is no longer displayed. After the user presses the microphone off button, a mute sign is displayed in the area where the user's video is located.
示例性的,用户为图13中的用户A,当用户按下麦克风关按钮后,用户A所在区域坐下角的标志显示为静音标志。Exemplarily, the user is user A in FIG. 13, and when the user presses the microphone off button, the sign of the sitting corner of the area where user A is located is displayed as a mute sign.
如图14所示,第一视图显示区2011中显示视频通话画面,视频通话画面 中显示参与视频通话的两个参与方的视频,每个参与方的视频占据第一视图显示区2011的一半。同时,在两个参与方的视频之上,以半透明形式显示供用户操作的项目。这些项目可以包括悬浮小窗按钮、美颜滤镜按钮、邀请好友按钮、挂断按钮、视频关按钮、麦克风关按钮以及切换布局按钮等。焦点对象可以定位在其中一个项目上,例如,定位在悬浮小窗按钮上。As shown in FIG. 14, a video call screen is displayed in the first view display area 2011, and the video call screen displays videos of two participants participating in the video call, and the video of each participant occupies half of the first view display area 2011. At the same time, on top of the videos of the two participants, the items for users to operate are displayed in a semi-transparent form. These items can include floating small window buttons, beauty filter buttons, invite friends buttons, hang up buttons, video off buttons, microphone off buttons, and switch layout buttons. The focus object can be positioned on one of the items, for example, positioned on the floating window button.
具体的,第二显示屏可以为关闭背光的状态,或者,第二显示屏上可以显示天气、时间等信息。用户按下悬浮小窗按钮、切换布局按钮、邀请好友按钮以及美颜滤镜按钮之后的界面示例将下述实施例中说明。用户按下挂断按钮后,界面显示上述图12所示的画面。用户按下视频关按钮后,用户对应的视频为黑屏状态,不再显示当前用户的视频。用户按下麦克风关按钮后,用户的视频所在的区域中显示静音标志。示例性的,用户为图13中的用户A,当用户按下麦克风关按钮后,用户A所在区域坐下角的标志显示为静音标志。Specifically, the second display screen may be in a state where the backlight is turned off, or the second display screen may display information such as weather and time. Examples of the interface after the user presses the floating window button, the switch layout button, the invite friend button, and the beauty filter button will be described in the following embodiments. After the user presses the hang up button, the interface displays the screen shown in Figure 12 above. After the user presses the video off button, the user's corresponding video is in a black screen state, and the current user's video is no longer displayed. After the user presses the microphone off button, a mute sign is displayed in the area where the user's video is located. Exemplarily, the user is user A in FIG. 13, and when the user presses the microphone off button, the sign of the sitting corner of the area where user A is located is displayed as a mute sign.
图16为第一控制器和第二控制器的交互过程示意图,如图16所示,第一控制器和第二控制器的交互过程包括:FIG. 16 is a schematic diagram of the interaction process between the first controller and the second controller. As shown in FIG. 16, the interaction process between the first controller and the second controller includes:
S1601、第一控制器在第一显示屏显示视频画面。S1601. The first controller displays a video image on the first display screen.
在一些实施例中,该视频画面可以是电影、电视剧的图像内容、视频剪辑或者应用程序中的视频画面等。In some embodiments, the video screen may be the image content of a movie, a TV series, a video clip, or a video screen in an application.
如果上述视频画面还具有对应的音频内容,则第一控制器还同时播放视频画面对应的音频信息。If the above-mentioned video picture also has corresponding audio content, the first controller also simultaneously plays the audio information corresponding to the video picture.
S1602、第一控制器接收来电请求。S1602. The first controller receives an incoming call request.
在一些实施例中,该来电请求可以是视频通话请求、语音通话请求、游戏邀请等。In some embodiments, the incoming call request may be a video call request, a voice call request, a game invitation, etc.
S1603、第一控制器向第二控制器发送来电指示。S1603. The first controller sends an incoming call indication to the second controller.
第一控制器判断出当前正在第一显示屏显示视频画面,则可通过串口传输方式向第二控制器发送来电指示。该来电指示中可以包括来电的类型和来电者的信息,第二控制器据此选择待显示的项目。或者,该来电指示中可以既包括来电类型和来电者的信息,又包括待第二控制器在第二显示屏显示的项目,第二控制器基于来电指示,直接显示项目。The first controller determines that the video screen is currently being displayed on the first display screen, and can send an incoming call indication to the second controller through a serial port transmission mode. The incoming call indication may include the type of the incoming call and the information of the caller, and the second controller selects the item to be displayed accordingly. Alternatively, the incoming call indication may include both the type of the incoming call and the information of the caller, as well as the items to be displayed on the second display screen by the second controller, and the second controller directly displays the items based on the incoming call indication.
来电的类型可以包括视频通话、语音通话、游戏邀请等。The types of incoming calls can include video calls, voice calls, game invitations, and so on.
来电者的信息可以包括来电者的肖像、姓名等。The information of the caller may include the portrait, name, etc. of the caller.
相应的,第二控制器接收上述来电指示。Correspondingly, the second controller receives the above-mentioned incoming call indication.
S1604、第二控制器在第二显示屏显示来电提醒画面。S1604. The second controller displays an incoming call reminder screen on the second display screen.
第二控制器在第二显示屏的第二视图显示区中显示来电提醒画面,来电提醒画面中包括来电者肖像、姓名、来电提示语、接听视频按钮、仅接听语音按钮、挂断按钮等项目。如果来电的类型为视频通话、游戏邀请等基于视频的来电,则第二控制器可以将焦点对象定位在接听视频按钮上,如果来电的类型为语音通话,则第二控制器将焦点对象定位在仅接听语音按钮后。The second controller displays the incoming call reminder screen in the second view display area of the second display screen. The incoming call reminder screen includes the caller's portrait, name, incoming call reminder, answer video button, answer voice only button, hang up button, etc. . If the type of the incoming call is a video-based incoming call such as a video call or game invitation, the second controller can position the focus object on the answer video button. If the type of the incoming call is a voice call, the second controller will position the focus object on the Only after answering the voice button.
第二控制器在第二显示屏显示来电提醒画面后,用户可以通过操作遥控器上的向左键、向右键移动焦点对象,以选择按钮,并按下OK键以进行确认。或者,用户可以直接按下OK键以进行确认。After the second controller displays the incoming call reminder screen on the second display screen, the user can move the focus object by operating the left key and the right key on the remote control to select a button, and press the OK key to confirm. Alternatively, the user can directly press the OK key to confirm.
S1605、第二控制器接收用户的接听视频来电指示。S1605. The second controller receives the user's instruction to answer the video call.
S1606、第二控制器向第一控制器发送视频通话指示。S1606. The second controller sends a video call instruction to the first controller.
用户在按下OK键之后,第二控制器基于焦点对象当前所定位的项目,识别出用户的指示。如果焦点对象定位在挂断按钮,则第二控制器确认接收到挂 断指示,并将挂断指示发送给第一控制器,第一控制器接收到挂断指示后,指示第二控制器关闭来电提醒画面,不再执行下述的步骤。如果焦点对象定位在仅接听语音按钮,则第二控制器确认接收到接听语音来电指示,并向第一控制器发送语音通话指示,第一控制器接收到语音通话指示后,执行语音通话的控制,例如播放来电者的语音、接收接听者的语音并发送给来电方设备等,同时,第一控制器可以指示第二控制器关闭来电提醒画面,并指示第二控制器在第二显示屏上显示正在语音通话的项目。并且,不再执行下述的步骤。After the user presses the OK key, the second controller recognizes the user's instruction based on the item currently located by the focus object. If the focus object is positioned on the hang-up button, the second controller confirms that it receives the hang-up instruction and sends the hang-up instruction to the first controller. After the first controller receives the hang-up instruction, it instructs the second controller to shut down Incoming call reminder screen, no longer perform the following steps. If the focus object is positioned on the voice-only button, the second controller confirms that it has received the voice call instruction and sends the voice call instruction to the first controller. After the first controller receives the voice call instruction, it executes the voice call control , Such as playing the caller’s voice, receiving the receiver’s voice and sending it to the caller’s device, etc. At the same time, the first controller can instruct the second controller to close the call reminder screen and instruct the second controller to be on the second display Shows the items that are in a voice call. And, do not perform the following steps.
如果焦点对象定位在接听视频按钮,则第二控制器确认接收到接听视频来电指指示,并向第一控制器发送视频通话指示。If the focus object is positioned on the answer video button, the second controller confirms that the instruction to answer the video call is received, and sends the video call instruction to the first controller.
相应的,第一控制器接收到视频通话指示,并执行下述的步骤。Correspondingly, the first controller receives the video call instruction and executes the following steps.
S1607、第一控制器在第一显示屏显示视频通话画面。S1607. The first controller displays a video call screen on the first display screen.
在一些实施例中,上述视频通话画面中可以包括视频通话参与方的视频,以及,供用户操作的项目。其中,供用户操作的项目可以显示在视频通话参与方的视频之上。In some embodiments, the above-mentioned video call screen may include videos of the video call participants and items for the user to operate. Among them, the items for the user to operate can be displayed on the video of the video call participants.
在一些实施例中,第一控制器可以按照视频通话的参与方的数量确定各参与方的视频显示位置。例如,假设视频通话为两方视频通话,则来电者和接听通话者的视频分别占据第一显示屏的屏幕的一半。又例如,假设视频通话为六方视频通话,则通话的各参与方分别占据第一显示的六分之一。In some embodiments, the first controller may determine the video display position of each participant according to the number of participants in the video call. For example, assuming that the video call is a two-party video call, the video of the caller and the caller respectively occupy half of the screen of the first display screen. For another example, assuming that the video call is a six-party video call, each participant in the call occupies one-sixth of the first display.
在一些实施例中,第一控制器在视频通话参与方的视频之上显示供用户操作的项目,这些项目可以包括悬浮小窗按钮、切换布局按钮、邀请新参与方按钮、挂断按钮、视频关按钮、麦克风关按钮以及屏幕共享按钮等。不同的通话类型所显示的项目可以不同。焦点对象可以定位在其中一个项目上,例如悬浮 小窗按钮上。用户可以通过操作遥控器上的向左键、向右键移动焦点对象,以选择其他项目,并通过操作遥控器上的OK键进行确认。In some embodiments, the first controller displays items for the user to operate on the video of the video call participants. These items may include a floating window button, a switch layout button, a button for inviting new parties, a hangup button, and a video Off button, microphone off button, screen sharing button, etc. The displayed items can be different for different call types. The focus object can be positioned on one of the items, such as a floating window button. The user can move the focus object by operating the left and right keys on the remote control to select other items, and confirm by operating the OK key on the remote control.
S1608、第二控制器关闭来电提醒画面。S1608. The second controller closes the incoming call reminder screen.
值得说明的是,第二控制器可以在执行上述步骤S1306之后执行该步骤。该步骤与上述S1607的执行顺序可以不分先后。It is worth noting that the second controller may execute this step after executing the above-mentioned step S1306. This step and the execution order of S1607 may be in no particular order.
第二控制器关闭来电提醒画面后,可以在第二显示屏显示时间、天气、气温、提醒消息等信息,或者,第二控制器与可以关闭第二显示屏的背光。After the second controller closes the call reminder screen, it can display information such as time, weather, temperature, and reminder messages on the second display screen, or the second controller can turn off the backlight of the second display screen.
上述实施例中,当第一显示屏正在播放视频画面时第一控制器接收到来电请求,则在第二显示屏上显示来电提醒画面,从而使得第一显示屏正在显示的视频画面不被遮挡,极大提升用户体验。当用户选择接听视频来电之后,在第一显示屏上显示视频通话画面,以使得用户可以查看到视频通话各方的视频。In the above embodiment, when the first controller receives the incoming call request while the first display screen is playing a video screen, it displays the incoming call reminder screen on the second display screen, so that the video screen being displayed on the first display screen is not blocked. , Which greatly improves the user experience. After the user chooses to answer the video call, the video call screen is displayed on the first display screen, so that the user can view the videos of all parties to the video call.
在一些实施例中,上述交互流程中,第一控制器和第二控制器之间的信息传输可以通过串口传输。In some embodiments, in the foregoing interaction process, the information transmission between the first controller and the second controller may be transmitted through a serial port.
在一些实施例中,当第一控制器在第一显示屏显示视频通话画面后,用户可以选择进行小窗视频通话,第一控制器根据用户的选择,使用小窗显示视频通话画面,同时,继续播放视频通话之前的通话画面,从而实现边看边聊的效果,极大提升用户的使用体验。具体的,用户可以按下图13或图14中的悬浮小窗按钮,或者,用户可以按下图13或图14中的切换布局按钮,以进行小窗视频通话。In some embodiments, after the first controller displays the video call screen on the first display screen, the user can choose to make a small window video call. The first controller uses the small window to display the video call screen according to the user's selection. At the same time, Continue to play the call screen before the video call, so as to achieve the effect of watching and chatting, which greatly improves the user experience. Specifically, the user may press the floating small window button in FIG. 13 or FIG. 14, or the user may press the switch layout button in FIG. 13 or FIG. 14 to make a small window video call.
图17示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图。如图17所示,响应于用户输入的小窗视频通话指示,第一视图显示区2011中的视频通话画面被关闭,并且继续显示进行视频通话之前的视频 画面。其中,该小窗视频通话指示由用户按下上述的悬浮小窗按钮来输入。同时,第二视图显示区2021中显示小窗视频通话画面,该小窗视频通话画面中各视频参与方的视频。FIG. 17 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment. As shown in FIG. 17, in response to the small window video call instruction input by the user, the video call screen in the first view display area 2011 is closed, and the video screen before the video call continues to be displayed. Wherein, the small window video call instruction is input by the user pressing the above floating small window button. At the same time, a small window video call screen is displayed in the second view display area 2021, and the video of each video participant in the small window video call screen is displayed.
在一些实施例中,每个参与方的视频所在区域的左下角显示参与方的姓名,右下角显示参与方为静音状态或非静音状态。在一些实施例中,第二视图显示区2021中可以在各参与方的视频之上叠加一行提示文本(图中未示出),例如“按菜单键切换窗口”,以使得用户可以根据提示文本执行返回图13或图14所示的显示画面。In some embodiments, the name of the participant is displayed in the lower left corner of the area where the video of each participant is located, and the lower right corner shows that the participant is in a silent state or a non-muted state. In some embodiments, a line of prompt text (not shown in the figure) can be superimposed on the video of each participant in the second view display area 2021, such as "press the menu key to switch windows", so that the user can follow the prompt text The execution returns to the display screen shown in Fig. 13 or Fig. 14.
在一些实施例中,当第二视图显示区2021中显示各视频参与方的视频后,用户可以按下遥控器中的特定按钮(例如返回按钮),则显示设备重新返回图13或图14所示的显示画面。或者,第二视图显示区中可以显示返回按钮,用户通过操作遥控器选中该按钮,并确认,显示设备重新返回图13或图14所示的显示画面。In some embodiments, after the video of each video participant is displayed in the second view display area 2021, the user can press a specific button (for example, the return button) on the remote control, and the display device will return to that shown in FIG. 13 or FIG. 14. Display screen shown. Alternatively, a return button may be displayed in the second view display area. The user selects the button by operating the remote control and confirms that the display device returns to the display screen shown in FIG. 13 or FIG. 14 again.
图18示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图,如图18所示,响应于用户输入的小窗视频通话指示,第一视图显示区2011中的视频通话画面被关闭,并且继续显示进行视频通话之前的视频画面。其中,该小窗视频通话指示由用户按下上述的切换布局按钮来输入。同时,第一视图显示区2011的下方靠近第一显示屏下边缘的位置显示小窗视频通话画面,该小窗视频通话画面中各视频参与方的视频。在一些实施例中,每个参与方的视频所在区域的左下角显示参与方的姓名,右下角显示参与方为静音状态或非静音状态。FIG. 18 exemplarily shows a schematic diagram of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment. As shown in FIG. 18, in response to a small window video call instruction input by the user, the display area in the first view display area 2011 The video call screen is closed, and the video screen before the video call continues to be displayed. Wherein, the small window video call instruction is input by the user pressing the above-mentioned switch layout button. At the same time, a small window video call screen is displayed below the first view display area 2011 near the lower edge of the first display screen, and the video of each video participant in the small window video call screen. In some embodiments, the name of the participant is displayed in the lower left corner of the area where the video of each participant is located, and the lower right corner shows that the participant is in a silent state or a non-muted state.
在一些实施例中,第一视图显示区2011的右上角各视频参与方的视频后, 用户可以按下遥控器中的特定按钮(例如返回按钮),则显示设备重新返回图13或图14所示的显示画面。或者,第一视图显示区2011的下方靠近第一显示屏下边缘的位置还可以显示返回按钮,用户通过操作遥控器选中该按钮,并确认,显示设备重新返回图13或图14所示的显示画面。In some embodiments, after the first view displays the videos of each video participant in the upper right corner of the area 2011, the user can press a specific button (for example, the return button) on the remote control, and the display device will return to that shown in FIG. 13 or FIG. 14. Display screen shown. Alternatively, a return button may be displayed below the first view display area 2011 near the lower edge of the first display screen. The user selects this button by operating the remote control and confirms that the display device returns to the display shown in FIG. 13 or FIG. 14 Picture.
图19为第一控制器和第二控制器的交互过程示意图,如图19所示,第一显示屏上显示视频通话画面之后,用户可以选择小窗显示视频通话画面,则第一控制器可以通知第二控制器在第二显示屏显示小窗视频通话画面,第一控制器和第二控制器的交互过程包括:Figure 19 is a schematic diagram of the interaction process between the first controller and the second controller. As shown in Figure 19, after the video call screen is displayed on the first display screen, the user can select the small window to display the video call screen, and the first controller can Notifying the second controller to display the small window video call screen on the second display screen, the interaction process between the first controller and the second controller includes:
S1901、第一控制器接收用户输入的小窗视频通话指示。S1901. The first controller receives a small window video call instruction input by the user.
用户可以选择第一显示屏上所显示的悬浮小窗按钮,并确认,第一控制器即接收到小窗视频通话指示。The user can select the floating small window button displayed on the first display screen and confirm that the first controller receives the small window video call instruction.
S1902、第一控制器向第二控制器发送小窗视频通话指示。S1902. The first controller sends a small window video call instruction to the second controller.
该小窗视频通话指示用于指示第二控制器在第二显示屏上显示小窗视频通话画面。示例性的,第一控制器可以在该指示中携带视频通话的参与方数量,各方的姓名等。The small window video call indication is used to instruct the second controller to display a small window video call picture on the second display screen. Exemplarily, the first controller may carry the number of participants in the video call, the names of the parties, etc. in the instruction.
相应的,第二控制器接收到小窗视频通话指示。Correspondingly, the second controller receives the small window video call instruction.
S1903、第一控制器关闭视频通话画面,并显示视频通话之前的视频画面。S1903. The first controller closes the video call screen and displays the video screen before the video call.
S1904、第二控制器在第二显示屏显示小窗视频通话画面。S1904. The second controller displays a small window video call screen on the second display screen.
第二控制器接收到小窗视频通话指示后,基于通话参与方数量和姓名等,在第二显示屏上的多个区域分别显示各参与方的视频以及姓名等。After receiving the small window video call instruction, the second controller displays the video and name of each participant in multiple areas on the second display screen based on the number and names of the participants in the call.
上述步骤S1903和S1904的执行顺序可以不分先后。The execution order of the above steps S1903 and S1904 may be in no particular order.
在一些实施例中,当第二控制器在第二显示屏显示小窗视频通话画面后, 用户可以按下遥控器中的特定按钮(例如返回按钮),或者,通过遥控器选择小窗视频通话画面中的返回按钮,并确认,第一控制器基于用户的操作,接收到用户的返回指令,响应于返回指令,第一控制器向第二控制器发送关闭小窗视频通话画面指令,第二控制器响应于该指令,关闭小窗视频通话画面,同时,第一控制器重新在第一显示屏显示上述的视频通话画面。In some embodiments, after the second controller displays the small window video call screen on the second display screen, the user can press a specific button (for example, the return button) on the remote control, or select the small window video call through the remote control The return button in the screen and confirm that the first controller receives the user's return instruction based on the user's operation. In response to the return instruction, the first controller sends the second controller an instruction to close the small window video call screen, and the second In response to the instruction, the controller closes the video call screen in the small window, and at the same time, the first controller displays the above-mentioned video call screen on the first display screen again.
在一些实施例中,上述交互流程中,第一控制器和第二控制器之间的信息传输可以通过串口传输。In some embodiments, in the foregoing interaction process, the information transmission between the first controller and the second controller may be transmitted through a serial port.
对应于上述图18所示的交互界面,在另一实施例中,第一控制器接收到用户输入的小窗视频通话指示后,关闭视频通话画面,并在第一显示屏的目标区域显示小窗视频通话画面。Corresponding to the interactive interface shown in FIG. 18, in another embodiment, the first controller closes the video call screen after receiving the small window video call instruction input by the user, and displays the small window in the target area of the first display screen. Window video call screen.
其中,第一控制器可以根据视频通话参与方的数量确定目标区域的大小,并在目标区域上显示小窗视频通话画面。Wherein, the first controller may determine the size of the target area according to the number of participants in the video call, and display a small window video call picture on the target area.
在一些实施例中,当第二控制器在第一显示屏的目标区域显示小窗视频通话画面后,用户可以按下遥控器中的特定按钮(例如返回按钮),或者,通过遥控器选择小窗视频通话画面中的返回按钮,并确认,第一控制器基于用户的操作,接收到用户的返回指令,响应于返回指令,第一控制器关闭小窗视频通话画面,同时,第一控制器重新在第一显示屏显示上述的视频通话画面。In some embodiments, after the second controller displays the small window video call screen in the target area of the first display screen, the user can press a specific button (such as the return button) on the remote control, or select the small window through the remote control. The return button in the window video call screen and confirm that the first controller receives the user’s return instruction based on the user’s operation. In response to the return instruction, the first controller closes the small window video call screen. At the same time, the first controller The above-mentioned video call screen is displayed on the first display screen again.
图20示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图。如图20所示,响应于用户输入的邀请指示,第一视图显示区2011中在显示的视频通话画面之上,显示可供邀请的好友列表。其中,该邀请指示由用户按下上述的邀请新参与方按钮或邀请好友按钮来输入。FIG. 20 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment. As shown in FIG. 20, in response to the invitation instruction input by the user, on the displayed video call screen in the first view display area 2011, a list of friends available for invitation is displayed. Wherein, the invitation instruction is input by the user pressing the aforementioned invite new participant button or invite friend button.
在一些实施例中,好友列表可以显示在第一视图显示区2011上方靠近第一 显示屏的上边缘的位置,该好友列表中可以显示每个好友的肖像以及姓名。当用户选择一个好友的肖像或姓名并按下OK键之后,该好友加入视频通话,第一视图显示区中新增该好友的视频。In some embodiments, the friend list may be displayed above the first view display area 2011 near the upper edge of the first display screen, and each friend's portrait and name may be displayed in the friend list. After the user selects a friend's portrait or name and presses the OK button, the friend joins the video call, and the friend's video is added to the display area of the first view.
图21示例性示出了根据示例性实施例中显示设备200中用户界面与用户进行交互示意图。如图21所示,响应于用户输入的美颜滤镜指示,第一视图显示区2011中在显示的视频通话画面之上,显示美颜滤镜选项。美颜滤镜选项可以包括背景、贴纸和滤镜。在背景选项下,用户可以选择多种背景中的任意一种。在贴纸选项下,用户可以选择多种贴纸中的任意一种。在滤镜选项下,用户可以选择任意一种滤镜方式。在美颜选项下,用户选择任意一种美颜方式。在一些实施例中,美颜滤镜选项可以显示在第一视图显示区2011下方靠近第一显示屏的下边缘的位置,此时,该位置上原来所显示的其他按钮暂时被隐藏。FIG. 21 exemplarily shows a schematic diagram of interaction between a user interface and a user in the display device 200 according to an exemplary embodiment. As shown in FIG. 21, in response to the beautification filter instruction input by the user, the first view display area 2011 displays the beautification filter options on the displayed video call screen. The beauty filter options can include backgrounds, stickers, and filters. Under the background option, the user can choose any of a variety of backgrounds. Under the sticker option, users can choose any one of a variety of stickers. Under the filter options, the user can choose any filter method. Under the beautification option, the user can select any beautification method. In some embodiments, the beauty filter option may be displayed at a position near the lower edge of the first display screen under the first view display area 2011. At this time, other buttons originally displayed at this position are temporarily hidden.
以上以前述的第一种可选方式为例对第一控制器和第二控制器的交互处理过程以及界面显示过程进行了说明。对于前述的第二种可选方式,可以使用相应的处理以及显示过程。示例性的,第二控制器接收到用户输入的接听视频来电指示后,使用与上述第一种可选方式中第一控制器相同的方式在第二显示屏显示视频通话画面,在用户按下确认键后,由第一控制器在第一显示屏显示视频通话画面。具体执行过程此处不再赘述。The foregoing describes the interaction processing process and the interface display process of the first controller and the second controller by taking the foregoing first optional manner as an example. For the aforementioned second alternative, the corresponding processing and display process can be used. Exemplarily, after the second controller receives the instruction to answer the video call input by the user, it displays the video call screen on the second display screen in the same manner as the first controller in the above-mentioned first optional method, and when the user presses After the confirmation key, the first controller displays the video call screen on the first display screen. The specific implementation process will not be repeated here.
图22为本申请实施例提供的来电显示方法的流程示意图,该方法的执行主推为上述的控制器,如图22所示,包括:FIG. 22 is a schematic flowchart of a caller ID method provided by an embodiment of the application. The method is mainly executed by the aforementioned controller, as shown in FIG. 22, including:
S2201、在第一显示屏显示视频画面时接收来电请求。S2201: Receive an incoming call request when a video screen is displayed on the first display screen.
S2202、响应于上述来电请求,在第二显示屏上显示来电提醒画面。S2202, in response to the aforementioned call request, display an incoming call reminder screen on the second display screen.
上述步骤的具体执行过程可以参见前述实施例,此处不再赘述。For the specific execution process of the foregoing steps, reference may be made to the foregoing embodiment, which will not be repeated here.
本实施例中,当第一显示屏正在播放视频画面时控制器接收到来电请求,则在第二显示屏上显示来电提醒画面,从而使得第一显示屏正在显示的视频画面不被遮挡,极大提升用户体验。In this embodiment, when the first display screen is playing a video screen, the controller receives an incoming call request, and then displays the incoming call reminder screen on the second display screen, so that the video screen being displayed on the first display screen is not blocked. Greatly enhance the user experience.
在一些实施例中,控制器包括第一控制器和第二控制器。In some embodiments, the controller includes a first controller and a second controller.
所述控制器在第一显示屏显示视频画面时接收来电请求,包括:The controller receiving an incoming call request when a video screen is displayed on the first display screen includes:
所述第一控制器在第一显示屏显示视频画面时接收来电请求。The first controller receives an incoming call request when the first display screen displays a video image.
所述控制器响应于所述来电请求,在第二显示屏上显示来电提醒画面,包括:The controller displays an incoming call reminder screen on the second display screen in response to the incoming call request, including:
所述第一控制器响应于所述来电请求,向所述第二控制器发送来电指示;The first controller sends an incoming call indication to the second controller in response to the incoming call request;
所述第二控制器接收所述来电指示,响应于所述来电指示,在所述第二显示屏上显示来电提醒画面。The second controller receives the incoming call indication, and in response to the incoming call indication, displays an incoming call reminder screen on the second display screen.
在一些实施例中,上述方法还包括:In some embodiments, the above method further includes:
在所述第二显示屏上显示来电提醒画面之后,响应于用户输入的对所述接通所述来电请求的选项卡,控制所述第二显示屏呈现聊天画面。After the incoming call reminder screen is displayed on the second display screen, in response to the user input for the tab request to connect to the incoming call, control the second display screen to present a chat screen.
在一些实施例中,上述方法还包括:In some embodiments, the above method further includes:
响应于用户对所述聊天画面的选择,控制所述聊天画面从第二显示屏切换至第一显示屏。In response to the user's selection of the chat screen, controlling the chat screen to switch from the second display screen to the first display screen.
在一些实施例中,上述方法还包括:In some embodiments, the above method further includes:
第二控制器接收用户输入的接听视频来电指示,响应于所述接听视频来电指示,向所述第一控制器发送视频通话指示,并关闭所述来电提醒画面。The second controller receives the instruction for answering the video call input by the user, and in response to the instruction for answering the video call, sends a video call instruction to the first controller, and closes the incoming call reminder screen.
第一控制器接收第二控制器发送的视频通话指示,响应于所述视频通话指示,在所述第一显示屏显示视频通话画面。The first controller receives the video call instruction sent by the second controller, and in response to the video call instruction, displays a video call picture on the first display screen.
在一些实施例中,上述方法还包括:In some embodiments, the above method further includes:
第一控制器接收用户输入的小窗视频通话指示,响应于所述小窗视频通话指示,关闭所述视频通话画面,并向所述第二控制器发送小窗视频通话指示。第二控制器响应于所述小窗视频通话指示,在所述第二显示屏显示小窗视频通话画面。The first controller receives the small window video call instruction input by the user, responds to the small window video call instruction, closes the video call screen, and sends the small window video call instruction to the second controller. In response to the small window video call instruction, the second controller displays a small window video call screen on the second display screen.
在一些实施例中,上述方法还包括:In some embodiments, the above method further includes:
第一控制器接收用户输入的小窗视频通话指示,响应于所述小窗视频通话指示,关闭所述视频通话画面,并在所述第一显示屏的目标区域显示小窗视频通话画面。The first controller receives the small window video call instruction input by the user, and in response to the small window video call instruction, closes the video call screen, and displays the small window video call screen in the target area of the first display screen.
在一些实施例中,在关闭所述视频通话画面之后,所述方法还包括:In some embodiments, after closing the video call screen, the method further includes:
第一控制器在所述第一显示屏显示所述视频画面。The first controller displays the video screen on the first display screen.
在一些实施例中,本申请实施例还提供一种存储介质,所述存储介质中存储有指令,当其在计算机上运行时,使得计算机执行如上述方法实施例中的方法。In some embodiments, the embodiments of the present application further provide a storage medium, which stores instructions in the storage medium, which when run on a computer, causes the computer to execute the method in the above method embodiment.
在一些实施例中,本申请实施例还提供一种运行指令的芯片,所述芯片用于执行上述方法实施例中的方法。In some embodiments, the embodiment of the present application further provides a chip for executing instructions, and the chip is used to execute the method in the above method embodiment.
本申请实施例还提供一种程序产品,所述程序产品包括计算机程序,所述计算机程序存储在存储介质中,至少一个处理器可以从所述存储介质读取所述计算机程序,所述至少一个处理器执行所述计算机程序时可实现上述方法实施例中的方法。An embodiment of the present application also provides a program product, the program product includes a computer program, the computer program is stored in a storage medium, at least one processor can read the computer program from the storage medium, and the at least one When the processor executes the computer program, the method in the foregoing method embodiment can be implemented.
在本申请实施例中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如, A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系;在公式中,字符“/”,表示前后关联对象是一种“相除”的关系。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b,或c中的至少一项(个),可以表示:a,b,c,a-b,a-c,b-c,或a-b-c,其中,a,b,c可以是单个,也可以是多个。In the embodiments of the present application, "at least one" refers to one or more, and "multiple" refers to two or more. "And/or" describes the association relationship of the associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship; in the formula, the character "/" indicates that the associated objects before and after are in a "division" relationship. "The following at least one item (a)" or similar expressions refers to any combination of these items, including any combination of a single item (a) or a plurality of items (a). For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple A.
可以理解的是,在本申请实施例中涉及的各种数字编号仅为描述方便进行的区分,并不用来限制本申请实施例的范围。It can be understood that the various numerical numbers involved in the embodiments of the present application are only for easy distinction for description, and are not used to limit the scope of the embodiments of the present application.
可以理解的是,在本申请的实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It can be understood that, in the embodiments of the present application, the size of the sequence numbers of the above-mentioned processes does not imply the order of execution. The execution order of the processes should be determined by their functions and internal logic, and should not correspond to the embodiments of the present application. The implementation process constitutes any limitation.
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the application, not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. range.

Claims (12)

  1. 一种显示设备,其特征在于,包括:A display device is characterized in that it comprises:
    第一显示屏、第二显示屏和控制器;The first display screen, the second display screen and the controller;
    所述控制器被配置为:在所述第一显示屏显示视频画面时,接收来电请求,在所述第二显示屏上显示来电提醒画面,所述来电提醒画面包括用于指示接通所述来电请求的选项卡和用于拒绝所述来电请求的选项卡。The controller is configured to: when the first display screen displays a video screen, receive an incoming call request, and display an incoming call reminder screen on the second display screen, and the incoming call reminder screen includes instructions for connecting to the The tab for the incoming call request and the tab for rejecting the incoming call request.
  2. 根据权利要求1所述的显示设备,其特征在于,在所述第一显示屏显示视频画面时,接收来电请求,在所述第二显示屏上显示来电提醒画面之后,所述控制器还被配置为:The display device according to claim 1, wherein when the first display screen displays a video screen, an incoming call request is received, and after the incoming call reminder screen is displayed on the second display screen, the controller is also Configured as:
    响应于用户输入的对所述接通所述来电请求的选项卡,控制所述第二显示屏呈现聊天画面。In response to the user input for the tab request to connect to the incoming call, controlling the second display screen to present a chat screen.
  3. 根据权利要求2所述的显示设备,其特征在于,所述控制器还被配置为:The display device according to claim 2, wherein the controller is further configured to:
    响应于用户对所述聊天画面的选择,控制所述聊天画面从第二显示屏切换至第一显示屏。In response to the user's selection of the chat screen, controlling the chat screen to switch from the second display screen to the first display screen.
  4. 根据权利要求1所述的显示设备,其特征在于,在所述第一显示屏显示视频画面时,接收来电请求,在所述第二显示屏上显示来电提醒画面之后,所述控制器还被配置为:The display device according to claim 1, wherein when the first display screen displays a video screen, an incoming call request is received, and after the incoming call reminder screen is displayed on the second display screen, the controller is also Configured as:
    响应于用户输入的对所述接通所述来电请求的选项卡,控制所述第一显示屏呈现聊天画面。In response to the user input for the tab request to connect to the incoming call, controlling the first display screen to present a chat screen.
  5. 根据权利要求3或4所述的显示设备,其特征在于,所述控制器还被配置为:The display device according to claim 3 or 4, wherein the controller is further configured to:
    响应于用户输入的小窗视频通话指示,在所述第二显示屏显示小窗视频通话画面。In response to the small window video call instruction input by the user, a small window video call screen is displayed on the second display screen.
  6. 根据权利要求3或4所述的显示设备,其特征在于,所述控制器还被配置为:The display device according to claim 3 or 4, wherein the controller is further configured to:
    响应于用户输入的小窗视频通话指示,在所述第一显示屏的目标区域显示小窗视频通话画面。In response to the small window video call instruction input by the user, a small window video call screen is displayed in the target area of the first display screen.
  7. 根据权利要求1所述的显示设备,其特征在于,所述控制器包括第一控制器和第二控制器;The display device according to claim 1, wherein the controller comprises a first controller and a second controller;
    所述第一控制器被配置为:在所述第一显示屏显示视频画面时,接收来电请求,响应于所述来电请求,向所述第二控制器发送来电指示;The first controller is configured to: when the first display screen displays a video screen, receive an incoming call request, and in response to the incoming call request, send an incoming call instruction to the second controller;
    所述第二控制器被配置为:接收所述来电指示,响应于所述来电指示,在所述第二显示屏上显示来电提醒画面。The second controller is configured to: receive the incoming call indication, and in response to the incoming call indication, display an incoming call reminder screen on the second display screen.
  8. 根据权利要求7所述的显示设备,其特征在于,所述第二控制器被配置为:8. The display device of claim 7, wherein the second controller is configured to:
    接收用户输入的接听视频来电指示,响应于所述接听视频来电指示,向所述第一控制器发送视频通话指示,并关闭所述来电提醒画面;Receiving an instruction for answering a video call input by a user, and in response to the instruction for answering a video call, sending a video call instruction to the first controller, and closing the incoming call reminder screen;
    所述第一控制器被配置为:The first controller is configured to:
    响应于所述视频通话指示,在所述第一显示屏显示视频通话画面。In response to the video call instruction, a video call screen is displayed on the first display screen.
  9. 根据权利要求8所述的显示设备,其特征在于,所述第一控制器被配置为:8. The display device according to claim 8, wherein the first controller is configured to:
    接收用户输入的小窗视频通话指示,响应于所述小窗视频通话指示,关闭所述视频通话画面,以及,向所述第二控制器发送小窗视频通话指示;Receiving a small window video call instruction input by a user, in response to the small window video call instruction, closing the video call screen, and sending a small window video call instruction to the second controller;
    所述第二控制器被配置为:The second controller is configured to:
    响应于所述小窗视频通话指示,在所述第二显示屏显示小窗视频通话画面。In response to the small window video call instruction, a small window video call screen is displayed on the second display screen.
  10. 根据权利要求8所述的显示设备,其特征在于,所述第一控制器被配置为:8. The display device according to claim 8, wherein the first controller is configured to:
    接收用户输入的小窗视频通话指示,响应于所述小窗视频通话指示,关闭所述视频通话画面,以及,在所述第一显示屏的目标区域显示小窗视频通话画面。Receive a small window video call instruction input by a user, close the video call screen in response to the small window video call instruction, and display a small window video call screen in the target area of the first display screen.
  11. 根据权利要求9或10所述的显示设备,其特征在于,所述第一控制器被配置为:The display device according to claim 9 or 10, wherein the first controller is configured to:
    在所述第一显示屏显示所述视频画面。The video screen is displayed on the first display screen.
  12. 一种来电显示方法,其特征在于,包括:A caller ID display method, which is characterized in that it includes:
    控制器在第一显示屏显示视频画面时接收来电请求;The controller receives the call request when the first display screen displays the video picture;
    所述控制器响应于所述来电请求,在第二显示屏上显示来电提醒画面,所述来电提醒画面包括用于指示接通所述来电请求的选项卡和用于拒绝所述来电请求的选项卡。In response to the incoming call request, the controller displays an incoming call reminder screen on the second display screen, the incoming call reminder screen including a tab for instructing to connect to the incoming call request and an option for rejecting the incoming call request card.
PCT/CN2020/086461 2019-11-04 2020-04-23 Display device and incoming call display method WO2021088326A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911067365 2019-11-04
CN201911067365.5 2019-11-04

Publications (1)

Publication Number Publication Date
WO2021088326A1 true WO2021088326A1 (en) 2021-05-14

Family

ID=75750043

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/086461 WO2021088326A1 (en) 2019-11-04 2020-04-23 Display device and incoming call display method

Country Status (2)

Country Link
CN (2) CN112788381B (en)
WO (1) WO2021088326A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113676689A (en) * 2021-08-18 2021-11-19 百度在线网络技术(北京)有限公司 Video call method and device and television

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051972A (en) * 2012-12-21 2013-04-17 康佳集团股份有限公司 Control method and system for prompting mobile phone call through smart television
US20130260728A1 (en) * 2012-03-28 2013-10-03 Kyocera Corporation Communication device, communication method, and storage medium storing communication program
CN105592193A (en) * 2014-10-20 2016-05-18 中国电信股份有限公司 Method and system for displaying incoming call on multiple screens
CN106445441A (en) * 2016-09-27 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Information display method and system
CN106534999A (en) * 2016-11-09 2017-03-22 合浦县文化体育和旅游局 TV set capable of video chats
CN106953990A (en) * 2017-03-29 2017-07-14 青岛海信移动通信技术股份有限公司 The incoming call sound method and mobile terminal of mobile terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101763595B1 (en) * 2010-11-16 2017-08-01 엘지전자 주식회사 Method for processing data for monitoring service in network tv and the network tv
EP3734404A1 (en) * 2011-02-10 2020-11-04 Samsung Electronics Co., Ltd. Portable device comprising a touch-screen display, and method for controlling same
CN103780864B (en) * 2012-10-18 2017-10-03 腾讯科技(深圳)有限公司 Video calling interface display method and device
CN106791571B (en) * 2017-01-09 2020-05-19 宇龙计算机通信科技(深圳)有限公司 Video display method and device for double-screen display terminal
CN109379484B (en) * 2018-09-19 2020-09-25 维沃移动通信有限公司 Information processing method and terminal
CN113037928A (en) * 2019-02-03 2021-06-25 华为技术有限公司 Method for presenting video by electronic equipment in incoming call and electronic equipment
CN110166814A (en) * 2019-05-25 2019-08-23 Oppo广东移动通信有限公司 Video picture displaying method and relevant device
CN110572519A (en) * 2019-09-20 2019-12-13 青岛海信移动通信技术股份有限公司 Method for intercepting caller identification interface and display equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130260728A1 (en) * 2012-03-28 2013-10-03 Kyocera Corporation Communication device, communication method, and storage medium storing communication program
CN103051972A (en) * 2012-12-21 2013-04-17 康佳集团股份有限公司 Control method and system for prompting mobile phone call through smart television
CN105592193A (en) * 2014-10-20 2016-05-18 中国电信股份有限公司 Method and system for displaying incoming call on multiple screens
CN106445441A (en) * 2016-09-27 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Information display method and system
CN106534999A (en) * 2016-11-09 2017-03-22 合浦县文化体育和旅游局 TV set capable of video chats
CN106953990A (en) * 2017-03-29 2017-07-14 青岛海信移动通信技术股份有限公司 The incoming call sound method and mobile terminal of mobile terminal

Also Published As

Publication number Publication date
CN116320554A (en) 2023-06-23
CN112788381A (en) 2021-05-11
CN112788381B (en) 2023-01-17

Similar Documents

Publication Publication Date Title
WO2020248668A1 (en) Display and image processing method
WO2021088320A1 (en) Display device and content display method
US12047643B2 (en) Method for switching video call interface on smart television, and smart television
CN111526415B (en) Double-screen display equipment and HDMI switching method thereof
CN111491190B (en) Dual-system camera switching control method and display equipment
CN111464840B (en) Display device and method for adjusting screen brightness of display device
WO2020248714A1 (en) Data transmission method and device
WO2020248681A1 (en) Display device and method for displaying bluetooth switch states
CN112788422A (en) Display device
CN112788423A (en) Display device and display method of menu interface
CN112783380A (en) Display apparatus and method
CN112788378B (en) Display device and content display method
WO2021223074A1 (en) Display device and interaction control method
CN113141528B (en) Display device, boot animation playing method and storage medium
WO2020248654A1 (en) Display apparatus and method for displaying applications together
WO2021088326A1 (en) Display device and incoming call display method
CN112784137A (en) Display device, display method and computing device
WO2021189400A1 (en) Display device, and display method of video chat window
WO2021088308A1 (en) Display device and music recommendation method
WO2021088309A1 (en) Display device and information prompt method
CN112788375B (en) Display device, display method and computing device
CN112788387B (en) Display apparatus, method and storage medium
CN113365124B (en) Display device and display method
WO2021088325A1 (en) Dual-screen display device and image display method
CN113497966B (en) Double-screen display equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20884511

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20884511

Country of ref document: EP

Kind code of ref document: A1