WO2022105409A1 - Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage - Google Patents

Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage Download PDF

Info

Publication number
WO2022105409A1
WO2022105409A1 PCT/CN2021/119570 CN2021119570W WO2022105409A1 WO 2022105409 A1 WO2022105409 A1 WO 2022105409A1 CN 2021119570 W CN2021119570 W CN 2021119570W WO 2022105409 A1 WO2022105409 A1 WO 2022105409A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
remote control
display
terminal device
application
Prior art date
Application number
PCT/CN2021/119570
Other languages
English (en)
Chinese (zh)
Inventor
樊杰
张成宝
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2022105409A1 publication Critical patent/WO2022105409A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems

Definitions

  • the present application relates to the field of display devices, and in particular, to a fault diagnosis method, a terminal device and a display device.
  • faults such as sound, picture, network, etc. may occur. Only by accurately locating and diagnosing the fault, can the user solve the problem in a targeted manner.
  • the present application provides a fault diagnosis method, a terminal device and a display device.
  • the terminal equipment provided in the first aspect includes:
  • the display is used to synchronously play the screen of the display device
  • a controller configured to execute:
  • the controller is further configured to perform:
  • the display In response to receiving the inputted first operation, the display is controlled to display a virtual remote control; wherein the virtual remote control includes several keys for remotely controlling the display device;
  • the remote control command is sent to the display device, so that the display device parses the key value of the key corresponding to the remote control command, and executes the key value of the key corresponding control tasks.
  • the controller is further configured to perform: communicating with the display device by verifying the PIN code.
  • the display device provided by the second aspect includes:
  • a controller configured to execute:
  • the controller is further configured to perform:
  • the remote control instruction is input through a virtual remote control displayed in the terminal device, and the virtual remote control includes several keys for remote control of the display device.
  • the controller is further configured to perform:
  • connection request In response to the operation of starting the fault diagnosis application, sending a connection request to the server, the connection request including the identification information of the display device;
  • connection mode is that the display device and the terminal device are connected through server communication.
  • the fault diagnosis method provided by the third aspect is used for the terminal equipment, including:
  • the fault diagnosis method provided in the fourth aspect is used for the display device, including:
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control apparatus 100;
  • FIG. 2 exemplarily shows the hardware configuration block diagram of the display device 200 in FIG. 1;
  • FIG. 3 exemplarily shows the hardware configuration block diagram of the control device 100 in FIG. 1;
  • FIG. 4 exemplarily shows a schematic diagram of the software configuration in the display device 200 in FIG. 1;
  • FIG. 5 exemplarily shows a schematic diagram of the icon control interface display of the application program in the display device 200
  • Fig. 6 exemplarily shows a schematic diagram of a communication scenario between a display device, a server and a terminal device;
  • FIG. 7 exemplarily shows a schematic diagram of the interface of the display device 200 displaying the PIN code
  • FIG. 8 exemplarily shows a schematic diagram of a page in which the fault diagnosis application 2 in the terminal device 500 displays an “overview”;
  • FIG. 9 exemplarily shows a schematic diagram of a page displaying “diagnosis” in the fault diagnosis application 2 in the terminal device 500;
  • FIG. 10 exemplarily shows a schematic page diagram of the “tool” displayed by the fault diagnosis application 2 in the terminal device 500;
  • FIG. 11 exemplarily shows a schematic diagram of a page where the fault diagnosis application 2 in the terminal device 500 displays “Control”;
  • FIG. 12 exemplarily shows the interaction diagram among the display device, the server and the terminal device.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software code capable of performing the function associated with that element.
  • remote control refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance.
  • RF radio frequency
  • Bluetooth to connect with electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors.
  • a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
  • gesture refers to a user's behavior through an action such as a change in hand shape or hand movement, which is used to express an intended thought, action, purpose/or result.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment.
  • a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
  • the control device 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., and the display device 200 is controlled by wireless or other wired methods.
  • the wireless mode may be a direct connection or a non-direct connection, and may be routed or not routed.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.
  • mobile terminals, tablets, computers, laptops, and other smart devices may also be accessed to control the display device 200 .
  • accessing an application running on the smart device controls the display device 200 .
  • the app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication.
  • a control command protocol can be established between the mobile terminal 300 and the display device 200
  • the remote control keyboard can be synchronized to the mobile terminal 300
  • the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300.
  • the audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 400 .
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
  • the display device 200 may additionally provide a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.
  • a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.
  • FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the exemplary embodiment.
  • the display device 200 includes a controller 250, a tuner 210, a communicator 220, a detector 230, an input/output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, At least one of the user interface 265 and the external device interface 240 .
  • the display 275 for receiving the image signal from the output of the first processor, performs components for displaying video content and images and a menu manipulation interface.
  • the display 275 includes a display component for presenting a picture, and a driving component for driving image display.
  • the video content displayed may be from broadcast television content or various broadcast signals that may be received via wired or wireless communication protocols.
  • various image contents sent from the network server side can be displayed and received from the network communication protocol.
  • display 275 is used to present a user-manipulated UI interface generated in display device 200 and used to control display device 200 .
  • a driving component for driving the display is also included.
  • display 275 is a projection display, and may also include a projection device and projection screen.
  • communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator may include at least one of the WIFI module 221, the Bluetooth module 222, the wired Ethernet module 223 and other network communication protocol modules or near field communication protocol modules, and an infrared receiver, so that the communicator 220 can 250, receives the control signal from the control device 100, and implements the control signal as a signal type such as a WIFI signal, a Bluetooth signal, and a radio frequency signal.
  • the display apparatus 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control apparatus 100 or the content providing apparatus.
  • the user interface 265 may be used to receive infrared control signals from the control device 100 (eg, an infrared remote control, etc.).
  • the detector 230 is a signal used by the display device 200 to collect the external environment or interact with the outside.
  • the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.
  • the detector 230 may further include an image collector 232, such as a camera, a camera, etc., which can be used to collect external environment scenes, and used to collect user attributes or interactive gestures with the user, and can adaptively change display parameters , and can also recognize user gestures to implement functions that interact with users.
  • an image collector 232 such as a camera, a camera, etc., which can be used to collect external environment scenes, and used to collect user attributes or interactive gestures with the user, and can adaptively change display parameters , and can also recognize user gestures to implement functions that interact with users.
  • detector 230 may also include a temperature sensor or the like, such as by sensing ambient temperature.
  • the display device 200 can adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the display device 200 can be adjusted to display a relatively cool color temperature of the image, or when the temperature is relatively low, the display device 200 can be adjusted to display a warmer color of the image.
  • the detector 230 may also be a sound collector 231 or the like, such as a microphone, which may be used to receive the user's voice.
  • a voice signal including a control instruction of the user to control the display device 200, or collecting ambient sounds is used to identify the type of the environment scene, so that the display device 200 can adaptively adapt to the ambient noise.
  • the input/output interface 255 is configured to enable data transfer between the controller 250 and other external devices or other controllers 250 . Such as receiving video signal data and audio signal data of external equipment, or command instruction data, etc.
  • the external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface HDMI interface, an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. interface. It is also possible to form a composite input/output interface by a plurality of the above-mentioned interfaces.
  • the tuner and demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, from multiple wireless Or demodulate the audio and video signal from the cable broadcast TV signal, the audio and video signal may include the TV audio and video signal carried in the frequency of the TV channel selected by the user, and the EPG data signal.
  • the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, and the controller 250 can send a control signal according to the user's selection, so that the modem responds to the user-selected TV signal frequency and modulates and demodulates the frequency.
  • broadcast television signals may be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals, etc. according to different broadcast formats of the television signals. Or according to different modulation types, it can be divided into digital modulation signal, analog modulation signal, etc. Or, it can be divided into digital signals, analog signals, etc. according to different types of signals.
  • the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.
  • the set-top box outputs the modulated and demodulated television audio and video signals of the received broadcast television signals to the main device, and the main device receives the audio and video signals through the first input/output interface.
  • the controller 250 controls the operation of the display device and responds to user operations.
  • the controller 250 may control the overall operation of the display apparatus 200 .
  • the controller 250 may perform an operation related to the object selected by the user command.
  • the object may be any of the selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object such as displaying operations linked to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon.
  • the user command for selecting the UI object may be an input command through various input devices (eg, a mouse, a keyboard, a touchpad, etc.) connected to the display device 200 or a voice command corresponding to a voice spoken by the user.
  • the controller 250 includes a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a video processor 270, an audio processor 280, other processors ( For example: at least one of graphics processing unit 253 (Graphics Processing Unit, GPU), central processing unit 254 (Central Processing Unit, CPU), communication interface 255 (Communication Interface), and communication bus 256 (Bus). Wherein, the communication The bus connects the various components.
  • RAM 251 is used to store temporary data for the operating system or other running programs.
  • ROM 252 is used to store various system startup instructions.
  • ROM 252 is used to store a basic input output system, called a Basic Input Output System (BIOS). It is used to complete the power-on self-check of the system, the initialization of each functional module in the system, the driver program of the basic input/output of the system, and the boot operating system.
  • BIOS Basic Input Output System
  • the power supply of the display device 200 starts to start, and the CPU executes the system start-up instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to facilitate startup or operation operating system.
  • the CPU copies the temporary data of various application programs in the memory to the RAM 251, so as to facilitate starting or running various application programs.
  • processor 254 executes operating system and application program instructions stored in memory. And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.
  • processor 254 may include multiple processors.
  • the plurality of processors may include a main processor and one or more sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode.
  • One or more sub-processors for an operation in a state such as standby mode.
  • the graphics processor 253 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.
  • various graphic objects such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.
  • the video processor 270 is configured to receive the external video signal and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. After video processing, a signal that can be directly displayed or played on the display device 200 can be obtained.
  • the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used for demultiplexing the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • the image synthesizing module such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphic generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed.
  • the frame rate conversion module is used to convert the input video frame rate, such as converting 60Hz frame rate to 120Hz frame rate or 240Hz frame rate.
  • the usual format is implemented by means of frame insertion.
  • the display formatting module is used for converting the received frame rate into the video output signal, and changing the signal to conform to the display format signal, such as outputting the RGB data signal.
  • the graphics processor 253 and the video processor can be integrated and set up, and can also be set up separately.
  • the processing of the graphics signal output to the display can be performed.
  • different functions can be performed respectively. For example, GPU+FRC (Frame Rate Conversion)) architecture.
  • the audio processor 280 is configured to receive an external audio signal, perform decompression and decoding, and noise reduction, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal to obtain a The sound signal played in the speaker.
  • the video processor 270 may comprise one or more chips.
  • the audio processor may also include one or more chips.
  • the video processor 270 and the audio processor 280 may be separate chips, or may be integrated into one or more chips together with the controller.
  • the audio output under the control of the controller 250, receives the sound signal output by the audio processor 280, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to an external device.
  • the external audio output terminal 287 of the device such as an external audio interface or an earphone interface, etc., may also include a short-range communication module in the communication interface, such as a Bluetooth module for outputting sound from a Bluetooth speaker.
  • the power supply 290 under the control of the controller 250, provides power supply support for the display device 200 with the power input from the external power supply.
  • the power supply 290 may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 to provide an external power supply interface in the display device 200 .
  • the user interface 265 is used for receiving user input signals, and then sending the received user input signals to the controller 250 .
  • the user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.
  • the user inputs user commands through the control device 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 250 .
  • the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • a "user interface” is a medium interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user.
  • the commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display of the electronic device, wherein the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets and other visual elements interface elements.
  • GUI Graphical User Interface
  • the memory 260 includes storing various software modules for driving the display device 200 .
  • various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is used for signal communication between various hardwares in the display device 200, and is a low-level software module that sends processing and control signals to the upper-layer module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage.
  • the speech recognition module includes a speech parsing module and a speech instruction database module.
  • the display control module is a module used to control the display to display image content, and can be used to play information such as multimedia image content and UI interface.
  • Communication module a module for control and data communication with external devices.
  • the browser module is a module for performing data communication between browsing servers. Service modules are used to provide various services and modules including various applications.
  • the memory 260 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects, and the like.
  • FIG. 3 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
  • the control apparatus 100 is configured to control the display device 200 , and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to play an intermediary role between the user and the display device 200 .
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.
  • control apparatus 100 may be a smart device.
  • control apparatus 100 may install various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 300 or other intelligent electronic device can perform a similar function of the control apparatus 100 after installing the application for operating the display device 200 .
  • the user can install the application, various function keys or virtual buttons of the graphical user interface available on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of the physical key of the control apparatus 100 .
  • the controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus.
  • the controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
  • the communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 .
  • the received user input signal is sent to the display device 200 .
  • the communication interface 130 may include at least one of other near field communication modules such as the WiFi chip 131 , the Bluetooth module 132 , and the NFC module 133 .
  • the user input/output interface 140 wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, a key 144, and the like.
  • the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc.
  • the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.
  • the output interface includes an interface for transmitting received user instructions to the display device 200 .
  • it can be an infrared interface or a radio frequency interface.
  • the infrared signal interface when used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module.
  • the radio frequency signal interface when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.
  • control device 100 includes at least one of a communication interface 130 and an input-output interface 140 .
  • the control device 100 is configured with a communication interface 130, such as modules such as WiFi, Bluetooth, NFC, etc., which can send user input instructions to the display device 200 through WiFi protocol, Bluetooth protocol, or NFC protocol encoding.
  • the memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller.
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller. Can battery and related control circuit.
  • a system may include a kernel (Kernel), a command parser (shell), a file system, and applications.
  • kernel Kernel
  • shell command parser
  • file system a file system
  • applications the kernel, shell, and file system make up the basic operating system structures that allow users to manage files, run programs, and access the system.
  • the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC).
  • IPC inter-process communication
  • the shell and user applications are loaded.
  • An application is compiled into machine code after startup, forming a process.
  • the system is divided into four layers, from top to bottom, they are an application layer (referred to as “application layer”), an application framework layer (referred to as “framework layer”) ”), the Android runtime and the system library layer (referred to as the “system runtime layer”), and the kernel layer.
  • application layer an application layer
  • frame layer an application framework layer
  • Android runtime the Android runtime
  • system library layer the system library layer
  • kernel layer the kernel layer
  • At least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, a clock program, a camera application, etc. built into the operating system; they may also be developed by a third party
  • the application programs developed by the author such as the Hijian program, the K song program, the magic mirror program, etc.
  • the application package in the application layer is not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.
  • the framework layer provides an application programming interface (Aplication Pogramming Iterface, API) and a programming framework for the applications of the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action.
  • the API interface Through the API interface, the application program can access the resources in the system and obtain the services of the system during execution.
  • the application framework layer in this embodiment of the present application includes managers (Managers), content providers (Content Providers), and view systems (View Systems), etc., wherein the manager includes at least one of the following modules: activity The Activity Manager is used to interact with all activities running in the system; the Location Manager is used to provide system services or applications with access to system location services; the Package Manager is used to It is used to retrieve various information related to the application package currently installed on the device; the Notification Manager is used to control the display and removal of notification messages; the Window Manager is used to manage the icons on the user interface. , windows, toolbars, wallpapers, and desktop widgets.
  • the Manager includes at least one of the following modules: activity The Activity Manager is used to interact with all activities running in the system; the Location Manager is used to provide system services or applications with access to system location services; the Package Manager is used to It is used to retrieve various information related to the application package currently installed on the device; the Notification Manager is used to control the display and removal of notification messages; the Window Manager is used to manage the icons on the user interface.
  • the activity manager is used to: manage the life cycle of each application and the usual navigation and fallback functions, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening the , back (including switching the currently displayed user interface in the display window to the upper-level user interface of the currently displayed user interface), and the like.
  • the window manager is used to manage all window programs, such as obtaining the display size, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (for example, reducing the display window to display, shaking display, distortion and deformation) display, etc.) etc.
  • the system runtime layer provides support for the upper layer, that is, the framework layer.
  • the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.
  • the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.
  • the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.
  • the kernel layer further includes a power driver module for power management.
  • software programs and/or modules corresponding to the software architecture in FIG. 4 are stored in the first memory or the second memory shown in FIG. 2 or FIG. 3 .
  • the remote control receiving device receives the input operation of the remote control
  • the corresponding hardware interrupt is sent to the kernel layer.
  • the kernel layer processes the input operation into the original input event (including the value of the input operation, the timestamp of the input operation and other information).
  • Raw input events are stored at the kernel layer.
  • the application framework layer obtains the original input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and regards the input operation as a confirmation operation, and the control corresponding to the confirmation operation is the control of the magic mirror application icon.
  • the mirror application calls the interface of the application framework layer, starts the mirror application, and then starts the camera driver by calling the kernel layer to capture still images or videos through the camera.
  • the display device receives an input operation (such as a split-screen operation) performed by the user on the display, and the kernel layer can generate corresponding input according to the input operation. event and report the event to the application framework layer.
  • the window mode (such as multi-window mode) corresponding to the input operation is set by the activity manager of the application framework layer
  • the window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display.
  • the application layer includes at least one application that can display corresponding icon controls on the display, such as: Live TV application icon controls, Video On Demand (VOD) applications Program icon control, media center application icon control, application center icon control, game application icon control, etc.
  • VOD Video On Demand
  • the live TV application may provide live TV from different sources.
  • a live TV application can access input from cable, over-the-air, satellite services, or other types of live TV services to provide TV signals.
  • the live TV application may display the video of the live TV signal on the display device 200 .
  • a video-on-demand application may provide video from various storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. For example, video-on-demand can come from the server side of cloud storage, from local hard disk storage containing existing video programs.
  • the media center application may provide various multimedia content playback applications.
  • a media center may provide services other than live TV or video-on-demand, where users can access various images or audio through a media center application.
  • the application center may provide storage of various applications.
  • An application can be a game, an application, or some other application that is related to a computer system or other device but can be run on a Smart TV.
  • the application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200 .
  • the present application provides a method based on the communication interaction between display devices and terminal devices to realize remote diagnosis of terminal devices and monitor the running status of display devices.
  • the display device and the terminal device can communicate through the Internet. In some embodiments, as shown in FIG.
  • the display device 200 and the terminal device 500 can communicate through the server 400 , the display device 200 is the device to be diagnosed, and the terminal device 500 is capable of monitoring the operation of the display device, fault location analysis, remote control
  • the server 400 realizes the interaction of data, information, instructions and other contents between the display device and the terminal device, and is the center for establishing the connection between the display device 200 and the terminal device 500 and data processing.
  • the premise of the implementation of the present application is that the display device 200 and the terminal device 500 are in a networked state.
  • a fault diagnosis application 1 may be set in the display device 200 , and the fault diagnosis application 1 is the entrance of the display device to access the fault diagnosis function. After the user starts the fault diagnosis application 1, the display device 200 and the terminal device 500 Establishing a communication connection means allowing the devices at both ends to communicate through the intermediate server 400, thereby starting the process of remote fault diagnosis.
  • the local data can be collected through, for example, JNI (Java Native Interface, Java Native Interface), relevant data collection interfaces in the system, and system SDK (Software Development Kit, software development kit).
  • System state information the system state information is not limited to including state information such as country settings, language settings, network (Network), picture mode (Pciture Mode), sound mode (Sound Mode), system information (systeminfo), and other information that is conducive to judgment Information on the operating status of the machine and analysis of fault conditions.
  • the system SDK may function as a transceiver interface for communication between the display device 200 and the server 400 .
  • the display device 200 sends the system status information obtained by the local end to the server 400 , and at the same time, the display device also needs to send the video stream of the local screen image to the server 400 together.
  • the controller 250 of the display device needs to perform mixing processing on the video images first, that is, mixing the images of the video layer and the OSD layer (On-Screen Display, on-screen menu adjustment mode), so as to assemble a frame of screen images, The real-time screen frames of each frame are synchronized to the server 400 .
  • a fault diagnosis application 2 is preset in the terminal device 500, and the fault diagnosis application 2 may be a browser-based application, so that the fault of the remote display device 200 can be diagnosed and remote control.
  • the fault diagnosis application 2 has been started and the terminal device 500 and the display device 200 have been successfully connected, the system status information and screen images of the display device 200 can be received through the fault diagnosis application 2, so that the screen images of the display device 200 can be displayed in real time. Synchronized to the terminal device 500, and the devices at both ends always maintain the screen synchronization.
  • the screen image of the display device 200 changes due to factors such as user operations, the screen displayed by the terminal device 500 is switched synchronously.
  • the terminal device 500 after the terminal device 500 acquires the screen image, it plays the screen image at the local end synchronously, so that the technician can view the screen image of the remote display device 200 in real time and intuitively on the terminal device. Automatically analyze whether there is an abnormality and the type of failure; technicians can also view the real-time screen of the display device 200 to further intuitively judge the problems that occur in the operation of the display device, so as to obtain whether there is a failure and the specific failure type, so as to give follow-up Targeted troubleshooting measures.
  • this embodiment establishes a unique connection between the display device 200 and the terminal device 500 based on the PIN code.
  • the specific implementation method is: the controller 250 sends a connection request to the server 400 in response to the operation of starting the fault diagnosis application 1, and the said The connection request carries the identification information of the display device 200.
  • the identification information described here is, for example, in the form of a MAC address, an IP address, or a unique device ID, which is convenient for the server 400 to accurately identify and distinguish the display device; after the server 400 responds to the connection request, it sends The display device that sends the request issues the PIN code; after the display device receives the PIN code, as shown in FIG. 7 , the display 275 can be controlled to display the PIN code. 043-525), and a prompt message is displayed below the PIN code.
  • the prompt message is used to prompt the user to establish a PIN code connection with the terminal device within a preset time.
  • the prompt message in Figure 7 is "Please establish a connection within 80s", That is, the preset time is 80 seconds.
  • the user of the display device can inform the technician who needs to remotely diagnose the fault within the preset time.
  • This notification behavior means that the user allows the terminal device 500 to remotely diagnose the machine.
  • the person enters the learned PIN code in the connection interface of the terminal device 500. If the PIN code matches, the verification is successful, so that the terminal device 500 has the right to remotely access the display device 200, that is, the terminal device 500 and the display device 200 are successfully connected. It should be noted that, the manner in which the terminal device 500 and the display device 200 are securely connected is not limited to that described in this embodiment.
  • the fault diagnosis application 2 in the terminal device 500 will display the required page.
  • the fault diagnosis application 2 includes page sections such as “Overview”, “Control”, “Diagnosis”, “Tools” and “History”.
  • the “Overview” page will display some basic information, such as the currently connected session code (ie PIN code), the brand, model, serial number, version, first registration time, and last boot of the connected display device 200 time etc.
  • the system information received from the display device 200 will be displayed on the “Diagnostics” page, including “Image Check”, “Sound Check”, “TV Reception Analysis”, “HDMI
  • the analysis contents such as "Port Analysis”, “Network Check” and “Bluetooth Analysis” are based on the obtained system status information of the display device 200, and involve the failure analysis of different hardware function configurations in the display device 200, and give the corresponding analysis
  • the analysis results may include whether an abnormality occurs and which portion of the located abnormality occurs.
  • the “Tools” page provides some operational tools for diagnosis and adjustment, including changing source, image diagnosis, sound diagnosis, TV diagnosis, factory reset, device configuration, reset image /sound settings, restore image/sound adjustments, etc.
  • the current configuration can be displayed, and the technician can be supported to adjust the configuration parameters adaptively.
  • the current sound configuration is volume 15, mute and standard mode, etc.
  • the technician can, for example, If it is adjusted to be non-muted, the display device 200 can be remotely controlled to unmute, so that the speaker can play a sound with a volume of 15 instead of a mute state.
  • the technician can also choose to reset the settings, and the hardware configuration will be restored to the parameters before the adjustment. If the technician chooses to resume the adjustment again, the setting reset will be canceled and the parameter configuration will be restored to the previously adjusted parameter configuration.
  • the “Control” page is mainly divided into two parts, the left part plays the screen of the display device 200 synchronously in real time, and the right part displays a virtual remote control, which includes a remote control.
  • the button function configuration of the virtual remote control is consistent with the physical remote control used by the display device 200. Therefore, the technician can completely simulate the manipulation of the display device 200 by the physical remote control by remotely operating the virtual remote control. And can be used to locate problems on the keys.
  • the technician When the technician sees a faulty picture on the screen, he can analyze the cause of the current failure of the display device and locate it. Depending on the type of failure, you can then adjust some configuration parameters of the display device through the diagnostic tool, or perform remote key control through the virtual remote control.
  • a technician triggers a button in the virtual remote control to input a remote control command
  • the terminal device 500 sends the remote control command to the display device 200 through the server 400
  • the system SDK in the display device 200 parses the remote control command
  • the key value corresponding to the command is obtained, and the system SDK can further call JNI to trigger key distribution on the display device, so as to execute the control task corresponding to the key value, and complete the manipulation and processing of the key on the display device.
  • the screen image and the virtual remote control can be displayed simultaneously in the form of FIG. 11 .
  • the technician enters the control page he may just want to view the screen image of the display device without performing remote control, so only the screen image can be displayed by default, which is equivalent to the virtual remote control being hidden; when When the user wants to remotely control the display device 200, he can input a first operation to control the display of the terminal device to display a virtual remote control. .
  • the "History" page provides a query of historical troubleshooting records.
  • the terminal device 500 should at least include a display for synchronously playing the screen images of the display device, a communicator for communicating with the server 400 (and thus connecting with the display device 200 through the server 400 ), and a controller,
  • Other software and hardware configurations of the terminal device 500 are not limited.
  • a fault diagnosis method is also provided, the execution subject of the method is the controller in the terminal device 500, and the method includes:
  • Step (A) in response to receiving the system state information and the screen image sent by the display device, synchronously playing the screen image;
  • Step (B) according to the screen image and the system state information, diagnosing whether the display device is faulty and the type of the fault.
  • the method further includes:
  • Step (C) in response to receiving the inputted first operation, displaying a virtual remote control; wherein, the virtual remote control includes several keys for remotely controlling the display device;
  • Step (D) in response to receiving the remote control command input through the virtual remote control, sending the remote control command to the display device, so that the display device parses the key value corresponding to the remote control command, and executes The control task corresponding to the key value of the key.
  • the method further includes: communicating with the display device by verifying the PIN code.
  • Embodiments of a display device, an embodiment of a fault diagnosis method executed in a display device, an embodiment of a terminal device, and an embodiment of a fault diagnosis method executed in a terminal device can be verified by mutual reference between these embodiments. No longer.
  • the display device 200 After the display device 200 starts the fault diagnosis application 1, it sends a connection request to the server 400; the server 400 responds to the connection request and sends a PIN code; the display device 200 receives and displays the PIN code and prompt information; the PIN code is entered in the terminal device 500 for verification, and after the verification is successful, the display device 200 establishes a connection with the terminal device 500; The system state information and the screen image are sent to the server 400 together; the server 400 forwards the received system state information and screen image to the terminal device 500; after the terminal device 500 receives the system state information and the screen image, it synchronizes in the fault diagnosis application 2 Playing the screen picture of the display device, and diagnosing whether the display device is faulty and the type of the fault according to the screen picture and the system status information; the terminal device 500 displays the virtual remote control on the control page in response to receiving the first operation of the input, and responds to receiving the first operation.
  • the remote control command is sent to the server 400; the server 400 sends the remote control command to the display device 200; the display device 200 parses the received remote control command, and obtains the key corresponding to the remote control command key value, and execute the control task corresponding to the key value.
  • the present application uses the terminal device 500 to remotely monitor the display device 200, that is, the display device 200 needs to communicate and interact with the terminal device.
  • the display device 200 starts the fault diagnosis application 1
  • the system status information and screen images of the local end are obtained. , and send it to the terminal device 500 through the server 400; after the terminal device 500 obtains the screen image, it plays the screen image at the local end synchronously, so that the technician can view the screen interface of the remote display device 200 in real time and intuitively on the terminal device, which will be displayed soon.
  • the screen image of the device 200 is synchronously shared with the terminal device 500 that analyzes the fault.
  • the present application provides a solution of using a virtual remote controller of a terminal device to simulate a physical remote controller to remotely control the display device.
  • This application realizes remote diagnosis and monitoring of display device faults in terminal equipment, and real-time analysis of the operation behavior of display equipment, without the need for fault simulation or on-site fault location, and its fault diagnosis method is not affected by the use scene of the display equipment, geographical environment, etc. The influence of factors greatly reduces the consumption of time and cost, improves the efficiency of fault diagnosis, and facilitates rapid troubleshooting and resolution, thereby bringing a better experience to users.
  • the present application also provides a computer storage medium, where a program can be stored in the computer storage medium.
  • the program may include the program steps involved in the aforementioned fault diagnosis method that the controller 250 is configured to execute; when the computer storage medium is located in the terminal device 500, the program may include The controller in the terminal device 500 is configured to execute the program steps involved in the fault diagnosis method.
  • the computer storage medium may be a magnetic disk, an optical disc, a read-only memory (English: Read-Only Memory, ROM for short) or a random access memory (English: Random Access Memory, RAM for short).

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage. Le procédé fait appel aux étapes suivantes : en réponse à la réception d'informations d'état de système et d'une image d'écran envoyée par un dispositif d'affichage, la lecture de manière synchrone de l'image d'écran ; et selon l'image d'écran et les informations d'état de système, le diagnostic quant au fait de savoir si une défaillance se produit dans le dispositif d'affichage, et d'un type de défaillance.
PCT/CN2021/119570 2020-11-17 2021-09-22 Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage WO2022105409A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011284412.4 2020-11-17
CN202011284412.4A CN112565740A (zh) 2020-11-17 2020-11-17 故障诊断方法、终端设备及显示设备

Publications (1)

Publication Number Publication Date
WO2022105409A1 true WO2022105409A1 (fr) 2022-05-27

Family

ID=75043076

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/119570 WO2022105409A1 (fr) 2020-11-17 2021-09-22 Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage

Country Status (2)

Country Link
CN (1) CN112565740A (fr)
WO (1) WO2022105409A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115168158A (zh) * 2022-09-05 2022-10-11 北京电科智芯科技有限公司 监控方法、终端设备、服务器、系统和存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112565740A (zh) * 2020-11-17 2021-03-26 海信视像科技股份有限公司 故障诊断方法、终端设备及显示设备
CN114628016B (zh) * 2022-05-17 2022-11-11 西南医科大学附属医院 一种基于大数据的腹腔镜手术器械运行故障预测系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823458A (zh) * 2014-03-17 2014-05-28 广东华南计算技术研究所 设备远程诊断装置及其诊断方法与系统
US20150015379A1 (en) * 2012-02-22 2015-01-15 Samsung Medison Co., Ltd. Method of controlling image diagnosis apparatus and mobile terminal for the same, and method of operating image diagnosis apparatus and image diagnosis apparatus for the same
CN106454478A (zh) * 2016-09-09 2017-02-22 腾讯科技（深圳）有限公司 一种图形识别码调整方法、装置及系统
CN111666180A (zh) * 2020-07-08 2020-09-15 北京恒泰实达科技股份有限公司 一种支持ppt演示的双机热备控制方法及系统
CN112565740A (zh) * 2020-11-17 2021-03-26 海信视像科技股份有限公司 故障诊断方法、终端设备及显示设备

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101192997A (zh) * 2006-11-24 2008-06-04 中国科学院沈阳自动化研究所 分布式设备远程状态监测与故障诊断系统
US20130218783A1 (en) * 2012-02-21 2013-08-22 Digital Manufacturing, Inc. Apparatus and method for real-time data capture and usage for fault repair
CN105828368A (zh) * 2015-01-08 2016-08-03 中兴通讯股份有限公司 一种故障定位的方法和相应装置
CN107070980A (zh) * 2017-01-22 2017-08-18 微鲸科技有限公司 智能终端的远程协助方法、装置及系统
CN106936933B (zh) * 2017-04-27 2018-05-29 广东南方新视界传媒科技有限公司 一种led屏幕智能远程监测控制系统
CN107562040A (zh) * 2017-09-18 2018-01-09 内蒙古自治区大气探测技术保障中心 故障诊断流程的获取方法以及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150015379A1 (en) * 2012-02-22 2015-01-15 Samsung Medison Co., Ltd. Method of controlling image diagnosis apparatus and mobile terminal for the same, and method of operating image diagnosis apparatus and image diagnosis apparatus for the same
CN103823458A (zh) * 2014-03-17 2014-05-28 广东华南计算技术研究所 设备远程诊断装置及其诊断方法与系统
CN106454478A (zh) * 2016-09-09 2017-02-22 腾讯科技（深圳）有限公司 一种图形识别码调整方法、装置及系统
CN111666180A (zh) * 2020-07-08 2020-09-15 北京恒泰实达科技股份有限公司 一种支持ppt演示的双机热备控制方法及系统
CN112565740A (zh) * 2020-11-17 2021-03-26 海信视像科技股份有限公司 故障诊断方法、终端设备及显示设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115168158A (zh) * 2022-09-05 2022-10-11 北京电科智芯科技有限公司 监控方法、终端设备、服务器、系统和存储介质

Also Published As

Publication number Publication date
CN112565740A (zh) 2021-03-26

Similar Documents

Publication Publication Date Title
CN111935518B (zh) 一种视频投屏方法及显示设备
WO2022105409A1 (fr) Procédé de diagnostic de défaillance, dispositif terminal, et dispositif d'affichage
CN114286165B (zh) 一种显示设备、移动终端、投屏数据传输方法及系统
CN112367543B (zh) 显示设备、移动终端、投屏方法及投屏系统
CN114302190A (zh) 一种显示设备及画质调整方法
WO2022073392A1 (fr) Procédé d'affichage d'image et dispositif d'affichage
CN111836115B (zh) 一种屏保展示方法、屏保跳转方法及显示设备
WO2022048203A1 (fr) Procédé d'affichage et dispositif d'affichage destinés à la manipulation d'informations d'invite de commande de procédé de saisie
WO2022021669A1 (fr) Procédé pour la commande d'un mode d'image intelligent et dispositif d'affichage
CN111683279A (zh) 显示设备及图像恢复方法
CN112565862A (zh) 一种显示设备及其设备参数的记忆方法、恢复方法
WO2021120586A1 (fr) Procédé de synchronisation de compte, dispositif mobile et télévision intelligente
CN112118400A (zh) 显示设备上图像的显示方法及显示设备
CN111970549A (zh) 菜单显示方法和显示设备
CN111954059A (zh) 屏保的展示方法及显示设备
CN111866498B (zh) 一种摄像头异常处理方法及显示设备
CN112306604B (zh) 一种传输文件的进度显示方法及显示设备
CN112040535B (zh) 一种Wifi处理方法及显示设备
CN116017006A (zh) 显示设备及与功放设备建立通信连接的方法
CN112269668A (zh) 一种应用资源共享及显示设备
CN112256449A (zh) 网页应用程序的接口调用方法、显示设备及服务器
CN111918132B (zh) 一种显示设备及多接口设备判断方法
CN114390190B (zh) 显示设备及监测应用启动摄像头的方法
CN114302197A (zh) 一种语音分离控制方法及显示设备
CN114286320A (zh) 一种显示设备、移动终端及蓝牙连接方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21893560

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21893560

Country of ref document: EP

Kind code of ref document: A1