CN113077859A

CN113077859A - Display device, control apparatus, and abnormality processing method

Info

Publication number: CN113077859A
Application number: CN202110298444.8A
Authority: CN
Inventors: 穆聪聪; 卢可敬; 马晓娜; 姜璐珩; 蒋伟; 王守帅; 沈润渊
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-02-10
Filing date: 2021-03-19
Publication date: 2021-07-06
Also published as: WO2022170828A1; CN113012779B; CN113077909A; CN114903433A; CN113012779A; CN114302185B; CN114903430A; CN114296578A; CN114903432A; CN113077860A; CN113077910A; CN114327345A; WO2022170827A1; CN114903446A; CN114903431A; CN113077861A; CN113077909B; WO2022170826A1; CN114302185A

Abstract

The application discloses a display device, a control device and an exception handling method, wherein the display device monitors whether user contact exception occurs or not in the process of acquiring user health data based on the contact of a user and a touch area; if the user contact is abnormal, detecting whether the user is in contact with the touch area again within a preset time length after the user contact is abnormal; and if the user is detected to be in contact with the touch area again, continuously acquiring the health data of the user until the number of the acquired effective data reaches the preset number. Therefore, in the process of acquiring the health data of the user, if the user contact is temporarily disconnected, the acquisition can be continued until the number of the acquired effective data reaches the preset number, so that the operation difficulty of the user is reduced, and the data acquisition failure caused by temporary contact failure or improper operation is avoided. In addition, the pressure of the user can be reduced, the situation that the user is nervous is avoided, and the user experience is improved.

Description

Display device, control apparatus, and abnormality processing method

Technical Field

The present application relates to the field of display device technologies, and in particular, to a display device, a control apparatus, and an exception handling method.

Background

With the continuous development of communication technology, terminal devices such as computers, smart phones and display devices are becoming more and more popular. Moreover, the user's demand for functions or services that can be provided by the terminal device is also increasing. Display devices, such as smart televisions, can provide playing pictures, such as audio, video, pictures, etc., for users, and are receiving much attention today.

With the popularization of display devices, the functions provided by the display devices can influence and change the lives of users, and the demands of the users for living, entertainment and leisure through the display devices are stronger and stronger. Based on the increasing attention and importance of families to the personal health condition and health preserving mode of members, how to monitor, record and improve the health of users through display equipment is a technical problem to be solved urgently at present.

Disclosure of Invention

The application provides a display device, a control apparatus, and an exception handling method.

In a first aspect, the present application provides a display device comprising:

a display;

a controller configured to:

monitoring whether user contact abnormity occurs in the process of acquiring user health data based on the contact of a user and a touch area;

if the user contact is abnormal, detecting whether the user is in contact with the touch area again within a preset time length after the user contact is abnormal;

if the user is detected to be in contact with the touch area again within the preset time length, continuing to collect the user health data until the quantity of the collected effective data reaches a preset quantity, wherein the effective data refers to the user health data collected when no abnormal detection exists.

In a second aspect, the present application also provides a control apparatus, comprising:

a touch area;

the health data acquisition module is connected with the touch area and is used for detecting the contact between a user and the touch area, and the health data acquisition module is used for acquiring user health data based on the contact between the user and the touch area;

a controller in communication with the health data acquisition module and the contact detection module, configured to:

responding to a data acquisition instruction sent by display equipment, and controlling the health data acquisition module to start acquiring user health data;

sending a health data packet containing the latest user health data and an abnormal identifier to display equipment every other preset time, wherein the abnormal identifier is used for representing whether detection abnormality and an abnormal type exist;

when the contact detection module detects that the user is disconnected from the touch area, the health data packet containing the latest user health data and the abnormal mark representing the abnormal contact of the user is sent to the display device, and when the contact detection module detects that the user is in renewed contact with the touch area, the health data packet containing the latest user health data and the abnormal mark representing the no abnormal contact is sent to the display device.

In a third aspect, the present application further provides an exception handling method applied to a display device, where the method includes:

In a fourth aspect, the present application further provides an exception handling method applied to a control device, where the control device includes a touch area, and the method includes:

responding to a data acquisition instruction sent by display equipment, and acquiring user health data based on contact between a user and the touch area;

when the condition that the user is in contact with the touch area again is detected, the health data packet containing the latest user health data and the abnormal mark representing the abnormal contact of the user is sent to the display device.

According to the technical scheme, the application provides the display equipment, the control device and the exception handling method. The method comprises the steps that the display equipment monitors whether user contact abnormity occurs or not in the process of acquiring user health data based on contact between a user and a touch area; if the user contact is abnormal, detecting whether the user is in contact with the touch area again within a preset time length after the user contact is abnormal; if the user is detected to be in contact with the touch area again within the preset time length, continuing to collect the user health data until the quantity of the collected effective data reaches the preset quantity, wherein the effective data refers to the user health data collected when no abnormal detection exists. Therefore, in the process of acquiring the health data of the user, if the user contact is temporarily disconnected, the acquisition can be continued until the number of the acquired effective data reaches the preset number, so that the operation difficulty of the user is reduced, and the data acquisition failure caused by temporary contact failure or improper operation is avoided. In addition, the pressure of the user can be reduced, the situation that the user is nervous is avoided, and the user experience is improved.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

FIG. 1 is a usage scenario of a display device shown in some embodiments of the present application;

fig. 2 is a block diagram of a hardware configuration of the control apparatus 100 shown in some embodiments of the present application;

fig. 3 is a block diagram of a hardware configuration of a display device 200 shown in some embodiments of the present application;

FIG. 4 is a diagram of the software configuration in a display device 200 shown in some embodiments of the present application;

FIG. 5A is another use scenario of a display device shown in some embodiments of the present application;

FIG. 5B is a schematic external view of a remote control unit according to some embodiments of the present application;

FIG. 6 is a schematic diagram illustrating an interaction process between a display device and a remote controller according to some embodiments of the present application;

FIG. 7 is a start page of an application shown in some embodiments of the present application;

FIG. 8 is a user agreement presentation page of an application shown in some embodiments of the present application;

FIG. 9 is an application home page of an application shown in some embodiments of the present application;

FIG. 10 illustrates an archival information input interface in accordance with certain embodiments of the present application;

FIG. 11 illustrates an archive management interface in some embodiments of the present application;

FIG. 12 is a schematic diagram illustrating an interaction process of a display device with a remote control device according to some embodiments of the present application;

FIG. 13 is an operation guidance interface shown in some embodiments of the present application;

FIG. 14 is another operation guidance interface presented in some embodiments herein;

FIG. 15 is a schematic diagram illustrating an interaction process of a display device with a remote control device according to some embodiments of the present application;

FIG. 16 is another operation guidance interface presented in some embodiments herein;

FIG. 17 is a schematic diagram illustrating an interaction process of a display device with a remote control device according to some embodiments of the present application;

FIG. 18 is a detection interface shown in some embodiments of the present application;

FIG. 19 illustrates an exception prompt interface in some embodiments of the subject application;

FIG. 20 is a test results interface shown in some embodiments of the present application;

FIG. 21 is another test result interface presented in some embodiments herein;

FIG. 22 illustrates a method of exception handling in some embodiments of the present application.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The application provides a terminal device, which can be a display device, such as an intelligent television and a touch control all-in-one machine, and can also be a portable mobile terminal, such as a mobile phone and a tablet personal computer. For convenience of description, the following description mainly takes a display device as an example to describe a specific implementation of the technical solution related to the embodiments of the present application.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, thereby mediating interaction between the user and the display device 200.

In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.

In some embodiments, the control device 100 further comprises a health data acquisition module 150 for acquiring user health data including heart rate, blood oxygen status, systolic pressure, diastolic pressure, etc.

In some embodiments, the control device 100 further comprises a contact detection module 160 coupled to the touch area on the control device housing for detecting contact input by the user on the touch area.

In some embodiments, the health data collection module and the contact detection module communicate with the controller 110 via a serial port.

In some embodiments, the control device 100 shown in fig. 2 may be a remote controller.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the display device exterior surface is provided with a touch area for receiving user contact.

In some embodiments, the detector 230 further comprises a health data acquisition module coupled to the touch area for acquiring user health data, such as heart rate, blood oxygen status, systolic pressure, diastolic pressure, etc., based on user contact with the touch area. Optionally, the health data collection module and the controller 250 may communicate via a serial port, for example, the controller 250 turns on or off a switch of the health data collection module via the serial port, and the health data collection module transmits the collected health data of the user to the controller 250 via the serial port.

Illustratively, the touch area may be disposed on a side of the display device or on a surface of the rear housing. When the user touches the touch area on the side of the display device or on the surface of the rear case, the touch pad detects the contact input by the user.

It should be noted that, for a portable terminal device (such as a mobile phone, a tablet computer, etc.) supporting fingerprint identification, the health data collecting module may be disposed below the fingerprint identification area to connect with the fingerprint identification area, so as to collect the health data of the user based on the contact between the user and the fingerprint identification area. In addition, the health data acquisition module can be communicated with a controller of the portable terminal device through a serial port, for example, the terminal controller turns on or off a switch of the health data acquisition module through the serial port, and the health data acquisition module transmits acquired user health data to the terminal controller through the serial port.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).

In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or may be an application developed by a third party developer, such as the health manager application shown in fig. 4. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

In some embodiments, the controller controls the operation and response of the display device 200, as well as user operations associated with the display, by running various software control programs (e.g., an operating system and/or various application programs) in memory. For example, control presents a user interface on a display, the user interface including a number of UI objects (e.g., controls, icons, items, etc.); in response to a received user command to a UI object on the user interface, the controller may perform an operation related to the object selected by the user command.

The application provides a display device has a health detection function. The health detection function is implemented based on health detection function-related applications installed on the display device. For ease of description, the health-check function-related application will be referred to as a "health caretaker".

Fig. 5A is a schematic diagram of an application scenario shown in some embodiments of the present application. As shown in fig. 5A, the remote controller and the display device may communicate with each other based on Bluetooth Low Energy (BLE) protocol, such as receiving/transmitting control signals, notification messages, and user health data. In addition, the remote controller collects the user health data through a built-in health data collection module and sends the collected user health data to the display equipment in real time. The display equipment completes interactive control with the remote controller by running a health manager application in the operating system, receives user health data sent by the remote controller end and sends the user health data to the server. The server receives the user health data sent by the display device, analyzes the user health data through a health application service corresponding to a health manager application, and finally returns the health detection result to the display device, and the health detection result is displayed to the user by the display device.

As shown in fig. 5B, the remote controller has various keys and a touch area, and the touch area is connected to the health data acquisition module and the contact detection module. The contact detection module may detect user contact when the user makes contact with the touch area. Under the condition that the user keeps contact with the touch area, the health data acquisition module can acquire the health data of the user under the control of the remote controller.

In some embodiments, the user may initiate the health detection function of the display device by contact with a touch area on the remote control for a predetermined time. It should be appreciated that since the health detection function of the display device is implemented based on a "health caretaker" application installed on the display device, the health detection function of the display device is initiated, i.e., the "health caretaker" application on the display device is initiated. For example, the user may hold a finger in contact with the touch area for 3 seconds to launch the "health caretaker" application.

In concrete implementation, referring to fig. 6, when the remote controller is paired with the display device, after the contact detection module detects that the user is continuously in contact with the touch area, the controller of the remote controller is notified through serial port communication, and after receiving the notification, the controller of the remote controller sends a control instruction indicating to start the health detection function to the display device. The display device responds to the control instruction, starts the health manager application and displays an interface of the health manager application. Illustratively, when the display device plays a video program based on a live television application and a third-party audio/video application, if a control instruction indicating to start a "health manager" application is received, the currently running live television application or the third-party audio/video application is transitioned to the "health manager" application, and an interface of the "health manager" application, such as a start page or an application home page, is displayed.

Of course, a key for starting the health detection function may be further provided on the remote controller, so that the user may start the health detection function-related application on the display device by one key, and the specific operation process is not described in detail.

It should be noted that, in order to avoid confusion between the controller of the remote controller and the controller of the display device during the description, the remote controllers mentioned below are all referred to as the controller of the remote controller, such as the controller 110 shown in fig. 2, unless otherwise specified. For example, if "the remote controller communicates with the health data collection module" is referred to hereinafter as "the controller of the remote controller communicates with the health data collection module", and if "the remote controller sends an instruction to the display device" is referred to hereinafter as "the controller of the remote controller sends an instruction to the display device".

It is noted that in case the remote control is not paired with the display device, a specific infrared code is emitted if the remote control detects a continuous contact of the user with the touch area. After the display equipment receives the specific infrared code, the health housekeeper application is started, the interface of the health housekeeper application is displayed, and meanwhile the pairing prompt is displayed, so that the user is reminded to operate the display equipment to be paired with the remote controller through the pairing prompt. For example, the user is prompted to operate the pairing by popping up a Toast prompt on the interface of the "health manager" application.

In other embodiments, the user may also enter a control command for launching the "health steward" application by entering a preset voice password. For example, a user speaks a preset voice password, such as "health detection" or "start health caretaker", using a near-field voice function or a far-field voice function of the display device, and the display device determines a control instruction corresponding to the voice password by recognizing the voice password input by the user, so as to start the health caretaker application.

In other embodiments, the user may further operate the display device to display the application center interface, and then launch the "health caretaker" application by clicking on an application icon of the "health caretaker" application displayed in the application center interface.

It should be noted that, for a terminal device with a built-in health data acquisition module, such as the display device with a touch area mentioned in the foregoing embodiment, or a portable terminal device supporting a fingerprint identification function, the health detection function is also implemented based on an installed health detection function related application, such as the above "health manager" application. In some embodiments, when such a display device or portable terminal device detects that the user has been in contact with the touch area for a preset time, the "health manager" application is pulled up, and the interface of the application is displayed. In one example, the display device has a health data acquisition module built therein and a touch area on the rear housing. When the user covers a finger on the backshell touch area for 3s, the display device starts the health manager application, and jumps to the interface of the health manager application from the current display interface. In another example, a user's mobile phone has a health data acquisition module built in and has a fingerprint identification area. When the user covers the finger on the fingerprint identification area for 3s, the mobile phone starts the application of 'health housekeeping' and displays the interface of the application of 'health housekeeping'.

In some embodiments, the "health steward" application, upon successful launch, first displays a launch page as shown in FIG. 7. Optionally, a presentation of the application-related function may be presented on the launch page. Optionally, when the display duration of the start page reaches a predetermined duration, the start page is deactivated, and the application home page is entered. For example, at the beginning of the display of the start page, a countdown is displayed in the upper left corner of the start page. And when the countdown is finished, the starting page is cancelled, and the application home page is entered.

In some embodiments, the "health steward" application, upon successful launch, first displays a user agreement presentation page. For example, in the case where the "health caretaker" application is successfully launched for the first time, the user agreement presentation page is displayed first. The user agreement presentation page may display application usage agreements or rules, such as disclaimer terms. The user can approve or reject the displayed protocol content by operating the related control on the user protocol presentation page. And if the user inputs the operation of agreeing the protocol content, the display device cancels the user protocol display page and enters a starting page or directly enters an application home page. If the user inputs an operation of rejecting the protocol content, the display device closes the health manager application, cancels the user protocol display page and returns to the interface before starting the health manager application.

Fig. 8 is a possible user protocol presentation page exemplarily illustrated in the present application. As shown in fig. 8, the user agreement presentation page includes an agreement content display area for displaying application use agreement or prescribed content, and a control display area for displaying user-operable controls, such as an "agree" control and a "reject" control. The user may select and determine the "agree" control to enter an operation to agree with the protocol content and may select and determine the "cancel" control to enter an operation to reject the protocol content.

In other embodiments, the display device may display a user protocol presentation area on an upper layer of the launch page, and display user protocol content and associated controls in the user protocol presentation area, thereby presenting the launch page and the user protocol content simultaneously.

Fig. 9 is an exemplary "health manager" application homepage for guiding a user to perform health check or build a health profile in a guest mode. As shown in fig. 9, the application home page includes a control "start setup" for triggering the setup of a health profile and a control "immediate experience" for triggering immediate health detection in guest mode. When displaying the application home page, the user may enter the profile information input interface by operating the "start setup" control, input user characteristic information in the profile information input interface, and input a health detection instruction in the profile management interface to instruct the display device to perform health detection on the specified user, which may be specifically referred to the embodiments shown in fig. 10 to 11; alternatively, the user may input a health detection instruction by operating an "immediate experience" control to instruct the display device to immediately health detect it.

Fig. 10 is an exemplary archive information input interface according to the present application, which may be specifically an interface entered by a user after operating a "start setup" control in a home page of an application. As shown in fig. 10, the file information input interface includes a plurality of input items, which are head portrait, nickname, gender, age, height, weight, and the like. The user can upload the head portrait file in the interface time, create a nickname of the user, and select gender, age, height and weight. After the input is finished, the display equipment can be instructed to store the input user characteristic information by operating the 'confirmation' control and enter the archive management interface, or the 'cancel' control is operated to return to the application home page.

FIG. 11 is an exemplary illustration of a profile management interface, which may be embodied as a user interface accessed after operating a "confirm" control in a profile information input interface. As shown in fig. 11, the archive management interface displays created archive cards, each archive card corresponds to a group of operation controls, which are a control for triggering health detection, "immediate physical examination" and a control for viewing previous health detection results, "physical examination report", respectively. The user can select the control on the corresponding file card to operate according to the detection object so as to input the health detection instruction. For example, when health detection on 'milk' is needed, an 'immediate physical examination' control on an archive card of 'milk' is operated. In addition, the file management interface also displays a tourist card, so that a user can operate the 'immediate physical examination' control on the tourist card to input a health detection instruction for detecting in a tourist mode. In addition, a control for newly building member file information, namely 'adding member +', is displayed in the file management interface, when a user operates the control, the user enters the file information input interface again, and the user can input the file information of the new member in the file information input interface.

Referring to fig. 12, in some embodiments, when the display device receives an input health detection instruction, an operation guidance interface is displayed, and a data acquisition instruction is sent to the remote controller to instruct the remote controller to start acquiring health data of the user.

Fig. 13 is an exemplary illustration of one possible operation guidance interface. As shown in fig. 13, operation guidance information is displayed on the operation guidance interface, and the information displays: the user needs to keep the fingers naturally and easily and completely cover the touch area, so that the health data acquisition module can smoothly acquire the health data of the user.

In some embodiments, the remote controller starts the health data acquisition module after receiving the data acquisition command sent by the display device. And after the health data acquisition module is successfully started, the remote controller sends a notification message indicating that the health data acquisition module is successfully started to the display equipment. As shown in fig. 12, in a specific implementation, the remote controller responds to the received data acquisition instruction, and turns on the switch of the health data acquisition module through serial port communication. After the switch of the health data acquisition module is turned on, the health data acquisition module informs the remote controller through serial port communication. Furthermore, the remote controller can judge whether the health data acquisition module is started successfully according to whether the notification of the health data acquisition module is received. And when judging that the health data acquisition module is successfully started, sending a notification message indicating that the health data acquisition module is successfully started to the display equipment. The display device executes timing operation after sending a data acquisition instruction to the remote controller. And if a notification message indicating that the health data acquisition module is started successfully is received within a preset time length, displaying a detection interface, wherein the detection interface is used for displaying detection progress and/or real-time user health data. And if the notification message indicating that the health data acquisition module is started successfully is not received within the preset time length, displaying a fault prompt on the operation guidance interface. For example, the content of the fault indication may be "failure to start the health data collection module" shown in fig. 14. And returning to the upper level interface after finishing the prompt.

Referring to fig. 15, in other embodiments, after receiving a data acquisition instruction sent by the display device, the remote controller starts the health data acquisition module, and detects whether there is user contact on the touch area through the contact detection module. When the contact detection module detects that the user is in contact with the touch area and the health data acquisition module is successfully started, the remote controller sends a notification message indicating the start of data acquisition to the display device. And after the display equipment sends a data acquisition instruction to the remote controller, timing operation is carried out to record the waiting time. And if a notification message which indicates that data acquisition is started and is sent by the remote controller is received within the preset waiting time (namely before the waiting time reaches the preset waiting time), displaying a detection interface, wherein the detection interface is used for displaying the detection progress and/or real-time user health data. And if the notification message which is sent by the remote controller and indicates to start data acquisition is not received within the preset waiting time, displaying a timeout prompt on the operation guidance interface. Illustratively, the content of the timeout indication may be "timeout, no user contact detected" shown in fig. 16. And returning to the upper level interface after finishing the prompt.

In some embodiments, the timing operation used to record the length of the wait period is referred to as a first timing operation.

In still other embodiments, when the display device receives an input health detection instruction, an operation guidance interface is displayed, and a control for triggering health detection, such as the "start detection" control in fig. 13, is displayed in the operation guidance interface. When the user operates the control, a data acquisition instruction is sent to the remote controller, and a detection interface is displayed.

In some embodiments, during the process of acquiring the user health data by the health data acquisition module, the remote controller transmits the acquired user health data to the display device in real time.

According to the embodiment, based on interactive control and cooperation of the remote controller and the display equipment, a user can start the health detection function of the display equipment through simple operation and acquire the health data of the user, so that the user can carry out health detection anytime and anywhere, and the experience is strong.

It should be noted that, for a terminal device with a built-in health data acquisition module, the terminal device controller responds to a health detection instruction input by a user, and turns on a switch of the health data acquisition module through a serial port. And after the health data acquisition module is successfully started, the health data acquisition module informs the terminal equipment controller through the serial port, and the terminal equipment controller controls the display of an operation guidance interface on the screen. And when the terminal equipment controller detects user contact within the preset waiting time, displaying a detection interface, and at the moment, starting to acquire the user health data by the health data acquisition module. In the data acquisition process, the health data acquisition module transmits the acquired user health data to the terminal equipment controller. And after the data acquisition is finished, the terminal equipment controller sends the acquired user health data to the server so as to analyze the user health data through the server and return a health detection result to the terminal equipment.

In some embodiments, to ensure the user experience of the health detection process and save the user time, the time for collecting data may be predefined, that is: the remote controller is limited to finish the collection and the transmission of the user health data within preset time, and the display equipment is limited to finish the reception of the user health data within preset receiving time.

In some embodiments, when the display device receives a notification message sent by the remote controller and indicating that data collection is started, a timing operation is performed to record a data receiving time length. In some embodiments, the timing operation for recording the data reception duration is referred to as a second timing operation.

In the data acquisition process, the remote controller packages the user health data acquired by the health data acquisition module into a data packet in real time and sends the data packet to the display equipment until the acquisition is finished. For the sake of distinction and explanation, the present application refers to the data packet encapsulating the user health data as a health data packet.

As shown in fig. 17, in an implementation manner, after the health data acquisition module is started, the health data of the user is continuously acquired, and the acquired health data of the user is synchronized to the remote controller in real time through serial port communication. And the remote controller encapsulates the acquired latest user health data in a health data packet at regular intervals and sends the health data packet to the display equipment until the health data acquisition module finishes acquiring. It should be noted that when the remote controller receives a preset number of valid data packets or the data receiving time reaches a predetermined time, the data collection is considered to be completed. The preset number is the preset receiving time length/the interval time length of sending the data packets to the display device, the valid data packets refer to the data packets sent to the display device when no detection abnormality exists, and the user health data encapsulated in the valid data packets are valid data. And after the data acquisition is finished, the display equipment sends an acquisition stopping instruction to the remote controller. The remote controller responds to the acquisition stopping instruction and closes the health data acquisition module.

Illustratively, the preset receiving time is 30s, and the preset number of health data packets is 24. That is, the remote controller should transmit 24 health data packets to the display device within 30 s.

In some embodiments, the remote controller encapsulates the acquired user health data into a health data packet according to a format agreed with the display device in advance, wherein the health data packet at least comprises a packet sequence identifier, user health data and an exception identifier. The packet sequence identifier i represents the ith health data packet sent to the display device by the remote controller, and the abnormal identifier represents whether detection abnormality exists and the abnormal type. It should be noted that the detection abnormality may include detection abnormality caused by a change in detection environment, such as a strong light environment, a weak communication signal, and the like, and also include detection abnormality caused by a contact between the user and the touch area, such as a movement of a finger of the user away from the touch area.

In one example, the data format of the health data packet is as follows:

in another example, the data format of the health data packet is as follows:

Bytel	Byte2-6	Byte7～23	Byte24～191	Byte182～197
					data head code	Package order mark	Collecting hardware ID	Raw health data	Retention

In some embodiments, after receiving the health data packet, the display device extracts the required data for displaying the detection interface from the health data packet, and then displays and updates the detection interface according to the extracted data, wherein the detection interface can display the detection progress and/or at least one item of user health data.

In specific implementation, firstly, hexadecimal bytes in the health data packet are converted into decimal, and then various health data and abnormal identifications are selected from the decimal bytes. In one example, after converting the hexadecimal bytes of the health data packet into decimal numbers, the obtained byte sequence is [1, 12, 76, -1, 29, 6, -13, -28, -40, -49, -57, -63, -66, -65, -63, -60, -60, -63, -68, -77, -86, -95, -103, -108, -111, -113, -112, -111, -110, -108, -109, -111, -115, -115, -109, -91, -59, -17, 29, 70, 97, 104, 92, 66, 33, 0, -26, -47, -60, -69, -73, -74, -73, -71, -69, -69, -72, -79, -86, -94, -101, -105, -109, -111, -112, -112, 35, 96, 84, -124, 25, 0, 111, 73, 46, -43, 0], wherein position 68 represents heart rate, position 69 represents blood oxygen, position 70 represents microcirculation, position 74 represents systolic blood pressure, position 75 represents diastolic blood pressure, and position 78 represents an abnormality marker. For example, anomaly 1 may represent a weak signal, anomaly 2 may represent a strong light environment, anomaly 3 may represent a contact anomaly, and anomaly 0 represents no anomaly.

In some embodiments, the display device determines the current detection progress according to the packet sequence identifier in the health data packet received latest and the preset number of health data packets. For example, assuming that the preset number is 24 and the packet sequence identifier of the latest received health data packet is 6, the current detection progress is determined to be 6/24, i.e., 25%.

In other embodiments, the display device determines the current detection progress according to the current data receiving duration and the preset receiving duration. For example, assuming that the current data receiving time length is 10s and the preset receiving time length is 30s, it is determined that the current detection progress is 10s/30s, that is, 1/3.

It should be appreciated that each time the display device receives a health data packet, the detection interface is updated according to the health data packet. For example, after the display device receives the 1 st health data packet, in the detection interface, part or all of the user health data in the 1 st health data packet, such as real-time heart rate status data and blood oxygen status data, and a detection progress, such as a progress bar representing the detection progress, may be displayed, and the detection progress may be determined according to the packet sequence identifier or the acquisition time of the health data packet. And when the display equipment receives the 2 nd health data packet, updating the detection interface according to the data in the 2 nd health data packet.

In some embodiments, a heart rate status curve is drawn in a content area on the upper side of the detection interface according to the heart rate status data in the health data packet, and the heart rate status value, the blood oxygen status data and the current detection progress are displayed in a content area on the lower side of the detection interface.

Fig. 18 illustrates a testing interface in some exemplary embodiments of the present application, in which a real-time heart rate status curve is displayed in a content area on the upper side of the interface, and a testing progress bar with a heart rate status value "70 BPM", a blood oxygen status value "85%" and a current progress of "62%" is sequentially displayed in a content area on the lower side of the interface.

In the above embodiment, after the "health manager" application is started, in response to an input health detection instruction, a data acquisition instruction is sent to the remote controller while the operation guidance interface is displayed. The remote controller starts the health data acquisition module in response to receiving the data acquisition instruction, and then enters the health detection process introduced in the above embodiment.

It should be appreciated that during the health detection process, the health data collection module collects user health data based on user contact with the touch area. Thus, during the health detection process, the user is required to keep the finger in contact with the touch area. Once the user removes the finger from the touch area, the contact between the user and the touch area is broken, and the data collected by the health data collection module is not the real health data of the user, so that the detection abnormality is caused. For convenience of explanation, in the embodiment of the present application, a detection abnormality caused by disconnection of the user contact with the touch area is referred to as a user contact abnormality. It should be understood that the abnormal conditions affecting the health data collection of the user also include weak communication signals, strong light environments, and the like.

As described above, the remote controller notifies the display device of the presence or absence of an abnormality and the type of the abnormality by encapsulating the abnormality flag in the health data packet. Illustratively, in the process of acquiring the health data of the user through the health data acquisition module, if the contact detection module detects that the contact between the user and the touch area is disconnected, which indicates that the user removes a finger from the touch area, the contact detection module notifies the remote controller through serial port communication. The remote controller determines that the user contact abnormity occurs according to the notification of the contact detection module. At this time, the remote controller encapsulates an abnormal identifier indicating that the user is in contact with the abnormal information in the health data packet, and sends the abnormal identifier to the display device. The display device can determine that the user contact abnormity occurs according to the abnormity identification in the data packet. When the abnormal condition exists, the remote controller encapsulates an abnormal mark which indicates no abnormal condition in the health data packet and sends the abnormal mark to the display equipment; the display device may determine that there is no abnormality currently according to the abnormality identifier in the health data packet.

In some embodiments, the contact detection module continues to detect contact of the user with the touch area after detecting disconnection of the user contact with the touch area, while the health data collection module continues to collect the user health data. When the contact detection module detects that the user is in contact with the touch area again, the remote controller is informed through serial port communication. The remote controller determines that the user is in contact with the touch area again according to the notification of the serial port communication, namely the user contact abnormity is relieved. At this time, the remote controller encapsulates an abnormal identifier which represents no abnormality in the health data packet, and sends the abnormal identifier to the display device. The display device can determine whether the user contact abnormity is removed or not according to the abnormity identification in the data packet.

In some embodiments, the data packet sent by the remote controller to the display device in the abnormal condition (including after the abnormal condition is removed) is a valid data packet, that is, the abnormal identifier in the valid data packet represents no abnormality. The data packet sent to the display device by the remote controller under the abnormal condition is an invalid data packet, namely, the abnormal identifier in the invalid data packet represents the abnormal types of user contact abnormity, weak communication signal or strong light environment and the like. In this way, the display device can distinguish between valid and invalid data packets based on the anomaly identification in the health data packets.

In some embodiments, after receiving the health data packet sent by the remote controller, the display device determines whether the health data packet is a valid data packet according to the abnormal identifier in the health data packet. And if the health data packet is a valid data packet, updating the detection interface according to the health data packet.

It should be understood that the display device may also determine whether the health data packet is valid based on the user health data in the health data packet. For example, when there are a plurality of 0's in the user health data, it may be determined that the user health data is invalid data, and the health data packet is an invalid data packet.

In some embodiments, the display device counts the number of received valid data packets in real time during the data receiving process, so as to determine whether the data collecting process can be terminated according to whether the number of valid data packets reaches a preset number.

In some embodiments, after receiving a health data packet sent by a remote controller, the display device determines whether user contact abnormality occurs according to an abnormality identifier in the health data packet; and if the user contact is abnormal, timing is executed to record the abnormal duration, and whether the user is in re-contact with the touch area within the preset duration is judged according to whether the valid data packet sent by the remote controller is received within the preset duration in which the user contact is abnormal. And if the valid data packet sent by the remote controller is not received within the preset time length in which the user contact is abnormal, indicating that the user does not contact the touch area again within the preset time length, sending a control instruction for indicating the remote controller to stop collecting data. The remote controller responds to the received control instruction and closes the health data acquisition module. If the valid data packets sent by the remote controller are received within the preset time length in which the user contact abnormity occurs, the user is indicated to be in re-contact with the touch area within the preset time length, namely the user contact abnormity is relieved, the healthy data packets sent by the remote controller are continuously received, and the number of the received valid data packets is recorded. And when the number of the received effective data packets reaches the preset number, sending a control instruction for instructing the remote controller to stop collecting data to the remote controller, and sending all the effective data packets to the cloud server. The remote controller closes the health data acquisition module in response to receiving a control instruction indicating that data acquisition is to be stopped.

It can be seen from the above embodiments that, in the process of acquiring the health data of the user, if the user contact is temporarily disconnected, the user contact can be continuously acquired until the acquired effective data amount reaches the preset amount, so that the operation difficulty of the user is reduced, and the data acquisition failure caused by temporary contact failure or improper operation is avoided. In addition, the pressure of the user can be reduced, the situation that the user is nervous is avoided, and the user experience is improved.

If the time for the user to contact and disconnect is too long, namely the time exceeds the preset time, the data acquisition fails, namely the health detection fails.

In other embodiments, after receiving a notification message sent by a remote controller and indicating that data collection is started, the display device executes a first timing operation to record a data receiving duration; after receiving the health data packet sent by the remote controller, the display equipment judges whether user contact abnormity occurs according to the abnormal identification in the health data packet; and if the user contact is abnormal, executing a second timing operation to record the abnormal duration, and judging whether the user is in re-contact with the touch area within the maximum duration according to whether the effective data packet sent by the remote controller is received before the abnormal duration reaches the maximum duration. And if the effective data packet sent by the remote controller is not received before the abnormal duration reaches the maximum duration, sending a control instruction for indicating the remote controller to stop collecting data to the remote controller. The remote controller responds to the control instruction and closes the health data acquisition module. And if the valid data packet sent by the remote controller is received before the abnormal duration reaches the maximum duration, continuing to receive the healthy data packet sent by the remote controller until the data receiving duration reaches the preset receiving duration. And when the data receiving duration reaches the preset receiving duration, sending a control instruction for instructing the remote controller to stop collecting data, and sending all received effective data packets to the cloud server. The remote controller closes the health data acquisition module in response to receiving a control instruction instructing it to stop acquiring data.

It is noted that in some embodiments, the data acquisition duration is equal to the data receiving duration, and the preset acquisition duration is equal to the preset receiving duration.

It can be seen from the above embodiments that in the process of collecting the user health data, if the user contact is temporarily disconnected, the user can continue to collect the data, so that the operation difficulty of the user is reduced, and the data collection failure caused by temporary contact failure or improper operation is avoided. In addition, the pressure of the user can be reduced, the situation that the user is nervous is avoided, and the user experience is improved.

If the user contact is broken for too long, i.e., beyond the maximum duration, the data collection fails, i.e., the health check fails.

In some embodiments, if the health check fails, an exception prompt interface is displayed. The abnormity prompting interface comprises a control used for triggering re-detection, and a user can trigger a new detection process by operating the control. In addition, the abnormality prompt interface can also prompt failure reasons, user suggestions and the like.

FIG. 19 illustrates an exception prompt interface in some exemplary embodiments of the present application. As shown in fig. 19, the abnormality prompt interface displays: the failure reason "data anomaly rate is high and detection results cannot be generated normally", and the user suggests "suggest to detect again, please keep fingers completely covered in the touch area during detection". In addition, a re-detection control and a cancel control are displayed on the abnormity prompting interface, a user can click the re-detection indication to return to the operation guide interface for re-detection, and can click the cancel control to return to the application home page.

It should be noted that, for the terminal device with the built-in health data acquisition module, when it detects that the user contact is abnormal in the process of acquiring the health data of the user through the health data acquisition module, a timing operation is executed to record the abnormal duration. If user contact is not re-detected for the maximum duration, the health data collection module is turned off to stop collecting data. If the user contact is re-detected within the maximum duration, the health data acquisition module is not closed to continue to acquire data until the acquired effective user health data meets the preset number or the data acquisition duration reaches the preset acquisition duration. And when the collected effective user health data meet the preset quantity, or the data collection duration reaches the preset collection duration, closing the health data collection module.

As described above, the display device performs interactive control with the remote controller by running the "health manager" application in the operating system, and receives the user health data sent from the remote controller. Therefore, once abnormal conditions such as flash back, blocking and the like occur to the application of the health manager, the display equipment cannot continue to carry out interactive control with the remote controller, and cannot continue to receive the user health data sent by the remote controller.

In some embodiments, to ensure normal communication between the remote controller and the display device, the display device periodically sends an online indication message to the remote controller after sending a data acquisition command to the remote controller. When the data receiving time length reaches the preset receiving time length or the effective data receiving quantity meets the preset receiving quantity (such as the preset quantity 24), the display equipment sends a collection stopping instruction to the remote controller and stops sending an online indicating message to the remote controller.

The remote controller judges whether the communication of the display equipment is abnormal according to the receiving condition of the online indicating message. For example, if online indication messages sent by the display device are not received for 3 consecutive times, it is determined that the display device is abnormal in communication. And if the communication of the display equipment is abnormal, closing the health data acquisition module to stop acquiring the health data of the user. If the display equipment is normally communicated all the time, the health data acquisition module is closed when an acquisition stopping instruction sent by the display equipment is received. It should be appreciated that after the health data collection module is turned off, the user health data will no longer be sent to the display device and, in turn, the health detection process will terminate.

In specific implementation, the health manager application sends a heartbeat packet to the remote controller at preset intervals. For example, a heartbeat packet is sent to the remote controller every 3 seconds. And if the remote controller does not receive the heartbeat packet sent by the health butler application for 3 times continuously, closing the health data acquisition module. Otherwise, when receiving a collection stopping instruction sent by the display equipment, closing the health data collection module.

In other embodiments, to ensure proper communication between the remote control and the display device, the remote control periodically sends an online query message to the display device during the data collection process. And the display equipment returns an online response message after receiving the online inquiry message sent by the remote controller. The remote controller judges whether the communication of the display equipment is abnormal according to the receiving condition of the online response message. For example, if online response messages returned by the display device are not received for 2 consecutive times, it is determined that the display device is abnormal in communication. And if the communication of the display equipment is abnormal, closing the health data acquisition module to stop acquiring the health data of the user. If the display equipment is normally communicated all the time, the health data acquisition module is closed when an acquisition stopping instruction sent by the display equipment is received.

In the specific implementation, in the data acquisition process, the remote controller sends a heartbeat packet to the health manager application at preset intervals. For example, a heartbeat packet is sent to the "health caretaker" application every 3 seconds. The health manager application returns a heartbeat response message to the remote controller after receiving the heartbeat packet sent by the remote controller. The remote controller can determine the communication connection condition with the health manager application according to the receiving condition of the heartbeat response message. And if the heartbeat response message sent by the health butler application is not received by the remote controller for 2 times continuously, indicating that the health butler application is abnormal in communication, closing the health data acquisition module, and further terminating the health detection process. Otherwise, when receiving a collection stopping instruction sent by the display equipment, closing the health data collection module.

In other embodiments, to ensure proper communication between the remote controller and the display device, the display device returns a receive response message to the remote controller in response to receiving the health data packet sent by the remote controller. The remote controller judges whether the communication of the display equipment is abnormal according to the receiving condition of the response message. For example, if the reception response message returned by the display device is not received 2 times consecutively, it is determined that the display device communication is abnormal. And if the communication of the display equipment is abnormal, closing the health data acquisition module to stop acquiring the health data of the user. Otherwise, when receiving a collection stopping instruction sent by the display equipment, closing the health data collection module.

In specific implementation, the health manager application returns a receiving response message to the remote controller after receiving the health data packet sent by the remote controller each time. And the remote controller determines the communication connection condition with the health manager application according to the receiving condition of the receiving response message. And if the remote controller does not receive the receiving response message returned by the health housekeeping application for 2 times continuously, which indicates that the communication of the health housekeeping application is abnormal, closing the health data acquisition module, and further terminating the health detection process.

It can be seen from the above embodiments that when the communication between the display device and the remote controller is abnormal due to the abnormal application of the "health manager", the remote controller can monitor the communication abnormality of the display device and actively turn off the health data acquisition module to terminate the data acquisition process, thereby preventing the health data acquisition module from being in a working state all the time and exhausting the electric quantity of the remote controller.

It should be noted that, for a terminal device with a built-in health data acquisition module, in the process of acquiring user health data through the health data acquisition module, if it is detected that the "health manager" application is abnormal, such as a flash back or a card pause, the health data acquisition module is turned off through a serial port.

In some embodiments, after the user health data collection is completed, the display device sends all the received health data packets to the cloud server.

In one implementation, the display device intercepts the user health data from each health data packet, splices the intercepted user health data with the packet sequence identifier of each health data packet as a splicing sequence, and converts the spliced data into bytes to generate a new data packet. And finally, sending the generated new data packet to a cloud server.

In some embodiments, the remote controller encapsulates the acquired user health data into a real-time data packet and an original data packet according to a format agreed with the display device in advance, the real-time data packet is used for displaying a detection interface on the display device, and the original data packet is used for sending to the cloud server. For example, the data format of the real-time data packet may be the data packet format as shown in the first example, and the data format of the original data may be the data packet format as shown in the second example.

It should be noted that the real-time data packet and the original data packet have different data header codes. In this way, the display device can distinguish the real-time data packet from the original data packet according to the header code of the received data packet. For example, the header code of the original data packet may be 0, and the header code of the real-time data packet may be 1. Then, if the header code of the data packet received by the display device is 0, it indicates that the data packet is the original data packet, and if the header code of the data packet received by the display device is 1, it indicates that the data packet is the real-time data packet.

In these embodiments, the display device needs to parse the real-time data packet, and may further display the detection interface according to the parsing result.

It should be noted that the display device does not need to analyze the received original data packets, but sends all the received original data packets to the cloud server after the data acquisition is finished.

In some embodiments, the display device intercepts the original health data from each original data packet, then splices the intercepted original health data with the packet sequence identifier of each original data packet as a splicing sequence, and converts the spliced data into bytes to generate a new data packet. And finally, sending the generated new data packet to a cloud server. Illustratively, according to the original data packet format, the data from the 23 rd position to the 190 th position is intercepted, i.e. the original health data is obtained.

Illustratively, the format of the data packet sent to the cloud server is as follows:

Byte1	Byte2-169	Byte170-337	……	Byte3677-3844	Byte3845-4012
						data head code	Raw health data (1)	Raw health data (2)	……	Raw health data (23)	Raw health data (24)

The original health data (1) is the user health data in the original data packet with the packet order identifier of 1, the original health data (2) is the user health data … … in the original data packet with the packet order identifier of 2, and so on, it can be seen that the data packet includes the user health data intercepted from each original data packet.

In some embodiments, a server receives a data packet sent by a display device, and first analyzes user health data from the data packet; then, analyzing the user health data by using a preset analysis algorithm to obtain a health detection result; and finally, sending the health detection result to display equipment so as to display the health detection result to a user at the display equipment end. As a possible implementation, the health detection result may include one or more of a heart rate variability index, symptom description information, symptom cause analysis, and user recommendation information.

In one example, the server analyzes the health data of the user by using a preset analysis algorithm to obtain that the heart rate variability index of the user is 67, the occurring symptoms comprise palpitation, shortness of breath and the like, the reasons of the symptoms comprise position change, physical activity, emotional anxiety, fear, excitement, drinking, smoking, drinking tea, drinking coffee and the like, and the given user suggestions comprise smoking cessation, alcohol withdrawal, less strong tea drinking, aerobic exercise increase, less night stay, fatigue avoidance and the like.

In some embodiments, the display device sends the user characteristic information to the server at the same time as sending the user health data to the server so that the server can analyze the user health data in combination with the user characteristic information. The user characteristic information may include the age, sex, height, weight, etc. of the user. It should be understood that the user characteristic information may be information entered by the user from the profile information input interface. In a scene that a user triggers health detection by operating an 'immediate physical examination' control on a certain archive card in an archive management interface, after data acquisition is finished, the display equipment sends acquired user health data and user characteristic information corresponding to the archive card to a server together.

In some embodiments, the server may further process the health detection result by using a preset content recommendation rule, determine recommended content matching the health detection result, and send related information of the recommended content to the display device, so as to push the corresponding recommended content to the user through the display device. For example, if the health detection result shows that the heart rate variability index of the user is high, content which is helpful for the user to improve cardiovascular health, such as health diet recipes, sports teaching videos and the like, can be recommended to the user.

For convenience of description, in the embodiments of the present application, information related to recommended content is referred to as recommendation information. The recommendation information may include display information and jump parameters. The display information comprises pictures, title characters and the like of recommended contents and is used for displaying in the user interface; the jump parameter is a relevant parameter for opening the recommended content.

It should be noted that the recommended content may be: applications, such as "AI fitness" applications; specifying application-provided content, such as video content in a small video application; video programs, such as a motion teaching video, a fat-reducing meal making method video and the like; it can also be a designated page in a designated application, such as a certain fitness item page in an "AI fitness" application.

In other embodiments, the server may combine the health detection results with the user characteristic information to determine recommended content that matches both the health detection results and the user characteristics. Thus, the determined recommended content will conform to both the health and personal characteristics of the user. For example, if the health detection result shows that the user is overweight and the user characteristic information shows that the user is older, content that helps the user lose weight and is consistent with the older user, such as a healthy fat-reducing meal, healthy equipment, and fitness items suitable for the older user, including jogging, fast walking, taiji, and the like, may be recommended to the user. For another example, if the health detection result shows that the user is overweight and the user characteristic information shows that the user is female, content that helps the user lose weight and is suitable for the female user, such as a healthy fat-reducing meal, and health equipment and fitness items (such as yoga and gymnastics) suitable for the female user, may be recommended to the user.

In some embodiments, the server obtains the user interest information in advance, so that the health detection result, the user feature information and the obtained user interest information can be combined to determine recommended content which is matched with the user interest information, the health detection result and the user feature information at the same time. Thus, the determined recommended content will conform to the user's interests, health, and personal characteristics simultaneously.

It will be appreciated that the content tag has category discrimination capability for the content, which may be a keyword contained in the content or a category name of a category to which the content belongs. A content source is a source of content, including applications or applets, plug-ins, etc. In some embodiments, the user's level of interest in a content tag or content source of a content may be used to characterize the user's level of interest in the content.

Based on this, the user interest information may include the user's interest level in the content tag and/or the application/plug-in (e.g., Widget). The interest of the user in a certain content tag can be determined according to the click behavior of the user on the content with the content tag, and the interest of the user in a certain application/plug-in can be determined according to the use condition of the user on the application/plug-in. It should be understood that the higher the number of clicks and the frequency of clicks of a user on content having a certain content tag, the higher the user's interest level in the content tag; the longer the user uses a certain application/plug-in and the higher the frequency of use, the higher the user's interest level in the application/plug-in.

In some implementation manners for obtaining the user interest information, when the display device receives the selection operation of the user on the content, the display device reports the relevant information of the content selected by the user to the server. The server extracts at least one content label from the content related information reported by the display equipment, adds 1 to the selected times corresponding to the content label if the extracted content label is the label selected by the user, stores the label if the extracted content label is a new label not selected by the user, and records that the selected times of the user on the content label is 1. Therefore, through the implementation mode, the server can collect the selection times and the frequency of the user for each content tag, namely the click times and the frequency, so that the user interest degree corresponding to each content tag can be determined according to the click times and the frequency corresponding to each content tag. It is noted that the related information of the content may include a content title, genre, profile information, and the like.

For example, the user interestingness of the content tag may be represented by an interest score, and the interest score is obtained by evaluating the user click frequency and frequency corresponding to the content tag based on a preset evaluation policy. For example, if the number of clicks corresponding to the content tag "body-building" is > M1 and the frequency of clicks is > n1, the user interest level corresponding to the content tag "body-building" is 3 points; if the number of clicks corresponding to the content tag 'fat-reducing' is greater than M2 and the frequency of clicks is greater than n2, the user interest level corresponding to the content tag 'fat-reducing' is 4 points.

In some implementations of obtaining user interest information, when a user opens an application or an applet plug-in (such as a Widget) on a display device, the display device reports a use notification of the application or the plug-in by the user to a server; when the user closes the application or the plug-in on the display device, the display device reports the duration of the user using the application or the plug-in to the server. And the server records the use condition of the user on each application and plug-in according to the use notice and the use duration reported by the display equipment, and further determines the user interest degree corresponding to each application or plug-in according to the use condition of the user on each application or plug-in.

For example, the user interestingness corresponding to the application or the applet may be represented by an interest score, and the interest score is obtained by evaluating the use condition corresponding to the application or the applet based on a preset evaluation policy. For example, if the number of times of use corresponding to the "AI fitness" application is greater than S1 and the total duration of use is greater than T1, the user interest level corresponding to the "AI fitness" application is 3 points; if the use times of the AI fitness application is more than S2 and the total use duration is more than T2, the user interest level of the AI fitness application is 4 points.

As described above, the server may combine the health detection result, the user feature information, and the pre-acquired user interest information to determine recommended content that matches the user interest information, the health detection result, and the user feature information at the same time.

In some implementation manners, the server firstly utilizes a content recommendation rule to process the user characteristic information and the health detection result so as to preliminarily screen out candidate contents matched with the user characteristic information and the health detection result; then determining a content tag for each candidate content; determining a user interest degree corresponding to the content tag of each candidate content according to the pre-acquired user interest information, and determining the candidate content to which the content tag with the user interest degree larger than a preset interest degree threshold belongs as recommended content; and finally, sending a recommendation information set consisting of recommendation information corresponding to all the recommended contents to the display equipment.

Further, the server may assign a priority to each recommended content according to the principle that the higher the user interest degree, the higher the priority of the recommended content, and send the priority identifier to the display device as a part of the recommendation information. Therefore, the display equipment can distinguish the interest difference of the user on different recommended contents according to the priority marks in each piece of recommended information, so that the recommended contents which are more interested by the user are preferentially displayed.

In another specific implementation manner, the server firstly processes the user characteristic information and the health detection result by using a preset content recommendation rule so as to preliminarily screen out candidate contents matched with the user characteristic information and the health detection result; then determining a content source of each candidate content, wherein the content source of the candidate content is an application or a plug-in on the display device; (ii) a Determining a user interest degree corresponding to a content source of each candidate content according to the pre-acquired user interest information, and determining the candidate content of the content source with the user interest degree larger than a preset interest degree threshold value as recommended content; and finally, sending a recommendation information set consisting of recommendation information corresponding to all the recommended contents to the display equipment.

Further, the server may assign a priority to each recommended content according to a principle that the higher the interest level of the content source, the higher the priority of the recommended content, and send the priority identifier to the display device as a part of the recommendation information. Therefore, the display equipment can distinguish the interest difference of the user on different recommended contents according to the priority marks in each piece of recommended information, so that the recommended contents which are more interested by the user are preferentially displayed.

In some embodiments, after receiving the health detection result and the recommendation information set returned by the server, the display device enters a detection result interface through the detection interface, and the health detection result and at least one recommendation content are displayed in a summary manner on the detection result interface. For example, the health detection result may be displayed in a first content area of the detection result interface, and the display information of the at least one piece of recommendation information, i.e., the title, picture, etc. of the recommended content, may be displayed in a second content area of the detection result interface.

In some embodiments, at least one tab is displayed in the second content area of the detection result interface, and at least one piece of recommended content randomly screened from the recommendation information set is displayed in each tab respectively. For example, a preset number of tabs may be displayed in the second content area, and the preset number of recommended contents randomly filtered from the recommendation information set may be displayed in each tab.

In some embodiments, the first content area and the second content area are respectively located at the upper side and the lower side of the detection result interface, and the area occupied by the first content area and the area occupied by the second content area can be divided according to the requirement of the content to be displayed.

Fig. 20 is a test result interface shown in some exemplary embodiments of the present application. As shown in fig. 20, specific contents of the health detection result, including the heart rate variability index of the user, the introduction of the heart rate variability concept, the description of the symptom appearing on the user, the reason of the symptom, and the user suggestion, are displayed in the first content area on the upper side of the detection result interface. Four recommended content tabs are displayed in a second content area on the lower side of the detection result interface, and the titles of the four recommended content tabs are 'healthy fat-reducing meal', 'AI fitness', 'cardiovascular recipe' and 'health-preserving class'. The user can click any one of the tabs to view the recommended content under the corresponding title.

It should be understood that the first content area and the second content area may also be located on the left and right sides of the detection result interface, respectively, and are not described in detail herein.

In some embodiments, the recommendation information includes priority identifiers of the recommended content, the priority identifier of each recommended content is determined by the server according to a content tag of the recommended content or a user interest level corresponding to the content source, the user interest level corresponding to the content tag is determined according to a click behavior of the user on the content having the content tag, and the user interest level corresponding to the content source is determined according to a usage situation of the user on the content source. And when the detection result interface is displayed, displaying a preset number of tabs in the second content area, and respectively displaying a preset number of recommended contents with the top priority in the recommended information set in each tab.

In some embodiments, a control for updating the recommended content is also displayed in the test results interface, such as a "change batch" control in the test results interface shown in fig. 16. The user can instruct the display device to replace the currently displayed recommended content by operating the control. And the display equipment responds to the confirmation operation of the control and respectively displays the recommended contents with the preset number of the top priorities in the rest recommended contents in each tab, wherein the rest recommended contents refer to the recommended contents which are not displayed in the recommended content set.

Fig. 21 is another exemplary test result interface, which is specifically an interface displayed after a user operates a "change batch" control in the interface shown in fig. 20. Unlike fig. 20, in fig. 21, the recommended contents displayed in the second content area on the lower side of the detection result interface are: yoga, Keep, light health and fitness suit.

It is to be noted that, in the above-described embodiment, each tab in the detection result interface may acquire a focus, and the user may move the focus position by operating the control device to select any one of the tabs. When the focus is on a certain tab, the user may input a confirmation operation to open the corresponding recommended content. Based on the method, when the display equipment receives the selection operation of the target recommended content input by the user, the jump parameter corresponding to the target recommended content is obtained; and starting the target jump application according to the jump parameters and displaying a target jump interface.

Specifically, the jump parameter includes a target jump application identifier and a target jump page identifier, where the target jump application identifier may specifically be an application package name and is used for enabling the display device to determine the target jump application, and the target jump page identifier may specifically be a class name and is used for enabling the display device to determine the target jump page. In addition, the jump parameter may also include a jump type. Illustratively, one possible jump parameter format is as follows:

{"startupType":4，"startupUrl":[{"key":"startupType"，"value":1，"type":"int"}，{"key":"package Name"，"value":"com.hisense.tv.mirror"，"type":"String"}，{"key":"className"，"value":"com.hisense.tv.mirror.PreviewActivity"，"type":"String"}]}

in the above example of the skip parameter, the packageName is an application package name, that is, a target skip page identifier, and the className is a class name, that is, a target skip page identifier.

Illustratively, when the user opens the "AI workout" tab of FIG. 20, the interface shown in FIG. 20 skips to the application home page of the "AI workout" application.

According to the embodiment, the technical scheme provided by the application can provide the health detection result for the user, meanwhile, the appropriate recommended content is pushed for the user according to the personalized health detection result of the user, the user interest and the user characteristics, the interface content is enriched, the potential requirements of the user are met, and the user experience is improved.

According to the display device provided in the above embodiment, an execution subject of the method may be a controller of the display device provided in the present application, such as the controller 250 shown in fig. 3. Since the exception handling method corresponds to the steps performed by the display device controller in the above-described embodiment, the following embodiments will only briefly describe the exception handling method. More specific implementation manners of the exception handling method provided by the application and the contents of the embodiment of the display device can be mutually referred to.

As shown in fig. 22, the exception handling method may include the steps of:

s221, monitoring whether user contact abnormity occurs in the process of collecting user health data based on the contact between the user and the touch area. If the user contact abnormality occurs, S222 is executed.

In some embodiments, the touch area is disposed on a remote controller, a health data acquisition module is disposed in the remote controller, the health data acquisition module is connected to the touch area, and the process of acquiring user health data based on contact between a user and the touch area includes: responding to an input health detection instruction, and sending a data acquisition instruction to a remote controller so as to instruct the remote controller to acquire user health data through a health data acquisition module; and receiving the user health data sent by the remote controller. More specifically, the receiving and receiving user health data sent by the remote controller includes: and receiving health data packets sent by the remote controller at intervals, wherein the health data packets at least comprise the latest user health data acquired by the health data acquisition module.

In some embodiments, the health data packet further includes an anomaly identifier, where the anomaly identifier is used to characterize whether there is a detected anomaly and an anomaly type; in the process of acquiring user health data based on the contact between the user and the touch area, monitoring whether user contact abnormity occurs or not comprises the following steps: and judging whether the abnormal mark in the received health data packet represents the user contact abnormity.

In other embodiments, the touch area is disposed on the display device body, the display device is disposed with a health data acquisition module, the health data acquisition module is connected to the touch area, and the process of acquiring the health data of the user based on the contact between the user and the touch area includes: the control health data acquisition module acquires user health data based on contact of a user with the touch area.

S222, detecting whether the user is in contact with the touch area again within a preset time length after the user contact abnormity occurs. If the user is detected to be in contact with the touch area again within the preset time length, S223 is executed, otherwise, S224 is executed.

In some embodiments, the detecting whether the user makes contact with the touch area again within a preset time period after the user contact abnormality occurs includes: and judging whether the health data packet received within the preset time after the contact abnormity appears is an effective data packet with an abnormal identification representation.

And S223, continuously collecting the health data of the user until the quantity of the collected effective data reaches a preset quantity.

S224, sending an acquisition stopping instruction to the remote controller so that the remote controller closes the health data acquisition module.

In addition, in some embodiments, when the number of the received valid data packets reaches a preset number, a collection stopping instruction is sent to the remote controller, so that the remote controller closes the health data collection module. In some embodiments, the exception handling method further comprises: and if the user is not detected to be in contact with the touch area again within the preset time, displaying an abnormal prompt interface, wherein the abnormal prompt interface is used for displaying reasons of detection failure, user suggestions and/or operation controls. As can be seen from the above embodiments, the present application provides a display device, a control apparatus, and an exception handling method. The method comprises the steps that the display equipment monitors whether user contact abnormity occurs or not in the process of acquiring user health data based on contact between a user and a touch area; if the user contact is abnormal, detecting whether the user is in contact with the touch area again within a preset time length after the user contact is abnormal; if the user is detected to be in contact with the touch area again within the preset time length, continuing to collect the user health data until the quantity of the collected effective data reaches the preset quantity, wherein the effective data refers to the user health data collected when no abnormal detection exists. Therefore, in the process of acquiring the health data of the user, if the user contact is temporarily disconnected, the acquisition can be continued until the number of the acquired effective data reaches the preset number, so that the operation difficulty of the user is reduced, and the data acquisition failure caused by temporary contact failure or improper operation is avoided. In addition, the pressure of the user can be reduced, the situation that the user is nervous is avoided, and the user experience is improved.

In specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the exception handling method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiments, since they are substantially similar to the method embodiments, the description is simple, and the relevant points can be referred to the description in the method embodiments.

The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

Claims

1. A display device, comprising:

a display;

a controller configured to:

2. The display device according to claim 1, wherein the touch area is provided on a remote controller, a health data acquisition module is provided in the remote controller, the health data acquisition module is connected to the touch area, and the process of acquiring the health data of the user based on the contact of the user with the touch area comprises:

responding to an input health detection instruction, and sending a data acquisition instruction to a remote controller so as to instruct the remote controller to acquire user health data through a health data acquisition module;

and receiving the user health data sent by the remote controller.

3. The display device according to claim 2, wherein the receiving of the user health data sent by the remote controller comprises:

and receiving health data packets sent by the remote controller at intervals, wherein the health data packets at least comprise the latest user health data acquired by the health data acquisition module.

4. The display device according to claim 3, wherein the health data packet further comprises an anomaly identifier, and the anomaly identifier is used for representing whether a detection anomaly exists and the anomaly type; in the process of acquiring user health data based on the contact between the user and the touch area, monitoring whether user contact abnormity occurs or not comprises the following steps:

judging whether the abnormal mark in the received health data packet represents abnormal user contact;

within a preset time length after the user contact abnormity occurs, detecting whether the user and the touch area are contacted again comprises the following steps:

and judging whether the health data packet received within the preset time after the contact abnormity appears is an effective data packet with an abnormal identification representation.

5. The display device of claim 2, wherein the controller is further configured to:

and if the user is not detected to be in contact with the touch area again within the preset time, sending a collection stopping instruction to the remote controller so that the remote controller closes the health data collection module.

6. The display device of claim 2, wherein the controller is further configured to:

and when the number of the received effective data packets reaches a preset number, sending a collection stopping instruction to the remote controller so that the remote controller closes the health data collection module.

7. The display device of claim 1, wherein the controller is further configured to:

and if the user is not detected to be in contact with the touch area again within the preset time, displaying an abnormal prompt interface, wherein the abnormal prompt interface is used for displaying reasons of detection failure, user suggestions and/or operation controls.

8. A control device, comprising:

a touch area;

9. An exception handling method applied to a display device, the method comprising:

10. An exception handling method is applied to a control device, the control device is provided with a touch area, and the method comprises the following steps: