WO2023231654A1

WO2023231654A1 - Archive management method and apparatus, device, storage medium and program product

Info

Publication number: WO2023231654A1
Application number: PCT/CN2023/090830
Authority: WO
Inventors: 孙康; 许亮; 李轲
Original assignee: 上海商汤智能科技有限公司
Priority date: 2022-05-31
Filing date: 2023-04-26
Publication date: 2023-12-07
Also published as: CN115061977A

Abstract

Embodiments of the present disclosure disclose an archive management method and apparatus, a device, a storage medium and a program product. The method comprises: on the basis of a plurality of frames of real-time images corresponding to a passenger in a vehicle, performing physiological state detection on the passenger; by means of a first interface of a connected display device, displaying real-time detection data obtained via the physiological state detection; when the physiological state detection meets a detection stopping condition, displaying the detection result of the passenger by means of a second interface of the display device, the detection result being determined on the basis of the real-time detection data; and in response to receiving a trigger operation for archive management control in the first interface or the second interface, by means of a third interface of the display device, managing archive data corresponding to the detection result.

Description

File management methods, devices, equipment, storage media and program products

Cross-references to related applications

This disclosure is based on a Chinese patent application with the application number 202210615018.7, the filing date is May 31, 2022, and the application name is "Archives Management Methods, Devices, Equipment, Storage Media and Program Products", and requires priority of this Chinese patent application rights, the entire content of this Chinese patent application is hereby incorporated into this disclosure in full.

Technical field

The present disclosure relates to but is not limited to the field of detection technology, and in particular, to a file management method, device, equipment, storage medium and program product.

Background technique

In vehicle safety, the physical health of the occupants is an important consideration. When the occupants are unwell or in sudden danger, the vehicle needs to be safely controlled in a timely manner. Currently, if drivers or passengers in the cabin want to know their real-time health status, they need to use wearable devices for testing. If the driver or passengers do not purchase and wear similar devices, it will be difficult to know their real-time health status. The lack of detection data on the physiological status of drivers or passengers is not conducive to comprehensive and effective safety protection for vehicle occupants.

Contents of the invention

In view of this, embodiments of the present disclosure provide at least one file management method, device, equipment, storage medium and program product.

The technical solution of the embodiment of the present disclosure is implemented as follows:

In a first aspect, an embodiment of the present disclosure provides a file management method, which method includes:

Detect the physiological status of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle; display the real-time detection data obtained by the physiological status detection through the first interface of the connected display device; stop when the physiological status detection meets the requirements Under certain conditions, the detection result of the occupant is displayed through the second interface of the display device; the detection result is determined based on the real-time detection data; in response to receiving the detection result for the first interface or the third The trigger operation of the file management control in the second interface manages the file data corresponding to the detection results through the third interface of the display device.

In the above embodiment, the physiological status is detected based on the multi-frame real-time images corresponding to the occupants and the real-time detection data is displayed through the first interface of the display device, so that the occupants in the vehicle-mounted device can be quickly detected and displayed in real-time without resorting to wearable devices. The health detection function in vehicle-mounted equipment has been expanded; at the same time, the detection results are determined based on real-time detection data and displayed on the second interface of the display device, thereby making it easier for users to understand their own health status in a timely manner and increasing practicality; archive data can also be formed based on the detection results , and realizes the management of archive data through the third interface of the display device, thereby recording the test results of each user's test, making it convenient for users to view the test results at any time.

In a second aspect, an embodiment of the present disclosure provides a file management device, which includes:

The state detection part is configured to detect the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle;

The data display part is configured to display the physiological state detected results through the first interface of the connected display device. real-time detection data;

The result display part is configured to display the detection result of the occupant through the second interface of the display device when the physiological state detection meets the detection stop condition; the detection result is determined based on the real-time detection data ;

The file management part is configured to manage the file data corresponding to the detection result through the third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface.

In a third aspect, an embodiment of the present disclosure provides a vehicle-mounted device, including a display device, a memory and a processor. The memory stores a computer program that can be run on the processor. The processor combines the display device with the display device when executing the program. Implement some or all of the steps in the above method.

In a fourth aspect, embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, some or all of the steps in the above method are implemented.

In a fifth aspect, the present disclosure provides a computer program product, including computer readable code. When the computer readable code is run in an electronic device, the processor in the electronic device executes a configuration configured to implement the above method. Some or all of the steps.

It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit the technical solution of the present disclosure.

Description of the drawings

The accompanying drawings herein are incorporated into and constitute a part of this specification. They illustrate embodiments consistent with the disclosure and, together with the description, serve to explain the technical solutions of the disclosure.

Figure 1 is an optional flow diagram of a file management method provided by an embodiment of the present disclosure;

Figure 2 is an optional flow diagram of a file management method provided by an embodiment of the present disclosure;

Figure 3 is an optional flow diagram of the file management method provided by an embodiment of the present disclosure;

Figure 4 is an optional flow diagram of the file management method provided by an embodiment of the present disclosure;

Figure 5 is a schematic flowchart of the implementation of a file management method provided by an embodiment of the present disclosure;

Figure 6 is a schematic structural diagram of a file management device provided by an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a hardware entity of a vehicle-mounted device provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the technical solutions of the present disclosure are further elaborated below in conjunction with the accompanying drawings and examples. The described embodiments should not be regarded as limiting the present disclosure. Those of ordinary skill in the art will All other embodiments obtained without creative efforts belong to the scope of protection of this disclosure.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict.

The terms "first/second/third" involved are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first/second/third" can be used interchangeably if permitted. The specific order or sequence may be changed so that the embodiments of the disclosure described herein can be implemented in an order other than that illustrated or described herein.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. The terminology used herein is for the purpose of describing the disclosure only and is not intended to be limiting of the disclosure.

Before further describing the embodiments of the present disclosure in detail, the terms and terms involved in the embodiments of the present disclosure are first explained. The nouns and terms involved in the embodiments of the present disclosure are suitable for the following explanation.

Embodiments of the present disclosure provide a file management method, which can be executed by a processor of a vehicle-mounted device or a mobile terminal device. The vehicle-mounted device may be a vehicle computer, a domain controller or a processor in the vehicle cabin, or may be a device host used to perform data processing operations such as images in a driver monitoring system or an occupant monitoring system. The embodiments of the present disclosure are applicable to This is not a limitation.

Figure 1 is a schematic flowchart of the implementation of a file management method provided by an embodiment of the present disclosure. As shown in Figure 1, the method includes the following steps S101 to S104:

Step S101: Perform physiological status detection on the occupants in the vehicle based on multiple frames of real-time images corresponding to the occupants;

Here, the multi-frame real-time images corresponding to the occupants may be multi-frame real-time images collected by the vehicle-mounted camera in real-time on the occupants, or may be multi-frame real-time images collected by other devices or servers in real-time and transmitted to the vehicle-mounted equipment through instant messaging. The embodiments of the present disclosure do not limit this.

Detecting the physiological status of the occupants is intended to detect one or more physiological indicators such as heart rate, respiratory status, blood oxygen saturation, blood pressure, heart rate variability, etc. Each indicator corresponds to a detection Data, thereby detecting the physiological status of each real-time image of the occupant, and a set of detection data for each indicator item can be obtained.

Taking heart rate detection as an example, the specific implementation method of physiological state detection based on the real-time image of the occupant can be: extracting the smooth area of the face from the image, and constructing the original sequence based on the average pixel brightness of the smooth area of the face extracted from multiple frames of real-time images. Signal; use algorithms such as CHROM to process the original sequence signal to obtain the rPPG (Remote Photoplethysmograph, remote photoplethysmograph) signal, and then perform Fourier transform to extract the power spectrum in the frequency domain to obtain the heart rate signal. Then, combined with the occupant's height, weight, age, gender and other information, physiological status indicators such as blood pressure and blood oxygen saturation can be obtained.

Compared with the way in the related art that users wear wearable devices to detect human physiological indicators, embodiments of the present disclosure apply visual physiological state detection technology to vehicle-mounted equipment to detect the physiological state of the occupants based on multiple frames of real-time images. During the implementation, image processing algorithms and signal analysis algorithms are used to extract indicators such as body temperature and real-time heart rate from multiple frames of real-time images to achieve the purpose of measuring physiological indicators of the driver or crew in the cabin.

Step S102, display the real-time detection data obtained by the physiological state detection through the first interface of the connected display device;

Here, when performing step S102, the vehicle-mounted controller connected to the display device or the remote controller controls the display device to display the first interface. The display device may be a central control screen of a vehicle-mounted device, which is not limited in the embodiments of the present disclosure.

The first interface is an interface displayed through a connected display device during physiological state detection. The display device may be, for example, a vehicle central control display screen, or may be a mobile smart terminal connected through a network. The entire detection process will last for a period of time, such as tens of seconds. For each real-time image in the multi-frame real-time image, a corresponding set of real-time detection data will be detected, and a set of real-time detection data corresponding to each real-time image will be displayed in sequence on the first page. on the interface. This facilitates users to understand their own health status in a timely manner and expands the health detection function and practicality of vehicle-mounted equipment.

Step S103, when the physiological state detection meets the detection stop condition, display the detection result of the occupant through the second interface of the display device;

Here, the detection stop condition may be any condition such as the detection duration reaches the preset detection duration, the posture of the person in the real-time image changes or the person disappears, and the detection stop request is received. The detection stop condition may be determined based on actual scenarios, which is not limited in the embodiments of the present disclosure.

The second interface can be understood as a detection report interface displayed after the detection is completed. In the second interface, the detection results of various physiological indicators obtained in this detection can be displayed. The detection results are determined based on the at least one set of real-time detection data, for example, the real-time detection results detected based on each real-time image. Data such as blood pressure measurements determine whether the final test results such as blood pressure indicators are normal. This makes it easier for users to understand their own health status in a timely manner and increases practicality.

Step S104: In response to receiving a trigger operation for the file management control in the first interface or the second interface, manage the file data corresponding to the detection result through the third interface of the display device.

Here, by setting file management controls in the first interface and the second interface, the file data corresponding to the test results can be managed by jumping to the third interface during or after the test based on user needs.

The profile data is generated based on at least detection results of the occupant. In some implementations, the profile data may also include other identity information such as the passenger's facial profile picture, user ID, etc. Therefore, the test results of each test performed by the user can be recorded through the archive data, and a third interface for managing the archive data is provided for users to view at any time.

In the embodiment of the present disclosure, the physiological status is detected based on the multi-frame real-time images corresponding to the occupants and the real-time detection data is displayed through the first interface of the display device, so that the occupants in the vehicle-mounted device can be quickly detected and displayed in real-time without resorting to wearable devices. , expands the health detection function in vehicle-mounted equipment; at the same time, the detection results are determined based on at least one set of detection data and displayed on the second interface of the display device, thereby facilitating users to understand their own health status in a timely manner and increasing practicality; it can also be based on the detection results The archive data is formed, and the archive data is managed through the third interface of the display device, so that the test results of each test by the user can be recorded, making it convenient for the user to view the test results at any time.

In some embodiments, the method further includes: upon receiving a request for physiological status detection in the vehicle triggered by the user through the vehicle central control screen or mobile device, obtaining the status of the occupants in the vehicle. Corresponding multi-frame real-time images.

Here, the user can trigger the physiological state detection request through voice instructions or by triggering the icon of the physiological state detection program on the central control screen.

In implementation, in response to the user's physiological state detection request, multiple frames of real-time images of the occupants can be collected in real time through a camera in a vehicle-mounted device, such as a vehicle-mounted camera, or multiple frames collected and transmitted in real time by a mobile device can be loaded through instant messaging. Frames of real-time images. The embodiments of the present disclosure do not limit the method of acquiring multiple frames of real-time images.

Among them, the vehicle camera is the camera in the smart car cabin. The vehicle-mounted camera can be a Driver Monitoring System (DMS) camera or an Occupant Monitoring System (OMS) camera, which can collect images of the driver or passengers in the car cockpit in real time for subsequent detection. analysis to ensure occupant safety.

In the above embodiment, when the user triggers a request to detect the physiological status of the occupants in the vehicle, multiple frames of real-time images of the corresponding occupants are obtained to respond to the actual needs of the user and obtain the real-time detection data of the occupants through visual detection. , without the need for additional wearable devices for detection.

In some embodiments, before the step S101, the method further includes: performing face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant; thus the above step S101 "based on the in-vehicle "Detecting the physiological status of the occupant using multiple frames of real-time images corresponding to the occupant" can be further implemented as the following steps 111 to 113:

Step 111: If the passenger is determined to be a profiled user based on the passenger's identity information, perform physiological state detection on the passenger based on multiple frames of real-time images corresponding to the passenger.

Here, the identity information may be the occupant's user identification, facial feature vector, facial key points and other information, so that the identity information can be used to further determine whether the occupant is a profiled user. Among them, profiled users are users who have already established personal files and are understood to be old users.

In the case where the identity information is a facial feature vector, it can be determined whether the occupant is a profiled user through the following process: face recognition is performed on the real-time image corresponding to the occupant to obtain the facial feature vector of the occupant; The passenger's facial feature vector and the stored preset facial feature vector determine whether the passenger is the profiled user.

In this way, the physiological status of the occupant is detected when the occupant is determined to be a profiled user based on the identity information, thereby ensuring that the occupant has a personal profile before the physiological status is detected to save the detection results.

Step 112: If the passenger is determined to be an unprofiled user based on the passenger's identity information, prompt the passenger to create a profile and display the profile creation interface through the display device;

Here, when it is determined that the user is an unprofiled user based on the identity information, the occupant's personal information, facial image, etc. are obtained through the profile creation interface displayed on the display device to complete the creation of the occupant's profile. Among them, undocumented users are understood to be new users.

The new file interface at least includes user personal information entry items and face image entry items. The user's personal information entry items may include name, gender, age, height, weight and other personal information input fields for users to fill in, and the face image entry items may be avatar entry controls to guide users to enter their own face avatars. This disclosed embodiment does not limit the layout setting of the new file interface.

In some other implementations, when the occupant is a user who has not created a profile, a pop-up window may be prompted in advance to prompt the user whether to create a profile at the moment, and the profile creation interface will be displayed when the occupant clicks to confirm the creation of a profile. Otherwise, the occupant will be directed to re-create the profile. Scan and capture to verify identity again.

Step 113: After the creation of the occupant's profile is completed, the physiological state of the occupant is detected based on multiple frames of real-time images corresponding to the occupant.

Here, after completing the input of personal information and facial images in the profile creation interface, the occupants can click the profile save control to complete the profile creation process, so that the physiological status detection of the occupants can be started.

In the above embodiment, before detecting the physiological status of the occupants in the vehicle, it is first determined based on the identity information whether the occupant is a profiled user. If the determination result is that the user has been profiled, the physiological status of the occupant is directly detected; if the determination result is that the user has not been profiled, the profile creation interface is displayed to obtain the user's personal information to complete the profile creation, and then based on the occupant's corresponding Multi-frame real-time images are used for physiological state detection. Therefore, it is ensured that the physiological status test is performed when the passenger has a personal file to save the test results; at the same time, the personal file is formed based on the identity information to facilitate subsequent management of the file.

In some embodiments, the above step S101 may be further implemented as follows: when the duration of detecting the physiological state of the occupant does not reach the first preset duration, and the number of frames of the collected real-time images reaches the first number of frames, or When the collection duration of the real-time image reaches the second preset duration, the physiological status of the occupant is detected based on the collected multiple frames of real-time images to obtain real-time detection data.

Here, the first preset duration is the upper limit of the duration of the entire physiological state detection process, which is generally 20 seconds to 30 seconds; the first number of frames and the second preset duration are empirical values, for a certain physiological indicator item For example, for heart rate value, the collected images need to reach a certain number of frames, such as 100 frames, or the real-time image collection duration reaches a certain length, such as 3 seconds, before the first detection data of this indicator item can be output.

When the physiological status detection duration, the number of real-time image collection frames, and the collection duration meet the corresponding conditions, the physiological status of the occupants will be continuously detected, thereby obtaining real-time detection data for multiple detections during the detection process, which will facilitate subsequent Determine more accurate test results.

Embodiments of the present disclosure provide a file management method, which can be executed by a processor of a vehicle-mounted device. As shown in Figure 2, the method includes the following steps S201 to S205:

Step S201, within a first preset time period, use a sliding window method to sequentially determine multiple sets of real-time detection data of the occupant corresponding to multiple sliding windows;

Here, each sliding window includes multiple frames of the real-time images, and the moving step size of the sliding window is not greater than the number of image frames in the sliding window. For example, if the sliding window contains 8 frames of real-time images, the moving step of the sliding window cannot exceed 8 frames.

Step S202: Display each set of real-time detection data in sequence through the first interface of the connected display device according to the collection timing of the multi-frame images in each sliding window;

Here, the collection timing is understood as the time stamp sequence of collecting each frame of image, that is, a set of detected detection data is displayed frame by frame through the first interface in accordance with the time stamp sequence of multiple frames of real-time images.

The way of sequentially displaying each set of real-time detection data can be exemplarily understood as displaying a set of detection data D1={d11, d12, d13} of the first frame image at the first moment, and displaying a set of detection data D1={d11, d12, d13} of the second frame image at the next moment. A set of detection data D2={d21, d22, d23}.

In this way, the real-time detection data displayed on the first interface of the display device is updated through a sliding window, so that the measurement data of multiple detections can be dynamically displayed during the detection process, making it easier for users to understand the detection process data and discover abnormalities in a timely manner.

Step S203: Draw dynamic change graphics of the detection data based on multiple sets of real-time detection data, and synchronously display the dynamic change graphics and the real-time detection data through the first interface;

Here, the dynamic change graph is the change curve of the detection data of the same indicator item in multiple frames of real-time images over time.

In this way, the dynamically changing graphics of the detection data obtained by simulating multiple frames of real-time images through multiple sets of real-time detection data are synchronously displayed on the first interface of the display device, making it easier for users to understand the real-time changes in corresponding physiological indicators and increasing practicality.

Step S204, when the physiological state detection meets the detection stop condition, display the detection result of the occupant through the second interface of the display device;

Here, the detection result is determined based on the real-time detection data.

Step S205: In response to receiving a trigger operation for the file management control in the first interface or the second interface, manage the file data corresponding to the detection result through the third interface of the display device.

Here, the above-mentioned steps S204 to step S205 respectively correspond to the above-mentioned steps S103 to step S104. During implementation, reference may be made to the specific implementation of the above-mentioned steps S103 to step S104.

In the embodiment of the present disclosure, the real-time detection data displayed on the first interface of the display device is updated through a sliding window, so that the measurement data of multiple detections can be dynamically displayed during the detection process, making it easier for users to understand the detection process data and discover abnormalities in a timely manner. At the same time, multiple sets of real-time detection data are used to simulate the dynamic change graphics of the detection data obtained from multiple frames of real-time images in real time, and are simultaneously displayed on the first interface of the display device, making it easier for users to understand the real-time changes in corresponding physiological indicators and increasing practicality.

In some embodiments, when face recognition is performed on the real-time image of the occupant and the avatar information or identity of the occupant is read, the avatar or identity of the occupant is synchronously displayed through the first interface. Identity information and the real-time detection data.

Here, the identity information of the passenger can be obtained through facial recognition of the real-time image of the passenger, or can be obtained from the information input by the passenger in the new profile page.

In this way, when the occupant's avatar or identity information is obtained through face recognition, the occupant's avatar or identity information is displayed simultaneously during the display of real-time detection data on the first interface to inform the user that the currently detected object is who, thereby reducing false detections due to the presence of multiple objects in real-time images.

In some embodiments, synchronously displaying the avatar or identity information of the occupant and the real-time detection data through the first interface includes: displaying the occupant through a first window drawn in the first interface. an icon of the avatar or an icon of the occupant's identity information; and display the real-time detection data through a second window drawn in the first interface; in response to the avatar of the occupant displayed in the first window When the icon or the icon of the passenger's identity information is clicked, it is determined that a trigger operation for the file management control in the first interface is received.

In this way, the icon of the occupant's avatar or the icon of the occupant's identification information is displayed through the first window in the first interface, and the real-time detection data is displayed through the second window in the first interface to achieve synchronous display. At the same time, by clicking the avatar icon or The icon of the identity information can trigger the file management control and provide a jump link from the first interface to the third interface to increase convenience.

In some embodiments, when dynamically changing graphics of the detection data are drawn based on multiple sets of real-time detection data, the avatar or identity information of the occupant is displayed simultaneously with the first interface. Detecting data in real time also includes: displaying the real-time dynamic change graphics through a third window drawn in the first interface.

In this way, the real-time dynamic change graphics are displayed through the third window in the third interface, which facilitates the user to understand the dynamic changes of the detection data in real time, thereby increasing the visual effect of the first interface.

In some embodiments, the detection results of the occupant include detection sub-results of at least one indicator item. Embodiments of the present disclosure provide a file management method, which can be executed by a processor of a vehicle-mounted device. As shown in Figure 3, the method includes the following steps S301 to S304:

Step S301: Perform physiological status detection on the occupants in the vehicle based on multiple frames of real-time images corresponding to the occupants;

Step S302, display the real-time detection data obtained by the physiological state detection through the first interface of the connected display device;

Here, the above-mentioned steps S301 to step S302 respectively correspond to the above-mentioned steps S101 to S102. During implementation, reference can be made to the specific implementation of the above-mentioned steps S101 to step S102.

Step S303: When the physiological state detection meets the detection stop condition, display the detection sub-results and associated detailed viewing controls of each indicator item through the second interface according to the preset control arrangement;

In implementation, the detection sub-results of the indicator item can be obtained by analyzing and processing at least one set of detection data for the same indicator item. For example, whether the final detection sub-result, that is, the blood pressure indicator is normal, is determined based on the detection data detected in each real-time image, such as the blood pressure measurement value.

Here, the preset control arrangement may be to distribute the control positions of each indicator item according to the category of the indicator item, wherein the category of the at least one indicator item may be the category of the department to which each indicator item belongs, such as respiratory status, respiration, etc. Frequency, etc. belong to the indicator items of the Department of Respiratory Medicine, and heart rate, heart rate variability, etc. belong to the indicator items of the Department of Neurology. Therefore, the detection sub-results of each indicator item are displayed on the second interface according to the department category distribution.

The second interface is used to display the indicator detection report obtained after the detection is completed. In the second interface, the detection sub-results, detection time, and occupant identification of each physiological indicator item obtained during this detection can be displayed.

In the second interface, the user can further click on the detailed view control for each indicator item. Each of the detailed view controls is used to display the historical detection data of the associated indicator item according to a preset time unit; the preset Time units include one of the following: year, month, week, or day. This makes it convenient for users to view the historical detection data of a certain indicator item within a specific time period as needed.

In some embodiments, the second interface further includes a re-measurement control, and the method further includes: in response to receiving a trigger operation for the re-measurement control, performing the physiological processing of multiple frames of real-time images corresponding to the occupant. Steps of detecting the status and displaying at least one set of obtained detection data through the first interface. Therefore, the detection process can be restarted through the re-measurement control on the second interface, which can improve the detection accuracy of physiological indicators and provide convenience to users at the same time.

Step S304: In response to receiving a trigger operation for the file management control in the first interface or the second interface, manage the file data corresponding to the detection result through the third interface.

Here, the above-mentioned step S304 respectively corresponds to the above-mentioned step S104, and the specific implementation of the above-mentioned step S104 may be referred to during implementation.

In the embodiment of the present disclosure, after the physiological state detection meets the detection stop condition, that is, after the detection is completed, the detection sub-results of multiple indicator items and the detailed viewing controls are simultaneously displayed according to the preset control arrangement. In this way, the overall test report of the occupants in this test can be displayed after the test is completed, which facilitates subsequent archiving and viewing. At the same time, the historical test data of each indicator item can be viewed according to the cycle of year, month, week, day, etc.

In some embodiments, the profile data at least includes a user avatar icon, personal information and historical physiological state detection results, and the third interface includes at least one of a new control, a user avatar icon and an edit control. Embodiments of the present disclosure provide a file management method, which can be executed by a processor of a vehicle-mounted device. As shown in Figure 4, the method includes the following steps S401 to S406:

Step S401: Perform physiological status detection on the occupants in the vehicle based on multiple frames of real-time images corresponding to the occupants;

Step S402, display the real-time detection results obtained by the physiological state detection through the first interface of the connected display device. measurement data;

Step S403: When the physiological state detection meets the detection stop condition, display the detection result of the occupant through the second interface of the display device;

Here, the detection result is determined based on the real-time detection data.

The above-mentioned steps S401 to step S403 respectively correspond to the foregoing steps S101 to step S103. During implementation, reference may be made to the specific implementation of the foregoing steps S101 to step S103.

Step S404, in response to the editing control in the third interface being triggered, control the display device to display the editing interface;

Here, the editing interface includes the user's personal information items, avatar, and a delete control configured to delete the archive data. In some implementations, the passenger's face and avatar can be re-entered on the editing interface or personal information such as height and weight can be changed; in other implementations, the entire file data can be directly deleted by clicking the delete control on the editing interface. Including user avatar icon, personal information, test data and test results of previous tests, etc.

Step S405: In response to the user avatar icon in the third interface being triggered, control the display device to jump to the second interface to display the latest historical physiological state detection results of the occupant;

Here, the user's avatar icon is associated with the occupant's corresponding historical physiological state detection results in the program, so that when the user clicks on the user's avatar icon, the user can be directly linked to the occupant's corresponding historical physiological state detection results and displayed on the second interface.

On the second interface, you can visually see the latest detection results, and further view the historical detection data of the corresponding indicator items through the detailed viewing control.

Step S406: In response to the new control in the third interface being triggered, control the display device to display a file creation interface.

Here, the profile creation interface is used to prompt the user to fill in personal information and enter a face image.

In this disclosed embodiment, the file creation interface is displayed by triggering the new control set in the third interface, and the function of obtaining information on the file creation interface to create a file is realized; the user avatar icon set in the third interface is triggered to jump to the second page. The interface displays the test results of the corresponding user and realizes the function of viewing the test results; by triggering the editing control set on the third interface, the user can independently edit personal information or delete archive data. This enriches the management functions of the third interface and can effectively cover health detection and file management scenarios in vehicle-mounted equipment.

In some embodiments, the above step S406 includes the following steps 461 to 463:

Step 461, in response to the new control being triggered, determine whether the total number of stored files exceeds the storage threshold;

Here, the total number of files stored is the cumulative number of files stored in the system, and the storage threshold is the maximum number of files set in advance based on the system's storage capacity or computing power.

Step 462: If the total number of files does not exceed the storage threshold, control the display device to display the file creation interface;

Here, when it is determined that there is sufficient storage space to create a file, the display device is controlled to display a file creation interface to complete the task of creating a new file.

Step 463: When the total number of files exceeds the storage threshold, a pop-up window prompts the first information; the first information is used to instruct the occupant to delete the stored historical files and then create a new file.

Here, it is assumed that the storage threshold, that is, the maximum number of archives stored is 10, and the current archive to be created is the 11th archive. It is necessary to delete the stored historical archives and then display the archive creation interface to create a new archive.

In this way, after the new control is triggered, if the total number of stored files exceeds the storage threshold, a pop-up window will remind the user to delete the historical files and then display the file creation interface. This reduces the problem of file creation failure or data loss due to insufficient system storage capacity by pre-judging whether the new creation conditions are met before displaying the new page.

In some embodiments, when the editing control is triggered, after step S404, the The method also includes the following steps:

Step 441, in response to the deletion control being triggered, a pop-up window prompts the second information;

Here, the second information is used by the occupant to confirm whether to delete the archive data. For example, the second information of "Are you sure to delete the archive data" is displayed on the pop-up window, and "Yes" and "No" controls are provided for the user to choose.

Step 442, in response to receiving the deletion operation for the archive data, delete the archive data and return to the editing interface;

Here, when the crew member confirms the deletion, the file data corresponding to the crew member is deleted, and the crew member returns to the editing interface of the previous level, where he can continue to receive other editing operations.

Step 443: In response to receiving the undelete operation for the archive data, return to the third interface.

Here, when the occupant cancels deletion, he or she exits the current editing interface and returns to the third interface to perform other management operations on the file data through the third interface.

In this way, when the delete control in the editing page is triggered, a pop-up window will confirm whether the user deletes the item, and return to the corresponding interface based on the user's deletion operation or cancellation of the deletion operation. This reduces accidental deletion by confirming again through a pop-up window, and at the same time returns to the interface of the previous step, providing convenience to users while ensuring the normal operation of the program.

The following describes the application of the file management method provided by the embodiment of the present disclosure in actual scenarios.

In related technologies, if the driver or crew wants to know the real-time health status, they need to use wearable devices for detection. If the driver or crew does not purchase and wear similar devices, they will not be able to know the real-time health status. The current smart car cabin does not include the function of physiological status detection. Indeed, this function is difficult for the vehicle to make accurate judgments on the physiological status of the driver or occupants. If a driver or passenger suddenly has a health problem that cannot be sensed by the vehicle and the user cannot self-test, accidents are likely to occur.

The disclosed embodiment relies on the camera in the vehicle cabin and uses visual health detection technology to detect the physiological status of the driver or passenger in the vehicle, and combines the face recognition results to form a personal file to facilitate recording of previous detection records.

An embodiment of the present disclosure provides a file management method, as shown in Figure 5. The method includes the following steps S501 to S514:

Step S501, start the detection application;

Here, the user clicks on the icon of the detection application on the central control screen or wakes it up through voice commands to start the detection application.

Step S502, perform face recognition on the occupants;

Here, if the recognition result indicates that the occupant is a new user, step S503 is executed; if the recognition result indicates that the occupant is an old user, step S505 is directly executed.

Step S503, enter the new file interface;

Here, if it is recognized that the occupant is a new user, that is, a health profile has not been created yet, the new profile interface (equivalent to the profile creation interface) will be entered.

The new profile interface provides fields such as "User ID", "Age", "Height", "Gender" and "Weight" for users to enter their basic personal information; at the same time, the user's face image can also be entered to complete the user's information. . Finally, in response to the user clicking the "Confirm" control, the process of establishing the health file of the passenger is completed, and the health test interface of the passenger is jumped to start the health test of the passenger.

Step S505, enter the health detection interface;

Here, the physiological status of the occupants is detected through the images captured by the cabin camera, and the entire process lasts 20 to 30 seconds. During the detection period, the health detection interface (equivalent to the first interface) is entered on the central control screen. The heart rate curve can be simulated and displayed in real time based on the detection data of a certain indicator item such as the heart rate value. The user's identity information is also displayed in the health detection interface ( Such as user avatar icon, user account, etc.).

During the detection process, the embodiment of the present disclosure simultaneously displays the heart rate curve and heart rate value, as well as user avatar icon, identity identification and other information based on the obtained detection data, thereby improving the practicality of the detection application.

Step S506: After the detection is completed, enter the detection report interface;

Here, after the health test is completed, the test report interface (equivalent to the second interface) is entered, and the indicator test report is displayed in this interface, including the occupant's heart rate, respiratory status, respiratory frequency, blood oxygen saturation, and Test results of indicators such as blood pressure and heart rate variability.

It should be noted that you can also click the "re-measure" button on the detection report interface to jump to step S502 for re-identification.

Step S507, in response to the detail viewing control of the detection report interface being triggered, the history record interface pops up;

Here, in the test report interface, the occupants can further click on the "Details View" control corresponding to each indicator item to pop up the history record interface. In the history record interface, you can view the historical detection data of the corresponding indicator items, and you can choose to view the historical detection data in units of year, month, week or day.

Step S508: In response to the file management control of the health detection interface or the detection report interface being triggered, the file management interface is displayed.

Here, during the above-mentioned steps S505 and S506, the user can directly click the "File Management" button on the health detection interface or the detection report interface to enter the file management interface (equivalent to the third interface). In the file management interface, users' health files can be viewed, edited or deleted, and historical detection data of each indicator can also be viewed.

Step S509, in response to the new file control of the file management interface being triggered, determine whether the total number of files is greater than 10;

In the file management interface, the user clicks the "New File" control to first determine whether the total number of files exceeds 10 (equivalent to the storage threshold). If it exceeds 10, perform step S510; if it does not exceed 10, enter the new file interface. , execute step S503.

Step S510, a pop-up window reminds "Delete unnecessary files first";

Here, a pop-up window reminds the user to delete unnecessary files, that is, historical files.

Step S511, in response to the editing control of the file management interface being triggered, jump to the editing interface;

In the file management interface, the user clicks the "Edit" control for the current personal file to enter the file editing interface and edit the personal file.

Step S512, in response to the delete control on the editing interface being triggered, a pop-up window prompts "Delete or not";

Here, in the editing interface, further click the "Delete" control, and a pop-up window will remind the user whether to delete. If the user confirms the deletion, the current health file will be deleted and returned to the file management interface; if the user denies deletion, return to Editing interface.

Step S513, in response to the avatar on the file management interface being clicked, jump to the detection report interface;

Here, in the file management interface, the user clicks on the avatar to display the latest indicator detection report through the detection report interface.

Step S514: In response to the detail viewing control of the detection report interface being triggered, a history record interface pops up.

Here, continue to click on the details view control on the detection report interface to pop up the history record interface; on the history record interface, click on a blank position to return to the most recent indicator detection report.

This disclosed embodiment combines the user's indicator detection results and face recognition results to generate a personal profile, and records the results of each detection in the user's own personal profile, and can select a time period to view historical detection data.

The disclosed embodiment applies the visual health detection solution to vehicle-mounted equipment in the form of an application program, which can effectively cover the health detection scene in the vehicle cabin, allowing users to view various physiological indicators and understand real-time health status in the vehicle. There is no need to buy and wear additional equipment. During the detection process, you can see the real-time heart rate curve and heart rate value, which increases practicality.

Since users create health files based on face recognition and record the test results of each indicator test, when users want to view long-term changes in their own indicators, they can independently launch the test application, enter the file management interface, and click on the avatar to view it. Historical detection data to understand long-term changes in each indicator.

In other embodiments, when the user is driving a vehicle on the road, he or she can use voice control to open the detection application to start a physiological state detection; or the user can manually start the detection application when waiting for traffic lights, parking, and other stationary scenes. After a physiological status test, you can view the test results of each indicator in 20 to 30 seconds. If there is a problem with any indicator, the detection application will also give corresponding health suggestions and reminders.

Based on the foregoing embodiments, embodiments of the present disclosure provide a file management device. The device includes various parts and units included in each part. It can be implemented by a processor in a vehicle-mounted device; of course, it can also be implemented by Specific logic circuit implementation; during the implementation process, the processor can be a central processing unit (Central Processing Unit, CPU), a microprocessor (Microprocessor Unit, MPU), a digital signal processor (Digital Signal Processor, DSP) or an on-site Field Programmable Gate Array (FPGA), etc.

Figure 6 is a schematic structural diagram of a file management device provided by an embodiment of the present disclosure. As shown in Figure 6, the device 600 includes: a status detection part 610, a data display part 620, a result display part 630 and a file management part 640, where :

The state detection part 610 is configured to detect the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle;

The data display part 620 displays the real-time detection data obtained by the physiological state detection through the first interface of the connected display device;

The result display part 630 is configured to display the detection result of the occupant through the second interface of the display device when the physiological state detection meets the detection stop condition; the detection result is determined based on the real-time detection data of;

The file management part 640 is configured to manage the file data corresponding to the detection results through the third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface. .

In some possible embodiments, the device 600 further includes an image acquisition part configured to receive a request for physiological state detection in the vehicle triggered by the user through the vehicle central control screen or mobile device. , obtaining multiple frames of real-time images corresponding to the occupants in the vehicle.

In some possible embodiments, before detecting the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle, the device further includes a face recognition part configured to detect the occupant based on at least one frame of Face recognition is performed on the real-time image to obtain the identity information of the occupant; the status detection part 610 is also configured to, in the case where the occupant is determined to be a profiled user based on the identity information of the occupant, based on the identity information of the occupant The corresponding multiple frames of real-time images are used to detect the physiological status of the occupant.

In some possible embodiments, the status detection part 610 is also configured to prompt the occupant to create a profile and display it through the display device when the occupant is determined to be an unprofiled user based on the identity information of the occupant. Display the profile creation interface; the new profile interface at least includes user personal information entry items and facial image entry items; after the creation of the crew member's profile is completed, perform physiological tests on the crew member based on multiple frames of real-time images corresponding to the crew member. Status detection.

In some possible embodiments, the state detection part 610 is further configured to detect the physiological state of the occupant when the duration does not reach a first preset duration and the number of frames of the collected real-time images reaches a first When the number of frames or the collection duration of the real-time images reaches the second preset duration, the physiological status of the occupant is detected based on the collected multiple frames of real-time images to obtain the real-time detection data.

In some possible embodiments, the status detection part 610 is further configured to use a sliding window method to sequentially determine multiple sets of real-time detection of the occupant corresponding to multiple sliding windows within the first preset time period. Data, wherein each sliding window includes multiple frames of the real-time image, and the moving step size of the sliding window is not greater than the number of image frames in the sliding window; the data display part 620 is also configured to perform the following steps according to each of the The collection timing of the multi-frame images within the sliding window displays the groups of real-time detection data in sequence through the first interface of the connected display device.

In some possible embodiments, the device further includes an image drawing part configured to draw dynamic change graphics of the detection data based on multiple sets of real-time detection data, and to synchronously display the dynamic changes through the first interface. Graph with the real-time detection data.

In some possible embodiments, the device further includes an information display part configured to perform face recognition on the real-time image of the occupant and read the avatar information or identity of the occupant. The first interface synchronously displays the avatar or identity information of the occupant and the real-time detection data.

In some possible embodiments, the information display part includes a first display sub-part, a second display sub-part and a determination sub-part, wherein: the first display sub-part is configured to draw in the first interface The first window displays an icon of the occupant's avatar or an icon of the occupant's identity information; the second display sub-part is configured to display the real-time detection through the second window drawn in the first interface Data; the determination sub-part is configured to determine that the icon for the first passenger's avatar or the identification information of the passenger is clicked in response to the fact that the icon is clicked. Trigger operation of the file management control in an interface.

In some possible embodiments, the information display part also includes a third display sub-part configured to draw dynamically changing graphics of the detection data based on multiple sets of the real-time detection data, through the first The third window drawn in the interface displays the real-time dynamically changing graphics.

In some possible embodiments, the detection results of the occupant include detection sub-results of at least one indicator item, and the result display part 630 is also configured to perform the detection according to the preset condition when the physiological state detection meets the detection stop condition. The control arrangement mode displays the detection sub-results and detailed viewing controls of each indicator item through the second interface; the detailed viewing controls are triggered to display the historical detection data of the corresponding indicator items according to the preset time unit. ; The preset time unit includes one of the following: year, month, week, day.

In some possible embodiments, the profile data at least includes user avatar icons, personal information and historical physiological state detection results, the third interface includes at least one of a new control, a user avatar icon and an edit control, and the profile management Portion 640 includes a third display sub-portion, a jump portion, or a fourth display sub-portion, wherein: the third display sub-portion is configured to control the display device in response to an editing control in the third interface being triggered. Display an editing interface; the editing interface includes the user's personal information items, avatars, and a deletion control for deleting the archive data; the jump part is configured to respond to the user avatar icon in the third interface being Trigger, control the display device to jump to the second interface to display the latest historical physiological state detection results of the occupant; the fourth display sub-part is configured to respond to the third interface The new control is triggered to control the display device to display the file creation interface.

In some possible embodiments, the fourth display sub-part includes a determination unit, a first display unit and a first pop-up window unit, wherein: the determination unit is configured to determine storage in response to the new control being triggered. Whether the total number of files exceeds the storage threshold; the first display unit is configured to control the display device to display the file creation interface when the total number of files does not exceed the storage threshold; the first pop-up window A unit configured to prompt the first information in a pop-up window when the total number of files exceeds the storage threshold; the first information is configured to instruct the occupant to delete the stored historical files and then create a new file.

In some possible embodiments, when the editing control is triggered, the third display sub-section further includes a second pop-up window unit, a first return unit and a second return unit, wherein: the second The pop-up window unit is configured to prompt the second information in response to the deletion control being triggered; the second information is used for the occupant to confirm whether to delete the archive data; the first return unit is configured to respond to Upon receiving the deletion operation for the archive data, delete the archive data and return to the editing interface; the second return unit is configured to respond to receiving the undelete operation for the archive data, return to the The third interface.

The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. In some embodiments, the device provided by the embodiments of the present disclosure has functions or includes parts that can be configured to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of the present disclosure, Please refer to the description of the method embodiments of the present disclosure for understanding.

If the disclosed technical solution involves personal information, the products applying the disclosed technical solution will clearly inform the personal information processing rules and obtain the individual's independent consent before processing personal information. If the disclosed technical solution involves sensitive personal information, the product applying the disclosed technical solution must obtain the individual's separate consent before processing the sensitive personal information, and at the same time meet the requirement of "express consent". For example, setting up clear and conspicuous signs on personal information collection devices such as cameras to inform them that they have entered the scope of personal information collection, and that personal information will be collected. If an individual voluntarily enters the collection scope, it is deemed to have agreed to the collection of his or her personal information; or On personal information processing devices, when using obvious logos/information to inform personal information processing rules, obtain personal authorization through pop-up messages or asking individuals to upload their personal information; among them, personal information processing rules may include personal information processing rules. Information processors, purposes of personal information processing, processing methods, types of personal information processed, etc.

It should be noted that in the embodiments of the present disclosure, if the above file management method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present disclosure can be embodied in the form of software products that are essentially or contribute to related technologies. The software product is stored in a storage medium and includes a number of instructions to enable a A vehicle-mounted device (which may be a personal computer, a server, a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read Only Memory, ROM), magnetic disk or optical disk and other media that can store program code. In this way, the embodiments of the present disclosure are not limited to any specific hardware, software, or firmware, or any combination of hardware, software, and firmware.

An embodiment of the present disclosure provides a vehicle-mounted device, including a memory and a processor. The memory stores a computer program that can be run on the processor. When the processor executes the program, some or all of the steps in the above method are implemented.

Embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, some or all of the steps in the above method are implemented. The computer-readable storage medium may be transient or non-transitory.

Embodiments of the present disclosure provide a computer program, which includes computer readable code. When the computer readable code is run in a vehicle-mounted device, the processor in the vehicle-mounted device executes a part for implementing the above method or All steps.

Embodiments of the present disclosure provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. When the computer program is read and executed by a computer, some of the above methods are implemented or All steps. The computer program product can be implemented specifically through hardware, software or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK) and so on.

It should be noted here that the above description of various embodiments tends to emphasize the differences between the various embodiments, and the similarities or similarities may be referred to each other. The description of the above embodiments of equipment, storage media, computer programs and computer program products is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the disclosed equipment, storage media, computer programs and computer program products, please refer to the description of the disclosed method embodiments for understanding.

It should be noted that Figure 7 is a schematic diagram of a hardware entity of a vehicle-mounted device in an embodiment of the present disclosure. As shown in Figure 7 , the hardware entity of the vehicle-mounted device 700 includes: a processor 701, a display device 702 and a memory 703, where:

The display device 702, the memory 703 and the processor 701 are connected through the bus 704; the memory 703 is configured to store an executable computer program; the processor 701 is configured to execute the executable computer program stored in the memory 703, in combination with the display device 702, to implement The file management method provided by any of the above embodiments of the present disclosure. Among them, obviously The display device can be a car central control screen.

The memory 703 is configured to store instructions and applications executable by the processor 701, and can also cache data to be processed or processed by the processor 701 and each module in the vehicle-mounted device 700 (for example, image data, audio data, voice communication data and Video communication data), which can be implemented through flash memory (FLASH) or random access memory (Random Access Memory, RAM). Data can be transmitted between the processor 701, the display device 702 and the memory 703 through the bus 704.

It will be understood that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic associated with the embodiment is included in at least one embodiment of the present disclosure. Thus, the appearances of "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that in various embodiments of the present disclosure, the size of the serial numbers of the above steps/processes does not mean the order of execution. The execution order of each step/process should be determined by its functions and internal logic, and should not be The implementation process of the embodiments of the present disclosure constitutes no limitations. The above serial numbers of the embodiments of the present disclosure are only for description and do not represent the advantages and disadvantages of the embodiments.

It should be noted that, in this document, the terms "comprising", "comprises" or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device that includes a series of elements not only includes those elements, It also includes other elements not expressly listed or inherent in the process, method, article or apparatus. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article or apparatus that includes that element.

In the several embodiments provided in this disclosure, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components may be combined, or can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be electrical, mechanical, or other forms. of.

The units described above as separate components may or may not be physically separated; the components shown as units may or may not be physical units; they may be located in one place or distributed to multiple network units; Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present disclosure can be all integrated into one processing unit, or each unit can be separately used as a unit, or two or more units can be integrated into one unit; the above-mentioned integration The unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

Those of ordinary skill in the art can understand that all or part of the steps to implement the above method embodiments can be completed through hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the execution includes: The steps of the above method embodiment; and the aforementioned storage media include: mobile storage devices, read-only memory (Read Only Memory, ROM), magnetic disks or optical disks and other various media that can store program codes.

Alternatively, if the above-mentioned integrated units of the present disclosure are implemented in the form of software functional parts and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure can be embodied in the form of a software product in essence or that contributes to related technologies. The computer software product is stored in a storage medium and includes a number of instructions to enable a computer. The vehicle-mounted device (which may be a personal computer, a server, a network device, etc.) executes all or part of the methods described in various embodiments of the present disclosure. The aforementioned storage media include: mobile storage devices, ROMs, magnetic disks or optical disks and other media that can store program codes.

The above are only embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, and should are covered by the protection scope of this disclosure.

Industrial applicability

In the embodiment of the present disclosure, the physiological status of the occupant is detected based on multiple frames of real-time images corresponding to the occupant in the vehicle; the real-time detection data obtained by the physiological status detection is displayed through the first interface of the connected display device; in the When the physiological state detection meets the detection stop condition, the detection result of the occupant is displayed through the second interface of the display device; the detection result is determined based on the real-time detection data; in response to receiving the detection result for the first The trigger operation of the file management control in an interface or the second interface manages the file data corresponding to the detection results through the third interface of the display device. The above solution can quickly detect and display the occupants in the vehicle equipment in real time without the need for wearable devices. It expands the health detection function in the vehicle equipment, facilitates users to understand their own health status in a timely manner, and increases the practicality; it can also be based on the detection results. The archive data is formed, and the archive data is managed through the third interface of the display device, so that the test results of each test by the user can be recorded, making it convenient for the user to view the test results at any time.

Claims

A file management method, the method includes:

Detect the physiological status of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle;

Display the real-time detection data obtained by the physiological state detection through the first interface of the connected display device;

When the physiological state detection meets the detection stop condition, the detection result of the occupant is displayed through the second interface of the display device; the detection result is determined based on the real-time detection data;

In response to receiving a trigger operation for a file management control in the first interface or the second interface, file data corresponding to the detection result is managed through a third interface of the display device.
The method according to claim 1, wherein the method further includes: upon receiving a request for physiological state detection in the vehicle triggered by a user through a vehicle-mounted central control screen or a mobile device, obtaining the Multiple frames of real-time images corresponding to the occupants in the vehicle.
The method according to claim 1 or 2, wherein before detecting the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle, the method further includes:

Perform face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant;

The physiological status detection of the occupant based on the multi-frame real-time images corresponding to the occupant in the vehicle includes:

When the passenger is determined to be a profiled user based on the passenger's identity information, the physiological state of the passenger is detected based on multiple frames of real-time images corresponding to the passenger.
The method according to claim 3, wherein the physiological state detection of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle further includes:

When the passenger is determined to be an undocumented user based on the passenger's identity information, the passenger is prompted to create a profile and a profile creation interface is displayed through the display device; the new profile interface at least includes user personal information entry items and facial image entry items;

After the occupant's profile is created, the physiological status of the occupant is detected based on multiple frames of real-time images corresponding to the occupant.
The method according to any one of claims 1 to 4, wherein the physiological state detection of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle includes:

When the duration of the physiological status detection of the occupant does not reach the first preset duration, and the number of frames of the collected real-time images reaches the first number of frames, or the collection duration of the real-time images reaches the second preset duration. In this case, the physiological status of the occupant is detected based on the collected multiple frames of real-time images to obtain the real-time detection data.
The method according to claim 5, wherein the step of detecting the physiological status of the occupant based on the collected multi-frame real-time images to obtain the real-time detection data includes:

Within the first preset time period, a sliding window method is used to sequentially determine multiple sets of real-time detection data of the occupant corresponding to multiple sliding windows; wherein each sliding window includes multiple frames of the real-time detection data. Image, the moving step size of the sliding window is not greater than the number of image frames in the sliding window;

The first interface of the connected display device displays the real-time detection data obtained from the physiological state detection, including:

According to the collection timing of the multi-frame images in each sliding window, the groups of real-time detection data are displayed in sequence through the first interface of the connected display device.
The method of claim 6, further comprising:

Draw a dynamic change graph of the detection data based on multiple sets of the real-time detection data, and synchronously display the dynamic change graph and the real-time detection data through the first interface.
The method according to claim 6 or 7, wherein the method further includes:

By performing face recognition on the real-time image of the occupant and reading the avatar information or identity of the occupant In the case of identification, the occupant's avatar or identity information and the real-time detection data are displayed simultaneously through the first interface.
The method according to claim 8, wherein the synchronous display of the occupant's avatar or identity information and the real-time detection data through the first interface includes:

Display an icon of the occupant's avatar or an icon of the occupant's identity information through the first window drawn in the first interface; and

Display the real-time detection data through a second window drawn in the first interface;

In response to the click of the icon of the occupant's avatar or the icon of the occupant's identification information displayed in the first window, it is determined that a trigger operation for the file management control in the first interface is received. .
The method according to claim 9, wherein in the case of drawing dynamically changing graphics of the detection data based on multiple sets of the real-time detection data, the avatar or identity of the occupant is synchronously displayed through the first interface. The identification information and the real-time detection data also include:

The real-time dynamically changing graphics are displayed through a third window drawn in the first interface.
The method according to any one of claims 1 to 10, wherein the detection result of the occupant includes a detection sub-result of at least one indicator item, and in the case where the physiological state detection satisfies the detection stop condition, the The second interface of the display device displays the detection results of the occupant, including:

When the physiological state detection meets the detection stop condition, the detection sub-results and associated details viewing controls of each indicator item are displayed through the second interface according to the preset control arrangement; the details When the viewing control is triggered, the historical detection data of the associated indicator items is displayed according to a preset time unit; the preset time unit includes one of the following: year, month, week, or day.
The method according to any one of claims 1 to 10, wherein the archive data at least includes a user avatar icon, personal information and historical physiological state detection results, and the third interface includes a new control, a user avatar icon and an editing control At least one of the management of archival data corresponding to the detection results through the third interface of the display device includes:

In response to the editing control in the third interface being triggered, control the display device to display an editing interface; the editing interface includes the user's personal information items, avatar, and a deletion control for deleting the archive data;

In response to the user avatar icon in the third interface being triggered, controlling the display device to jump to the second interface to display the most recent historical physiological state detection result of the occupant;

In response to the new control in the third interface being triggered, the display device is controlled to display a file creation interface.
The method according to claim 12, wherein, in response to a new control in the third interface being triggered, controlling the display device to display a profile creation interface includes:

In response to the new control being triggered, determine whether the total number of stored files exceeds a storage threshold;

When the total number of files does not exceed the storage threshold, control the display device to display the file creation interface;

When the total number of files exceeds the storage threshold, a pop-up window prompts the first information; the first information is configured to instruct the occupant to delete the stored historical files and then create a new file.
The method according to claim 12 or 13, wherein when the editing control is triggered, the method further includes:

In response to the deletion control being triggered, a pop-up window prompts second information; the second information is used by the occupant to confirm whether to delete the archive data;

In response to receiving a deletion operation for the archive data, delete the archive data and return to the editing interface;

In response to receiving the undelete operation for the archive data, return to the third interface.
A file management device, the device includes:

The state detection part is configured to detect the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant in the vehicle;

The data display part is configured to display the real-time detection data obtained by the physiological state detection through the first interface of the connected display device;

The result display part is configured to display the detection result of the occupant through the second interface of the display device when the physiological state detection meets the detection stop condition; the detection result is determined based on the real-time detection data ;

The file management part is configured to manage the file data corresponding to the detection result through the third interface of the display device in response to receiving a trigger operation for the file management control in the first interface or the second interface.
The device of claim 15, wherein the device further comprises:

The image acquisition part is configured to acquire multiple frames of real-time images corresponding to the occupants in the vehicle upon receiving a request for physiological state detection in the vehicle triggered by the user through the vehicle central control screen or mobile device. .
The device according to claim 15 or 16, wherein before detecting the physiological state of the occupant based on the multi-frame real-time images corresponding to the occupant in the vehicle, the device further includes: a face recognition part configured as Perform face recognition based on at least one frame of the real-time image to obtain the identity information of the occupant;

The state detection part is also configured to detect the physiological state of the occupant based on multiple frames of real-time images corresponding to the occupant when the occupant is determined to be a profiled user based on the identity information of the occupant.
The device according to claim 17, wherein the status detection part is further configured to prompt the occupant to create a profile and pass the The display device displays a profile creation interface; the new profile interface at least includes user personal information entry items and facial image entry items; after the creation of the crew member's profile is completed, the crew member is evaluated based on multiple frames of real-time images corresponding to the crew member. Perform physiological status testing.
The device according to any one of claims 15 to 17, wherein the state detection part is further configured to detect the physiological state of the occupant when the duration does not reach a first preset time period and the collected real-time When the number of frames of the image reaches the first number of frames or the collection duration of the real-time image reaches the second preset duration, the physiological status of the occupant is detected based on the collected multiple frames of real-time images to obtain the real-time detection data. .
The device according to claim 19, wherein the state detection part is further configured to use a sliding window method to sequentially determine multiple groups of the occupants corresponding to multiple sliding windows within the first preset time period. Real-time detection data, wherein each sliding window includes multiple frames of the real-time image, and the moving step size of the sliding window is not greater than the number of image frames in the sliding window;

The data display part is further configured to sequentially display the groups of real-time detection data through the first interface of the connected display device according to the acquisition timing of the multi-frame images in each of the sliding windows.
The device according to claim 20, wherein the device further includes an image drawing part configured to draw dynamically changing graphics of the detection data based on multiple sets of the real-time detection data, and to synchronously display all the detection data through the first interface. the dynamically changing graphics and the real-time detection data.
The device according to claim 20 or 21, wherein the device further includes an information display part configured to perform face recognition on the real-time image of the occupant and read the avatar information or identity of the occupant. In this case, the occupant's avatar or identity information and the real-time detection data are displayed simultaneously through the first interface.
The device of claim 22, wherein the information display portion includes:

A first display sub-part configured to display an icon of the occupant's avatar or an icon of the occupant's identity information through a first window drawn in the first interface;

The second display sub-part is configured to display the real-time detection data through a second window drawn in the first interface; the determination sub-part is configured to respond to the avatar of the occupant displayed in the first window icon or all When the icon of the passenger's identity information is clicked, it is determined that a trigger operation for the file management control in the first interface is received.
The device according to claim 23, wherein the information display part further includes:

The third display sub-part is configured to display the real-time dynamic change graphics through a third window drawn in the first interface when the dynamic change graphics of the detection data are drawn based on multiple sets of the real-time detection data.
The device according to any one of claims 15 to 24, wherein the detection result of the occupant includes detection sub-results of at least one indicator item, and the result display part is further configured to detect a detection stop condition when the physiological state detection meets In the case of , according to the preset control arrangement, the detection sub-results and associated details viewing controls of each indicator item are displayed through the second interface; the details viewing controls are triggered to display according to the preset time unit The associated historical detection data of the indicator item; the preset time unit includes one of the following: year, month, week, or day.
The device according to any one of claims 15 to 24, wherein the archive data at least includes a user avatar icon, personal information and historical physiological state detection results, and the third interface includes a new control, a user avatar icon and an editing At least one of the controls, the file management part includes:

The third display sub-part is configured to control the display device to display an editing interface in response to the editing control in the third interface being triggered; the editing interface includes the user's personal information items, avatars, and a user interface for deleting the File data deletion control;

The jump part is configured to, in response to the user avatar icon in the third interface being triggered, control the display device to jump to the second interface to display the most recent historical physiological state detection result of the occupant;

The fourth display sub-part is configured to control the display device to display the file creation interface in response to the new control being triggered in the third interface.
The apparatus of claim 26, wherein the fourth display subsection includes:

a determination unit configured to determine whether the total number of stored files exceeds a storage threshold in response to the new control being triggered; a first display unit configured to control the display when the total number of files does not exceed the storage threshold The device displays the file creation interface; the first pop-up window unit is configured to prompt the first information in a pop-up window when the total number of files exceeds the storage threshold; the first information is configured to instruct the occupant to delete the Create new archives after storing historical archives.
The device according to claim 26 or 27, wherein, in the case where the editing control is triggered, the third display sub-section further includes:

A second pop-up window unit configured to prompt the second information in a pop-up window in response to the deletion control being triggered; the second information is used for the occupant to confirm whether to delete the archive data;

A first return unit configured to delete the archive data and return to the editing interface in response to receiving a deletion operation for the archive data;

The second return unit is configured to return to the third interface in response to receiving an undelete operation for the archive data.
A vehicle-mounted device including:

A display device; a memory configured to store an executable computer program;

A processor configured to implement the method of any one of claims 1 to 14 in combination with the display device when executing an executable computer program stored in the memory.
A computer-readable storage medium on which a computer program is stored, which implements the steps of the method described in any one of claims 1 to 14 when executed by a processor.
A computer program product comprising computer readable code, when the computer readable code is run in an electronic device, a processor in the electronic device executes a configuration configured to implement any one of claims 1 to 14 method.