WO2024159679A1 - 应用程序控制方法、装置、设备及存储介质 - Google Patents

应用程序控制方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2024159679A1
WO2024159679A1 PCT/CN2023/097936 CN2023097936W WO2024159679A1 WO 2024159679 A1 WO2024159679 A1 WO 2024159679A1 CN 2023097936 W CN2023097936 W CN 2023097936W WO 2024159679 A1 WO2024159679 A1 WO 2024159679A1
Authority
WO
WIPO (PCT)
Prior art keywords
emotion
target object
target
application
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/097936
Other languages
English (en)
French (fr)
Inventor
潘雪峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang Geely Holding Group Co Ltd
Zhejiang Zeekr Intelligent Technology Co Ltd
Original Assignee
Zhejiang Geely Holding Group Co Ltd
Zhejiang Zeekr Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang Geely Holding Group Co Ltd, Zhejiang Zeekr Intelligent Technology Co Ltd filed Critical Zhejiang Geely Holding Group Co Ltd
Publication of WO2024159679A1 publication Critical patent/WO2024159679A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y20/00—Information sensed or collected by the things
    • G16Y20/40—Information sensed or collected by the things relating to personal data, e.g. biometric data, records or preferences
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present application relates to the field of intelligent interaction technology, and in particular to an application control method, device, equipment and storage medium.
  • applications provide a rich human-computer interaction experience to enhance the user experience.
  • the personalized recommendation function in some applications makes intelligent content recommendations based on the user's historical data of using the application.
  • the present application provides an application control method, device, equipment and storage medium.
  • an application control method comprising:
  • a control instruction is sent to the target application, so that the target application performs an operation according to the control instruction.
  • acquiring the emotional characteristics of the target object according to the at least one physical sign data includes:
  • the vital sign data includes at least one of the target object's facial image, body temperature, blood pressure, blood sugar, blood oxygen, heart rate, sound and breathing frequency.
  • control instruction in response to the execution content of the target application satisfying the first mode, is used to instruct the target application to associate the execution content of the target application with the emotional characteristics of the target object.
  • control instruction in response to the execution content of the target application satisfying the first mode, the control instruction is used to:
  • the target application in response to the associated emotion feature not matching the emotion feature of the target object, the target application is instructed to update the associated emotion feature to the emotion feature of the target object.
  • control instruction in response to the execution content of the target application satisfying the second mode, is used to instruct the target application to call and execute content in an emotion content list that matches the emotion characteristics of the target object, and the emotion content list includes execution content in the target application that has been associated with the emotion characteristics.
  • the emotion feature includes the emotion of the target object and the emotion type corresponding to the emotion of the target object, and the emotion type includes three types for indicating positive emotion, negative emotion and neutral emotion;
  • control instruction In response to the execution content of the target application satisfying the second mode, the control instruction is used to:
  • the matching degree includes the matching degree between the emotion associated with the content with the same emotion type and the emotion of the target object.
  • the target application is an application currently used by the target object.
  • acquiring at least one vital sign data of the target object includes:
  • At least one vital sign data of the target object is acquired in real time.
  • the interface of the target application includes an option for starting an emotion content list function, and when the target object does not click on the emotion content list function option, the execution content satisfies the first mode.
  • the execution content satisfies the second mode.
  • performing emotion classification processing on the feature data set to obtain the emotion characteristics of the target object includes:
  • the feature data set is used as an input of an emotion classification network so that the emotion classification network outputs the emotion features of the target object, wherein the emotion features of the target object include the emotion of the target object and the emotion type corresponding to the emotion.
  • the method further comprises:
  • an emotion feature of the target object is determined.
  • an application control device comprising:
  • a data acquisition module which acquires at least one kind of vital sign data of the target object
  • An emotion acquisition module which acquires the emotion characteristics of the target object according to the at least one physical sign data
  • the control execution module sends a control instruction to the target application according to the execution content of the target application and the emotional characteristics of the target object, so that the target application performs an operation according to the control instruction.
  • the emotion acquisition module is specifically used to:
  • the vital sign data includes at least one of the target object's facial image, body temperature, blood pressure, blood sugar, blood oxygen, heart rate and breathing frequency.
  • control instruction in response to the execution content of the target application satisfying the first mode, is used to instruct the target application to associate the execution content of the target application with the emotional characteristics of the target object.
  • control instruction in response to the execution content of the target application satisfying the first mode, the control instruction is specifically used to:
  • the target application in response to the associated emotion feature not matching the emotion feature of the target object, the target application is instructed to update the associated emotion feature to the emotion feature of the target object.
  • control instruction in response to the execution content of the target application satisfying the second mode, is used to instruct the target application to call and execute content in an emotion content list that matches the emotion characteristics of the target object, and the emotion content list includes execution content in the target application that has been associated with the emotion characteristics.
  • the emotion feature includes the emotion of the target object and the emotion type corresponding to the emotion of the target object, and the emotion type includes three types for indicating positive emotion, negative emotion and neutral emotion;
  • control instruction In response to the execution content of the target application satisfying the second mode, the control instruction is specifically used to:
  • the matching degree includes the matching degree between the emotion associated with the content with the same emotion type and the emotion of the target object.
  • an electronic device comprising: a memory and a processor; the memory is used to store a computer program; the processor is used to execute the above-mentioned application control method by calling the computer program.
  • a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the above-mentioned application control method is implemented.
  • FIG1 is a schematic flow chart of an application control method according to an exemplary embodiment of the present application.
  • FIG2 is a schematic flow chart of an application control method applied in a vehicle, shown in an exemplary embodiment of the present application;
  • FIG3 is a schematic flow chart of a method for controlling a music application shown in an exemplary embodiment of the present application
  • FIG4 is a schematic diagram of the structure of an application control device shown in an exemplary embodiment of the present application.
  • FIG. 5 is a hardware schematic diagram of an electronic device shown in an exemplary embodiment of the present application.
  • first, second, third, etc. may be used in the present application to describe various information, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first classification threshold may also be referred to as the second classification threshold, and similarly, the second classification threshold may also be referred to as the first classification threshold.
  • word "if” as used herein may be interpreted as "at the time of” or “when” or “in response to determining”.
  • the present application provides an application control method, as shown in FIG1 , the method may include the following steps:
  • the physical sign data of the target object is used to characterize the physiological activity state of the target object.
  • the physical sign data may include Including but not limited to the target object's image, video, body temperature, blood pressure, blood sugar, blood oxygen, heart rate and breathing frequency and other data.
  • the image and video of the target object can be obtained through a camera, the body temperature of the target object can be obtained using a temperature sensor, and the data such as blood pressure, blood sugar, blood oxygen, heart rate and breathing frequency can be directly obtained with the help of a contact device, such as a sports bracelet in a wearable electronic device.
  • the vital sign data is used to indicate the physiological activity state of the target object.
  • the corresponding physiological activity state will also be different, which is specifically manifested as changes in the vital sign data.
  • the emotional state of the target object can be judged and the corresponding emotional characteristics can be obtained.
  • obtaining the emotional characteristics of the target object based on the at least one physical sign data includes: performing feature extraction on the at least one physical sign data to obtain a corresponding feature data set; performing emotion classification processing on the feature data set to obtain the emotional characteristics of the target object.
  • extracting features from the at least one type of vital sign data may include extracting features from each type of vital sign data in the at least one type of vital sign data to obtain feature data corresponding to each type of vital sign data; and obtaining a feature data set corresponding to the at least one type of vital sign data based on the obtained feature data corresponding to each type of vital sign data. Extracting features from the at least one type of vital sign data to obtain a feature data set that complies with the rules may be achieved through algorithms, programs, and other related technologies, which will not be elaborated in this application.
  • the emotion feature may include the emotion of the target object and the emotion type corresponding to the emotion, and the emotion type may include three types indicating positive emotion, neutral emotion, and negative emotion.
  • the feature data set can be used as the input content of the emotion recognition network to obtain the emotion features corresponding to the feature data set output by the emotion recognition network.
  • the emotion type corresponding to the emotion is an emotion type indicating positive emotions, such as positive emotion preference.
  • the vital sign data includes a facial image sequence of the target object at the current moment and at least one physiological parameter of the corresponding body temperature, blood pressure, blood sugar, blood oxygen, heart rate and respiratory rate.
  • feature extraction is performed on each type of vital sign data to obtain a first feature data set corresponding to the facial image sequence and a second feature data set corresponding to the at least one physiological parameter; facial image recognition processing is performed on the first feature data set to obtain the probability of the target object's emotion classification as each emotion, and further, the emotion classification result is combined with the second feature data set to perform emotion recognition processing again to determine the emotional characteristics of the target user.
  • the probability of the target object's emotion classification being "positive emotion” is 60%, the probability of the target object's emotion classification being “neutral emotion” is 35%, and the probability of the target object's emotion classification being “negative emotion” is 5%.
  • the emotion classification result determined based on the first feature data set is "positive emotion”.
  • the emotion classification result determined based on the second data set corresponding to at least one physiological parameter is "positive emotion", which is the same as the emotion classification result determined based on the first feature data set. In this case, it can be determined that the target user's emotional feature is "positive emotion”.
  • S103 Send a control instruction to the target application according to the execution content of the target application and the emotional characteristics of the target object, so that the target application performs an operation according to the control instruction.
  • the current execution content of the target application may include the operation page content corresponding to when the target application implements different functions.
  • the control instruction corresponds to the current execution content of the target application. Different execution contents correspond to different control instructions, so that the target application performs operations related to emotional characteristics on the current execution content according to emotional characteristics.
  • the target application After acquiring the emotional characteristics of the target object, the current execution content of the target application is obtained, the corresponding control instruction is determined according to the execution content, and the control instruction is sent to the target application; after receiving the control instruction, the target application determines the operation indicated by the control instruction, and performs the operation indicated by the control instruction on the current execution content.
  • the technical solution provided in the embodiment of the present application by acquiring the emotional characteristics of the target object without the user's perception, and sending corresponding control instructions based on the emotional characteristics and the execution content of the target application, so that the target application performs the corresponding operation, it is possible to control the operation of the application program based on the current emotional characteristics of the target object, providing a more convenient human-computer interaction experience.
  • control instruction in response to the execution content of the target application satisfying a first mode, is used to instruct the target application to associate the execution content of the target application with the emotional characteristics of the target object; in response to the execution content of the target application satisfying a second mode, the control instruction is used to instruct the target application to call and execute content in an emotional content list that matches the emotional characteristics of the target object, and the emotional content list includes execution content in the target application that has been associated with emotional characteristics.
  • Whether the execution content of the target application satisfies the first mode or the second mode depends on whether the execution content of the target application corresponds to the function of starting and running the emotion content list.
  • the target object is using the target application. Clicking different function options on the target application interface corresponds to different execution contents of the target application.
  • the target application interface may include an option to start the emotional content list function.
  • the target application interface does not display the function option of the emotional content list, or the function option is temporarily unavailable.
  • the target object does not click on the emotional content list function option, the execution content satisfies the first mode; when the target object clicks on the emotional content list function option, the execution content satisfies the second mode.
  • a corresponding control instruction is sent to the target application; after receiving the control instruction, the target application associates the current execution content with the acquired emotional characteristics of the target object, or adds a user emotional characteristic tag to the current execution content, and can add the execution content to the emotional content list after establishing the association between the execution content and the emotion.
  • a control instruction corresponding to the second mode is sent to the target application; after receiving the control instruction, the target application selects content matching the currently acquired emotional characteristics of the target user from the emotional content list and executes the matching content.
  • the emotional content list may include an emotional playlist list, in which songs are associated with the user's emotional characteristics, and each song is labeled with the user's emotional characteristic label.
  • the music player software interface does not display the function option of the emotional playlist list.
  • the music playing software interface When the music playing software interface does not display the function option of the emotional playlist, or the user does not select the function option of the emotional playlist, the music playing software starts playing songs, then the execution content of the music playing software satisfies the first mode; after receiving the control instruction, the currently acquired emotional characteristics of the user are associated with the song being played, such as adding the user's emotional label and emotional type label to the song being played. For example, if the acquired user emotion is excitement and positive emotional preference, and the currently playing song is song A, two labels are added to song A, namely "excitement" and "positive emotional preference".
  • the execution content of the music playback software satisfies the second mode; after receiving the control instruction, the songs that have been associated with the user's emotional characteristics in the music playback software, that is, the emotional playlist, are screened to find songs that match the currently acquired user emotional characteristics and play them. If the acquired emotional characteristics include happiness and positive emotional preferences, songs with positive emotional preferences and containing happy tags are preferentially screened in the emotional playlist for playing.
  • the execution content of the target application satisfies the first mode or the second mode.
  • the target application is controlled to perform operations corresponding to the first mode or the second mode on the current execution content, thereby realizing program operation control based on the emotional characteristics of the target object.
  • control instruction in response to the execution content of the target application satisfying the first mode, is specifically used to: when the execution content is not associated with the emotional characteristics, instruct the target application to associate the execution content with the emotional characteristics of the target object; when the execution content is already associated with the emotional characteristics, in response to the already associated emotional characteristics and the emotional characteristics of the target object not matching, instruct the target application to update the already associated emotional characteristics to the emotional characteristics of the target object.
  • the target application in the process of associating the execution content with the acquired emotional characteristics of the target object, there may be the following two methods: if the execution content itself is not associated with the emotional characteristics, the target application may be controlled to directly establish an association relationship between the execution content and the emotional characteristics of the currently acquired target object; in the case where the execution content is already associated with the emotional characteristics, when the already associated emotional characteristics do not match the emotional characteristics of the currently acquired target object, such as the already associated emotional characteristics include a positive emotional preference and the emotional characteristics of the currently acquired target object include a neutral emotional preference, the target application is controlled to update the already associated emotional characteristics to the currently acquired emotional characteristics.
  • an association is established between the execution content of the target application and the emotional characteristics of the target object, and the emotional characteristics associated with the execution content are timely updated according to the acquired emotional characteristics of the target object, so that the emotional characteristics associated with the execution content and the emotional characteristics of the target object are kept synchronously updated, so that the target application can provide more accurate emotion-related operations.
  • the emotion feature includes the emotion of the target object and the emotion type corresponding to the emotion of the target object, and the emotion type includes three types for indicating positive emotion, negative emotion and neutral emotion;
  • control instruction is specifically used to: instruct the target application to filter out content with the same emotion type corresponding to the emotion of the target object from the emotion content list; based on the emotion of the target object, call and execute content with the same emotion type according to the degree of match, and the degree of match includes the degree of match between the emotion associated with the content with the same emotion type and the emotion of the target object.
  • the execution content of the target application satisfies the second mode, and a control instruction is sent to enable the target application to filter and obtain the target object from the emotional content list.
  • the content with the same emotion type as that contained in the target object's emotional characteristics can be first filtered out, and further, the content with the same emotion type can be called and executed in the order of matching degree, and the matching degree can be the matching degree between the emotion corresponding to the content with the same emotion type and the emotion contained in the target object's emotional characteristics. For example, among the emotions corresponding to the content with the same emotion type and the emotions contained in the target object's emotional characteristics, if the two emotions are the same, the corresponding matching degree is the highest, and the content is executed first.
  • the emotional characteristics of the target object include the emotion "happy” and the emotion type "positive emotion preference”, then you can filter out songs whose corresponding emotion type label is "positive emotion preference” in the emotional playlist list, and among the songs containing "positive emotion preference", you can first play songs whose corresponding emotion is "happy”, and then play songs whose corresponding emotions are similar to "happy", and the remaining songs can be played in order.
  • content in an emotional content list is filtered according to the emotions and emotion types contained in the emotional characteristics of the target object, and the target application accurately executes the content that satisfies the target object's emotions based on the target object's current emotions, thereby achieving accurate control of the target application's execution state based on the target object's emotions and enhancing the user experience.
  • the embodiment of the present application takes the in-vehicle application control method as an example to illustrate the scheme of the present application.
  • the target object may be the driver
  • the target application is the application currently used by the driver
  • the application supports the execution of corresponding content based on the driver's emotional characteristics
  • the vehicle is usually equipped with devices including vital sign sensors, cameras, etc.
  • the vital sign sensors may include pressure sensors, current sensors, temperature sensors, etc., and the existing devices can be used to obtain the driver's vital sign data.
  • the steps may include:
  • the driver's images, videos and other data can be obtained through the camera installed in the vehicle; the driver's body temperature, sound, steering wheel pressure, steering wheel current and other vital sign data can also be obtained by using the vital sign sensors already installed in the vehicle.
  • the driver's body temperature and voice can be obtained through the body temperature sensor and the voice sensor respectively;
  • the steering wheel pressure is the pressure of the driver pressing the steering wheel, and the steering wheel current is the current flowing through the surface of the steering wheel when the driver holds the steering wheel with both hands. Therefore, the pressure sensor and current sensor installed on the steering wheel can be used to obtain Get the corresponding steering wheel pressure and steering wheel current.
  • the vital sign data is acquired, further data processing is performed on the vital sign data, and the processed data is used as new vital sign data, such as performing image enhancement processing on the image of the driver.
  • the feature data set may be the input content of the emotion classification algorithm or network, and meets the input data requirements of the algorithm or network. After obtaining at least one kind of vital sign data, feature extraction may be performed on the at least one kind of vital sign data to obtain a feature data set that meets the requirements.
  • the characteristic data set corresponds to the physiological activity state of the driver under the current emotional state.
  • the current emotional characteristics of the driver can be obtained by performing emotion classification processing based on the characteristic data set.
  • an emotion classification algorithm model and a service interface of the model are set in the vehicle's cabin controller. After the feature data set is acquired, the service interface is called to implement emotion classification processing to obtain the corresponding driver's emotion characteristics.
  • S204 Send a control instruction to the target application according to the emotional characteristics of the driver and the execution content of the target application, so that the target application performs a corresponding operation according to the operation instruction.
  • the target application is an application currently used by the driver, such as music software, video player software, etc.
  • the current execution content of the target application is obtained, and a corresponding control instruction is sent according to the current execution content.
  • the currently executed content corresponds to the function of starting to run the emotion content list, and the emotion content list includes execution content associated with the driver's emotions.
  • Corresponding control instructions are sent to implement interactive operations with the target application.
  • the control instructions are used to instruct the target application to filter and execute target content from the emotion content list.
  • the target content may include content in the emotion content list that matches the currently acquired driver's emotional characteristics.
  • a corresponding control instruction is sent to implement another interactive operation with the target application, and the control instruction is used to instruct the target application to associate the currently executed content with the emotion characteristics of the current driver.
  • the emotional characteristics of the target object are obtained through the device already installed in the vehicle, and the corresponding control instructions are sent according to the emotional characteristics and the execution content of the target application, so that the target application performs the corresponding operation, and the application is controlled according to the current emotional characteristics of the target object without adding additional equipment. Operation status.
  • the present application embodiment provides another music software control method, which may include the following steps:
  • the emotion service function is the service function corresponding to the technical solution provided in the embodiment of the present application.
  • the emotion service function can be in a closed state, and will not actively obtain the vital sign data of the target object and further use it in the operation process of subsequent steps.
  • the vital sign sensors, cameras, etc. in the vehicle may be in a temporarily non-working state and not provide any vital sign data collection service; or, the vital sign sensors, cameras, etc. may be in a state of continuously acquiring the driver's vital sign data, but before the emotional service function is started, the vital sign data is only recorded as a data, and no subsequent emotional feature extraction operation is performed.
  • Feature extraction is performed on the at least one physical sign data to obtain a feature data set that complies with the rules; after obtaining the feature data set, emotion classification processing is performed on the feature data to obtain the emotion characteristics of the target object corresponding to the feature data set.
  • the emotion classification processing can be implemented through an emotion classification network.
  • the classification network can preset multiple physical sign data categories and each physical sign data has its own weight value for emotion classification.
  • the physical sign data categories in the acquired feature data set can be dynamically adjusted to obtain the weight of the physical sign data for emotion classification; the acquired physical sign data set is used as the input of the emotion classification network, and the corresponding emotion features output by the emotion classification network can be obtained.
  • the emotion features can include the emotion of the target object and the emotion type corresponding to the emotion, so that at least one of the emotion features can be selected for use in subsequent operation steps.
  • the emotional playlist function corresponds to a way of playing songs in a music software; the songs in the emotional playlist include songs that have been associated with the emotional characteristics of the target object, or songs marked with emotional characteristics.
  • a control instruction is sent to enable the target application to perform an emotion association operation, that is, to associate the song currently playing by the music software with the acquired emotional characteristics of the target object, such as adding an emotional characteristic tag to the currently playing song, and the tag content is the acquired emotional characteristics of the target object.
  • the song that satisfies the emotional library and the emotions contained in the emotional characteristics can be added to the emotional playlist according to the emotional library set by the target application, so that the user can have a better experience when playing songs using the emotional playlist function.
  • the set emotional library includes all emotions corresponding to the positive emotional preference type.
  • Another mode of playing songs is to open the music software and then select the emotional playlist function to play songs, which corresponds to the situation in step S304.
  • the target object does not need to select the song content to be played.
  • a control instruction is sent to enable the target application to perform song screening and playback operations, that is, songs that match the acquired emotional characteristics of the target object are selected in the emotional playlist for playback.
  • the music software interface includes an emotional playlist function option, but the song list in the emotional playlist is not displayed on the screen, that is, the target object selects the emotional playlist function but cannot see the song content included in the emotional playlist.
  • the control instruction includes instruction information instructing the music software to select the first song in the emotional playlist to play, so that the music software performs the corresponding operation.
  • the present application further provides an embodiment of an application control device, the device comprising:
  • a data acquisition module 401 is used to acquire at least one type of vital sign data of a target object
  • An emotion acquisition module 402 is configured to acquire the emotion characteristics of the target object according to the at least one physical sign data
  • the control execution module 403 sends a control instruction to the target application according to the execution content of the target application and the emotional characteristics of the target object, so that the target application performs an operation according to the control instruction.
  • the emotion acquisition module is specifically used to:
  • the vital sign data includes at least one of the target object's facial image, body temperature, blood pressure, blood sugar, blood oxygen, heart rate and breathing frequency.
  • control instruction in response to the execution content of the target application satisfying the first mode, is used to instruct the target application to associate the execution content of the target application with the emotional characteristics of the target object.
  • control instruction in response to the execution content of the target application satisfying the first mode, the control instruction is specifically used to:
  • the target application in response to the associated emotion feature not matching the emotion feature of the target object, the target application is instructed to update the associated emotion feature to the emotion feature of the target object.
  • control instruction in response to the execution content of the target application satisfying the second mode, is used to instruct the target application to call and execute content in an emotion content list that matches the emotion characteristics of the target object, and the emotion content list includes execution content in the target application that has been associated with the emotion characteristics.
  • the emotion feature includes the emotion of the target object and the emotion type corresponding to the emotion of the target object, and the emotion type includes three types for indicating positive emotion, negative emotion and neutral emotion;
  • control instruction In response to the execution content of the target application satisfying the second mode, the control instruction is specifically used to:
  • the matching degree includes the matching degree between the emotion associated with the content with the same emotion type and the emotion of the target object.
  • the relevant parts can refer to the partial description of the method embodiments.
  • the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application. A person of ordinary skill in the art can understand and implement it without creative work.
  • An embodiment of the present application also provides an electronic device, a schematic diagram of the structure of the electronic device is shown in Figure 5, the electronic device 500 includes at least one processor 501, a memory 502 and a bus 503, and at least one processor 501 is electrically connected to the memory 502; the memory 502 is configured to store at least one computer-executable instruction, and the processor 501 is configured to execute the at least one computer-executable instruction, thereby executing any step of the application control method provided in any embodiment or any optional implementation method in the present application.
  • the processor 501 can be a FPGA (Field-Programmable Gate Array) or other devices with logic processing capabilities, such as an MCU (Microcontroller Unit) or a CPU (Central Process Unit).
  • FPGA Field-Programmable Gate Array
  • MCU Microcontroller Unit
  • CPU Central Process Unit
  • the technical solution provided in the embodiment of the present application by acquiring the emotional characteristics of the target object and sending corresponding control instructions based on the emotional characteristics and the execution content of the target application, so that the target application performs the corresponding operation, it is possible to control the operation of the application program based on the current emotional characteristics of the target object, thereby providing a more convenient human-computer interaction experience.
  • An embodiment of the present application also provides another readable storage medium storing a computer program, which is used to implement the steps of any application control method provided in any embodiment or any optional implementation manner in the present application when executed by a processor.
  • the readable storage medium includes, but is not limited to, any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or optical card. That is, the readable storage medium includes any medium that can store or transmit information in a readable form by a device (e.g., a computer).
  • the technical solution provided in the embodiment of the present application by acquiring the emotional characteristics of the target object and sending corresponding control instructions based on the emotional characteristics and the execution content of the target application, so that the target application performs the corresponding operation, it is possible to control the operation of the application program based on the current emotional characteristics of the target object, thereby providing a more convenient human-computer interaction experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

提供了一种应用程序控制方法、装置、设备及存储介质。应用程序控制方法包括：获取目标对象的至少一种体征数据（S101）；根据至少一种体征数据，获取目标对象的情绪特征（S102）；根据目标应用的执行内容和目标对象的情绪特征，向目标应用发送控制指令，以使目标应用根据控制指令执行操作（S103）。应用提供的技术方案，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更好的应用使用体验。

Description

应用程序控制方法、装置、设备及存储介质 技术领域
本申请涉及智能交互技术领域，尤其涉及一种应用程序控制方法、装置、设备及存储介质。
背景技术
应用程序作为媒体工具，提供了丰富的人机交互体验，以增强用户的使用体验。比如说，一些应用程序中的个性化推荐功能，通过用户使用程序的历史数据做智能化内容推荐。
相关技术中多通过对用户相关的历史内容数据进行分析，以识别用户的内容偏好，从而控制应用程序进行与内容偏好相关的操作，这种方式存在一定的时延、且在历史内容数据较少的情况下可能会无法精准识别用户偏好，给用户带来不好的体验。
发明内容
有鉴于此，为解决上述技术问题，本申请提供一种应用程序控制方法、装置、设备及存储介质。
具体地，本申请是通过如下技术方案实现的：
根据本申请实施例的第一方面，提供一种应用程序控制方法，所述方法包括：
获取目标对象的至少一种体征数据；
根据所述至少一种体征数据，获取所述目标对象的情绪特征；
根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
可选地，所述根据所述至少一种体征数据，获取所述目标对象的情绪特征，包括：
对所述至少一种体征数据进行特征提取，获取对应的特征数据集；
对所述特征数据集进行情绪分类处理，获取所述目标对象的情绪特征。
可选地，所述体征数据包括所述目标对象的面部图像、体温、血压、血糖、血氧、心率、声音及呼吸频次中的至少一项。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于指示所述目标应用将所述目标应用的执行内容与所述目标对象的情绪特征进行关联。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于：
在所述执行内容没有与情绪特征关联的情况下，指示所述目标应用将所述执行内容与所述目标对象的情绪特征进行关联；
在所述执行内容已经与情绪特征关联的情况下，响应于已经关联的情绪特征和所述目标对象的情绪特征不匹配，指示所述目标应用将所述已经关联的情绪特征更新为所述目标对象的情绪特征。
可选地，响应于所述目标应用的执行内容满足第二模式，所述控制指令用于指示所述目标应用调用并执行情绪内容列表中与所述目标对象的情绪特征相匹配的内容，所述情绪内容列表包括所述目标应用中已经与情绪特征关联的执行内容。
可选地，所述情绪特征包括所述目标对象的情绪、所述目标对象的情绪对应的情绪类型，所述情绪类型包括用于指示正向情绪、负向情绪及中性情绪的三种类型；
响应于所述目标应用的执行内容满足第二模式，所述控制指令用于：
指示所述目标应用从所述情绪内容列表中筛选出与所述目标对象的情绪对应的情绪类型相同的内容；
根据所述目标对象的情绪，按照匹配度调用并执行与所述情绪类型相同的内容，所述匹配度包括与所述情绪类型相同的内容关联的情绪和所述目标对象的情绪之间的匹配度。
可选地，所述目标应用是所述目标对象当前使用的应用程序。
可选地，获取目标对象的至少一种体征数据包括：
响应于所述目标对象启动情绪服务功能，实时获取所述目标对象的至少一种体征数据。
可选地，所述目标应用的界面包括启动情绪内容列表功能的选项，当所述目标对象没有点击所述情绪内容列表功能选项时，所述执行内容满足所述第一模式。
可选地，当所述目标对象点击情绪内容列表功能选项时，所述执行内容满足所述第二模式。
可选地，对所述特征数据集进行情绪分类处理，获取所述目标对象的情绪特征，包括：
将所述特征数据集作为情绪分类网络的输入，以使所述情绪分类网络输出所述目标对象的情绪特征，其中，所述目标对象的情绪特征包括所述目标对象的情绪、所述情绪对应的情绪类型。
可选地，所述方法还包括：
对所述至少一种体征数据中的每种体征数据进行特征提取，分别得到所述面部图像序列对应的第一特征数据集和所述至少一种生理参数对应的第二特征数据集；
对所述第一特征数据集进行人脸图像识别处理，得到所述目标对象的情绪分类为每一种情绪的概率；
基于所述目标对象的情绪分类为每一种情绪的概率，确定第一情绪分类结果；
基于至少一种生理参数对应的第二数据集，确定第二情绪分类结果；
基于所述第一情绪分类结果和所述第二情绪分类结果，确定所述目标对象的情绪特征。
根据本申请实施例的第二方面，提供一种应用程序控制装置，所述装置包括：
数据获取模块，获取目标对象的至少一种体征数据；
情绪获取模块，根据所述至少一种体征数据，获取所述目标对象的情绪特征；
控制执行模块，根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
可选地，所述情绪获取模块具体用于：
对所述至少一种体征数据进行特征提取，获取对应的特征数据集；
对所述特征数据集进行情绪分类处理，获取目标对象的情绪特征。
可选地，所述体征数据包括所述目标对象的面部图像、体温、血压、血糖、血氧、心率及呼吸频次中的至少一项。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于指示目标应用将所述目标应用的执行内容与所述目标对象的情绪特征进行关联。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令具体用于：
在所述执行内容没有与情绪特征关联的情况下，指示目标应用将所述执行内容与所述目标对象的情绪特征进行关联；
在所述执行内容已经与情绪特征关联的情况下，响应于已经关联的情绪特征和所述目标对象的情绪特征不匹配，指示目标应用将所述已经关联的情绪特征更新为所述目标对象的情绪特征。
可选地，响应于所述目标应用的执行内容满足第二模式，所述控制指令用于指示目标应用调用并执行情绪内容列表中与所述目标对象的情绪特征相匹配的内容，所述情绪内容列表包括目标应用中已经与情绪特征关联的执行内容。
可选地，所述情绪特征包括所述目标对象的情绪、所述目标对象的情绪对应的情绪类型，所述情绪类型包括用于指示正向情绪、负向情绪及中性情绪的三种类型；
响应于所述目标应用的执行内容满足第二模式，所述控制指令具体用于：
指示目标应用从所述情绪内容列表中筛选出与所述目标对象的情绪对应的情绪类型相同的内容；
根据所述目标对象的情绪，按照匹配度调用并执行与所述情绪类型相同的内容，所述匹配度包括与所述情绪类型相同的内容关联的情绪和所述目标对象的情绪之间的匹配度。
根据本申请实施例的第三方面，提供一种电子设备，所述电子设备包括：存储器和处理器；所述存储器，用于存储计算机程序；所述处理器，用于通过调用所述计算机程序，执行上述应用程序控制方法。
根据本申请实施例的第四方面，提供一种计算机可读存储介质，其上存储有计算机程序，所述程序被处理器执行时实现上述应用程序控制方法。
本申请实施例提供的技术方案可以包括以下有益效果：
在上述本申请提供的技术方案中，通过在用户无感的情况下获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更为便捷的人机交互体验。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性的和解释性的，并不能限制本申请。此外，本申请中的任一实施例并不需要达到上述的全部效果。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本申请的实施例，并与说明书一起用于解释本申请的原理。
图1是本申请一示例性实施例示出的一种应用程序控制方法流程示意图；
图2是本申请一示例性实施例示出的一种应用于车辆中的应用程序控制方法流程示意图；
图3是是本申请一示例性实施例示出的一种对音乐应用进行控制的方法流程示意图；
图4是本申请一示例性实施例示出的一种应用程序控制装置的结构示意图；
图5是本申请一示例性实施例示出的一种电子设备的硬件示意图。
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
在本申请使用的术语是仅仅出于描述特定实施例的目的，而非旨在限制本申请。在本申请和所附权利要求书中所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式，除非上下文清楚地表示其他含义。还应当理解，本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。
应当理解，尽管在本申请可能采用术语第一、第二、第三等来描述各种信息，但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如，在不脱离本申请范围的情况下，第一分类阈值也可以被称为第二分类阈值，类似地，第二分类阈值也可以被称为第一分类阈值。取决于语境，如在此所使用的词语“如果”可以被解释成为“在……时”或“当……时”或“响应于确定”。
本申请提供一种应用程序控制方法，参见图1所示，所述方法可以包括以下步骤：
S101，获取目标对象的至少一种体征数据；
目标对象的体征数据用于表征所述目标对象的生理活动状态，所述体征数据可以包 括但不限于所述目标对象的图像、视频、体温、血压、血糖、血氧、心率及呼吸频次等数据。
其中，所述目标对象的图像、视频可以通过摄像头获取，该目标对象的体温可以利用温度传感器得到，所述血压、血糖、血氧、心率及呼吸频次等数据可以借助接触式设备直接获取，如可穿戴式电子设备中的运动手环。
S102，根据所述至少一种体征数据，获取所述目标对象的情绪特征；
体征数据用于指示目标对象的生理活动状态，目标对象处于不同的情绪状态下，对应的生理活动状态也会不同，具体表现为体征数据上的变化；基于所述目标对象当前的体征数据，可以判断目标对象的情绪状态，获取到对应的情绪特征。
在一些实施例中，所述根据所述至少一种体征数据，获取所述目标对象的情绪特征，包括：对所述至少一种体征数据进行特征提取，获取对应的特征数据集；对所述特征数据集进行情绪分类处理，获取目标对象的情绪特征。
其中，对所述至少一种体征数据进行特征提取，可以包括对该至少一种体征数据中的每一种体征数据进行特征提取，得到每一种体征数据对应的特征数据；基于得到的每一种体征数据对应的特征数据，得到所述至少一种体征数据对应的特征数据集。对所述至少一种体征数据进行特征提取，获取符合规则的特征数据集，可以通过算法、程序等相关技术实现，本申请对此不再赘述。
所述情绪特征可以包括目标对象的情绪、以及所述情绪对应的情绪类型，所述情绪类型可以包括指示正向情绪、中性情绪、负向情绪的三种类型。
比如说，获取到四种体征数据，对所述四种体征数据进行特征提取，得到一个特征数据集；可以将所述特征数据集作为情绪识别网络的输入内容，得到情绪识别网络输出的该特征数据集对应的情绪特征。假设输出的情绪特征中，对应的目标对象的情绪是开心，该情绪对应的情绪类型是指示正向情绪的情绪类型，如正向情绪偏好。
在一个示例中，所述体征数据包括目标对象当前时刻的面部图像序列以及相应的体温、血压、血糖、血氧、心率及呼吸频次中的至少一种生理参数。在获取到体征数据后，对每一种体征数据进行特征提取，分别得到面部图像序列对应的第一特征数据集和所述至少一种生理参数对应的第二特征数据集；对所述第一特征数据集进行人脸图像识别处理，得到目标对象的情绪分类为每一种情绪的概率，进一步地，将所述情绪分类结果结合第二特征数据集再次进行情绪识别处理，确定目标用户的情绪特征。在一些实施例中， 在对第一特征数据集进行人脸图像识别处理后，得到的目标对象的情绪分类为“正向情绪”的概率是60％，目标对象的情绪分类为“中性情绪”的概率是35％，目标对象的情绪分类为“负向情绪”的概率是5％，在这种情况下，基于第一特征数据集确定的情绪分类结果为“正向情绪”。进一步，基于至少一种生理参数对应的第二数据集确定的情绪分类结果为“正向情绪”，与基于第一特征数据集确定的情绪分类结果相同，在这种情况下，可以确定目标用户的情绪特征是“正向情绪”。
S103，根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
所述目标应用当前的执行内容可以包括目标应用实现不同功能时对应的操作页面内容，所述控制指令与所述目标应用当前的执行内容相对应，不同的执行内容对应于不同的控制指令，以使得目标应用根据情绪特征对当前的执行内容进行与情绪特征相关的操作。
在获取到目标对象的情绪特征后，获取目标应用的当前执行内容，根据所述执行内容确定其对应的控制指令，并向所述目标应用发送控制指令；所述目标应用在接收到所述控制指令后，确定控制指令所指示的操作，并对当前执行内容进行控制指令所指示的操作。
根据本申请实施例提供的技术方案，通过在用户无感的情况下获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更为便捷的人机交互体验。
在一些实施例中，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于指示目标应用将所述目标应用的执行内容与所述目标对象的情绪特征进行关联；响应于所述目标应用的执行内容满足第二模式，所述控制指令用于指示目标应用调用并执行情绪内容列表中与所述目标对象的情绪特征相匹配的内容，所述情绪内容列表包括目标应用中已经与情绪特征关联的执行内容。
其中，所述目标应用的执行内容满足第一模式或者所述第二模式，在于目标应用的执行内容是否对应于启动运行情绪内容列表的功能。
目标对象正在使用目标应用，在目标应用界面点击不同的功能选项，对应目标应用的不同执行内容。目标应用界面可以包括启动情绪内容列表功能的选项，当第一次注册 并使用该目标应用、或者该目标应用内不存在与目标对象的情绪特征关联的执行内容时，所述目标应用界面不显示情绪内容列表的功能选项、或者该功能选项处于暂时不可用状态。当目标对象没有点击情绪内容列表功能选项时，所述执行内容满足第一模式；当目标对象点击情绪内容列表功能选项时，所述执行内容满足第二模式。
在所述执行内容满足第一模式时，向目标应用发送对应的控制指令；目标应用在接收到该控制指令后，将当前执行内容和获取到的目标对象的情绪特征建立关联、或者为当前执行内容添加用户情绪特征标签，可以在建立执行内容与情绪关联后将该执行内容添加到情绪内容列表中。
在所述执行内容满足第二模式时，向目标应用发送与第二模式对应的控制指令；目标应用在接收到控制指令后，从情绪内容列表中筛选与当前获取的目标用户的情绪特征匹配的内容，并执行该匹配的内容。
以所述目标应用是音乐播放软件为例，所述情绪内容列表可以包括情绪歌单列表，该列表内的歌曲都与用户的情绪特征建立关联，每首歌曲标有用户情绪特征标签。当第一次注册并使用该音乐软件、或者该音乐播放软件内不存在与用户情绪特征关联的歌曲时，所述音乐播放软件界面不显示情绪歌单列表的功能选项。
在音乐播放软件界面不显示情绪歌单列表的功能选项、或者用户没有选择情绪歌单列表的功能选项的情况下，音乐播放软件开始播放歌曲，则音乐播放软件的执行内容满足第一模式；在接收到控制指令后，将当前获取的用户的情绪特征与正在播放的歌曲进行关联，如为正在播放的歌曲添加用户的情绪标签、情绪类型标签，比如说获取的用户情绪是兴奋、正向情绪偏好，当前播放的歌曲是歌曲A，则为歌曲A添加两个标签，分别是“兴奋”“正向情绪偏好”。
当用户选择情绪歌单列表功能选项时，音乐播放软件的执行内容满足第二模式；在接收到控制指令后，在该音乐播放软件内已经与用户的情绪特征关联的歌曲中即情绪歌单中筛选，查找与当前获取的用户情绪特征相匹配的歌曲并进行播放，如获取的情绪特征包括开心、正向情绪偏好，则在情绪歌单中优先筛选正向情绪偏好且包含开心标签的歌曲进行播放。
在本申请实施例中，所述目标应用的执行内容满足第一模式或者第二模式，根据目标对象的情绪特征，控制目标应用对当前执行内容进行与第一模式或者第二模式对应的操作，实现了基于目标对象的情绪特征实现程序运行控制。
在一些实施例中，响应于所述目标应用的执行内容满足第一模式，所述控制指令具体用于：在所述执行内容没有与情绪特征关联的情况下，指示目标应用将所述执行内容与所述目标对象的情绪特征进行关联；在所述执行内容已经与情绪特征关联的情况下，响应于已经关联的情绪特征和所述目标对象的情绪特征不匹配，指示目标应用将所述已经关联的情绪特征更新为所述目标对象的情绪特征。
其中，在将所述执行内容与获取的目标对象的情绪特征进行关联的过程中，可以有下述两种方式：若所述执行内容本身没有与情绪特征进行关联，可以控制目标应用直接建立所述执行内容、当前获取的目标对象的情绪特征的关联关系；在所述执行内容已经与情绪特征关联的情况下，当已经关联的情绪特征与当前获取的目标对象的情绪特征不匹配时，如已经关联的情绪特征包括正向情绪偏好、当前获取的目标对象的情绪特征包括中性情绪偏好，则控制目标应用将所述已经关联的情绪特征更新为当前获取的情绪特征。
以上述音乐播放软件为例，在将当前播放的歌曲和获取的用户情绪特征进行关联的过程中，在当前播放的歌曲不包含情绪特征标签时，为当前播放的歌曲添加所述获取的用户情绪特征对应的标签；若当前播放的歌曲已经包含情绪特征标签，则在已经包含的情绪特征与当前获取的用户情绪特征不匹配的情况下，将对当前播放的歌曲包含的情绪特征标签进行更新，将其更新为当前获取的情绪特征。
在本申请实施例中，通过建立目标应用的执行内容与目标对象的情绪特征的关联，并根据获取的目标对象的情绪特征及时更新执行内容已经关联的情绪特征，使得执行内容关联的情绪特征与目标对象的情绪特征保持同步更新，以使目标应用提供更为准确的情绪化相关操作。
在一些实施例中，所述情绪特征包括所述目标对象的情绪、所述目标对象的情绪对应的情绪类型，所述情绪类型包括用于指示正向情绪、负向情绪及中性情绪的三种类型；
响应于所述目标应用的执行内容满足第二模式，所述控制指令具体用于：指示目标应用从所述情绪内容列表中筛选出与所述目标对象的情绪对应的情绪类型相同的内容；根据所述目标对象的情绪，按照匹配度调用并执行与所述情绪类型相同的内容，所述匹配度包括与所述情绪类型相同的内容关联的情绪和所述目标对象的情绪之间的匹配度。
其中，当目标对象选择目标应用的情绪内容列表功能选项时，目标应用的执行内容满足第二模式，发送控制指令以使目标应用从所述情绪内容列表中筛选与获取的目标对 象的情绪特征匹配的内容并执行。在控制目标应用从所述情绪内容列表中筛选与获取的目标对象的情绪特征匹配的内容的过程中，可以先筛选出与目标对象的情绪特征中包含的情绪类型相同的内容，进一步地，将与情绪类型相同的内容按照匹配度顺序调用并执行，该匹配度可以是与情绪类型相同的内容对应的情绪和目标对象的情绪特征中包含的情绪之间的匹配程度，比如说，在所述与情绪类型相同的内容对应的情绪、所述目标对象的情绪特征中包含的情绪中，二者情绪是相同的，对应的匹配程度最高，优先执行该内容。
仍以上述音乐播放软件为例，所述目标对象的情绪特征包含情绪“开心”、情绪类型“正向情绪偏好”，则可以在情绪歌单列表中筛选出歌曲对应的情绪类型标签是“正向情绪偏好”的歌曲，在包含“正向情绪偏好”的歌曲中可以先播放歌曲对应的情绪是“开心”的歌曲，接下来播放歌曲对应的情绪与“开心”相近的歌曲，余下的歌曲可以按照顺序播放。
在本申请实施例中，根据目标对象的情绪特征中包含的情绪、情绪类型进行情绪内容列表中的内容筛选，目标应用依据目标对象的当前情绪精准执行满足目标对象情绪的内容，实现了基于目标对象的情绪精准控制目标应用程序执行状态，增强了用户的使用体验。
本申请实施例以车辆内应用程序控制方法为例，对本申请的方案进行说明。在本实施例中，所述目标对象可以是驾驶员，目标应用是驾驶员当前使用的应用程序、且该应用程序支持基于驾驶员情绪特征执行对应内容；车辆内通常情况下会装配包括体征传感器、摄像头等装置，所述体征传感器可以包括压力传感器、电流传感器、温度传感器等，可以利用现有的装置获取驾驶员的体征数据。
下面详细描述应用程序控制方法的各个步骤，参见图2所示，该步骤可以包括：
S201，获取驾驶员的至少一种体征数据；
通过车辆内装载的摄像头，可以获取驾驶员的图像、视频等数据；也可以利用车辆内已经装载的体征传感器，获取驾驶员的体温、声音、方向盘压力、方向盘电流等体征数据。
其中，驾驶员体温、声音可以分别通过体温传感器、声音传感器获取；所述方向盘压力是驾驶员按压方向盘的压力大小，所述方向盘电流是驾驶员双手握方向盘时方向盘表面流过的电流大小，因此可以利用安装在方向盘上的压力传感器、电流传感器分别获 取对应的方向盘压力及方向盘电流。
在一个示例中，在获取到所述体征数据后，对所述体征数据作进一步地数据处理，将处理后的数据作为新的体征数据，如对驾驶员的图像进行图像增强处理等。
S202，对所述至少一种体征数据进行特征提取，得到对应的特征数据集；
所述特征数据集可以是情绪分类算法或者网络的输入内容，是符合该算法或网络的输入数据要求的。在获取到至少一种体征数据后，可以对所述至少一种体征数据进行特征提取，获取符合要求的特征数据集。
S203，根据所述特征数据集进行情绪分类处理，获取所述驾驶员的情绪特征，所述情绪特征包括驾驶员的情绪、以及所述情绪对应的情绪类型。
所述特征数据集对应于驾驶员当前情绪状态下的生理活动状态，基于所述特征数据集作情绪分类处理，可以获取驾驶员当前的情绪特征。
在一个示例中，车辆的座舱控制器内设置情绪分类算法模型及该模型的服务接口，在获取到所述特征数据集后，调用所述服务接口实现情绪分类处理，得到对应的驾驶员的情绪特征。
S204，根据所述驾驶员的情绪特征和所述目标应用的执行内容，向所述目标应用发送控制指令，以使所述目标应用根据操作指令执行对应的操作。
所述目标应用是驾驶员当前使用的应用程序，如音乐软件、视频播放软件等。获取所述目标应用的当前执行内容，并根据所述当前执行内容发送对应的控制指令。
该当前执行内容对应于启动运行情绪内容列表的功能，所述情绪内容列表包括与驾驶员的情绪关联的执行内容，则发送对应的控制指令实现与目标应用交互操作，所述控制指令用于指示目标应用从所述情绪内容列表中筛选并执行目标内容，所述目标内容可以包括情绪内容列表中与当前获取的驾驶员的情绪特征匹配的内容。
该当前执行内容不包括启动运行情绪内容列表功能，则发送对应的控制指令实现与目标应用另一种交互操作，所述控制指令用于指示目标应用将所述当前执行内容与当前驾驶员的情绪特征之间进行关联。
在本申请实施例中，通过车辆已经装载的装置获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，在无需增加额外设备的情况下实现了根据目标对象的当前情绪特征去控制应用程序的 运行情况。
本申请实施例提供另一种音乐软件控制方法，所述方法可以包括下述步骤：
S301，响应于目标对象启动情绪服务功能，实时获取所述目标对象的至少一种体征数据；
所述情绪服务功能，即本申请实施例提供的技术方案对应的服务功能。默认状态下，情绪服务功能可以处于关闭状态，不会主动获取所述目标对象的体征数据并进一步用于后续步骤的操作过程。
以车辆为例，车辆中的体征传感器、摄像头等可以处于暂不工作的状态，不提供任何体征数据采集服务；或者，所述体征传感器、摄像头等可以处于持续获取驾驶员的体征数据状态，但在情绪服务功能启动之前，所述体征数据仅仅作为一种数据记录,不进行后续情绪特征的提取操作。
S302，根据所述至少一种体征数据，获取所述目标对象的情绪特征；
对所述至少一种体征数据进行特征提取，获取符合规则的特征数据集；在获取到所述特征数据集后，对所述特征数据进行情绪分类处理，可以得到所述特征数据集对应的目标对象的情绪特征。
该情绪分类处理可以通过情绪分类网络实现，该分类网络可以预设多种体征数据类别且每种体征数据对情绪分类有各自的权重值，可以对获取的特征数据集中的体征数据类别进行动态调整以获取体征数据对情绪分类的权重；将获取的体征数据集作为情绪分类网络的输入，可以得到情绪分类网络输出的对应的情绪特征，所述情绪特征可以包括目标对象的情绪、该情绪对应的情绪类型，以使得在后续的操作步骤中可以选择使用所述情绪特征中的至少一种。
S303，响应于所述音乐软件的执行内容包括目标对象没有启动情绪歌单功能，控制音乐软件将音乐软件当前播放的歌曲与所述目标对象的情绪特征建立关联；
S304，响应于所述音乐软件的执行内容包括所述目标对象启动情绪歌单功能的情况下，控制音乐软件在所述情绪歌单中筛选与所述目标对象的情绪特征匹配的歌曲进行播放。
所述情绪歌单功能，对应于一种音乐软件播放歌曲的方式；该情绪歌单中的歌曲包括已经与目标对象的情绪特征建立关联的歌曲、或者标有情绪特征的歌曲。
音乐软件播放歌曲有两种模式，一种是打开音乐软件后选择除情绪歌单功能以外的任一种播放方式进行播放歌曲，这种模式对应于步骤S303中的情况，在获取到音乐软件的执行内容对应于选择除情绪歌单以外的播放方式播放歌曲的情况下，发送控制指令以使得目标应用进行情绪关联操作，即将音乐软件当前播放的歌曲与获取的目标对象的情绪特征进行关联，如为当前播放的歌曲添加情绪特征标签，该标签内容为获取的目标对象的情绪特征。
在一个示例中，在用户将当前播放的歌曲与获取的目标对象的情绪特征进行关联后，可以依据目标应用设定的情绪库，将所述情绪特征中包含的情绪满足情绪库的歌曲添加到情绪歌单，以使得用户使用情绪歌单功能播放歌曲时获得更好体验。例如，设定的情绪库中包括所有正向情绪偏好类型对应的情绪。
另一种播放歌曲的模式是打开音乐软件后选择情绪歌单功能播放歌曲，对应于步骤S304中的情况，这种模式下目标对象无需选择要播放的歌曲内容，在获取到音乐软件的执行内容对应于情绪歌单功能播放歌曲时，发送控制指令以使得目标应用进行歌曲筛选播放操作，即在所述情绪歌单中选择与获取的目标对象的情绪特征匹配的歌曲进行播放。
在一个示例中，该音乐软件界面包含情绪歌单功能选项，而情绪歌单中的歌曲列表不做屏幕显示，即目标对象选择情绪歌单功能而不能看到情绪歌单内包括的歌曲内容。
S305，响应于目标对象启动音乐软件的情绪歌单功能、且设定时间内没有获取到所述目标对象的情绪特征，控制音乐软件选择所述情绪歌单中第一首歌曲进行播放。
在目标对象选择情绪歌单功能播放歌曲的情况下，在设定的时间段内没有获取到目标对象的情绪特征，控制指令包括指示音乐软件选择所述情绪歌单中的第一首歌曲进行播放的指令信息，以使得音乐软件执行对应操作。
在本申请实施例提供的技术方案中，通过在用户无感的情况下获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更为便捷的人机交互体验。
与前述应用程序控制方法的实施例相对应，参见图4所示，本申请还提供了应用程序控制装置的实施例，所述装置包括：
数据获取模块401，获取目标对象的至少一种体征数据；
情绪获取模块402，根据所述至少一种体征数据，获取所述目标对象的情绪特征；
控制执行模块403，根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
可选地，所述情绪获取模块具体用于：
对所述至少一种体征数据进行特征提取，获取对应的特征数据集；
对所述特征数据集进行情绪分类处理，获取目标对象的情绪特征。
可选地，所述体征数据包括所述目标对象的面部图像、体温、血压、血糖、血氧、心率及呼吸频次中的至少一项。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于指示目标应用将所述目标应用的执行内容与所述目标对象的情绪特征进行关联。
可选地，响应于所述目标应用的执行内容满足第一模式，所述控制指令具体用于：
在所述执行内容没有与情绪特征关联的情况下，指示目标应用将所述执行内容与所述目标对象的情绪特征进行关联；
在所述执行内容已经与情绪特征关联的情况下，响应于已经关联的情绪特征和所述目标对象的情绪特征不匹配，指示目标应用将所述已经关联的情绪特征更新为所述目标对象的情绪特征。
可选地，响应于所述目标应用的执行内容满足第二模式，所述控制指令用于指示目标应用调用并执行情绪内容列表中与所述目标对象的情绪特征相匹配的内容，所述情绪内容列表包括目标应用中已经与情绪特征关联的执行内容。
可选地，所述情绪特征包括所述目标对象的情绪、所述目标对象的情绪对应的情绪类型，所述情绪类型包括用于指示正向情绪、负向情绪及中性情绪的三种类型；
响应于所述目标应用的执行内容满足第二模式，所述控制指令具体用于：
指示目标应用从所述情绪内容列表中筛选出与所述目标对象的情绪对应的情绪类型相同的内容；
根据所述目标对象的情绪，按照匹配度调用并执行与所述情绪类型相同的内容，所述匹配度包括与所述情绪类型相同的内容关联的情绪和所述目标对象的情绪之间的匹配度。
上述装置中各个单元的功能和作用的实现过程具体详见上述方法中对应步骤的实现过程，在此不再赘述。
对于装置实施例而言，由于其基本对应于方法实施例，所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本申请方案的目的。本领域普通技术人员在不付出创造性劳动的情况下，即可以理解并实施。
本申请实施例还提供了一种电子设备，该电子设备的结构示意图如图5所示，该电子设备500包括至少一个处理器501、存储器502和总线503，至少一个处理器501均与存储器502电连接；存储器502被配置用于存储有至少一个计算机可执行指令，处理器501被配置用于执行该至少一个计算机可执行指令，从而执行如本申请中任意一个实施例或任意一种可选实施方式提供的任意一种应用程序控制方法的步骤。
进一步，处理器501可以是FPGA(Field－Programmable Gate Array，现场可编程门阵列)或者其它具有逻辑处理能力的器件，如MCU(Microcontroller Unit，微控制单元)、CPU(Central Process Unit，中央处理器)。
根据本申请实施例提供的技术方案，通过获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更为便捷的人机交互体验。
本申请实施例还提供了另一种可读存储介质，存储有计算机程序，该计算机程序用于被处理器执行时实现本申请中任意一个实施例或任意一种可选实施方式提供的任意一种应用程序控制方法的步骤。
本申请实施例提供的可读存储介质包括但不限于任何类型的盘(包括软盘、硬盘、光盘、CD-ROM、和磁光盘)、ROM(Read-Only Memory，只读存储器)、RAM(Random Access Memory，随即存储器)、EPROM(Erasable Programmable Read-Only Memory，可擦写可编程只读存储器)、EEPROM(Electrically Erasable Programmable Read-Only Memory，电可擦可编程只读存储器)、闪存、磁性卡片或光线卡片。也就是，可读存储介质包括由设备(例如，计算机)以能够读的形式存储或传输信息的任何介质。
根据本申请实施例提供的技术方案，通过获取目标对象的情绪特征、并根据情绪特征和目标应用的执行内容发送对应的控制指令，以使得目标应用执行对应的操作，实现了根据目标对象的当前情绪特征去控制应用程序的运行情况，提供了更为便捷的人机交互体验。
虽然本说明书包含许多具体实施细节，但是这些不应被解释为限制任何发明的范围或所要求保护的范围，而是主要用于描述特定发明的具体实施例的特征。本说明书内在多个实施例中描述的某些特征也可以在单个实施例中被组合实施。另一方面，在单个实施例中描述的各种特征也可以在多个实施例中分开实施或以任何合适的子组合来实施。此外，虽然特征可以如上所述在某些组合中起作用并且甚至最初如此要求保护，但是来自所要求保护的组合中的一个或多个特征在一些情况下可以从该组合中去除，并且所要求保护的组合可以指向子组合或子组合的变型。
由此，主题的特定实施例已被描述。其他实施例在所附权利要求书的范围以内。在某些情况下，权利要求书中记载的动作可以以不同的顺序执行并且仍实现期望的结果。此外，附图中描绘的处理并非必需所示的特定顺序或顺次顺序，以实现期望的结果。在某些实现中，多任务和并行处理可能是有利的。
以上所述仅为本申请的较佳实施例而已，并不用以限制本申请，凡在本申请的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本申请保护的范围之内。

Claims (16)

  1. 一种应用程序控制方法，其特征在于，所述方法包括：
    获取目标对象的至少一种体征数据；
    根据所述至少一种体征数据，获取所述目标对象的情绪特征；
    根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述至少一种体征数据，获取所述目标对象的情绪特征，包括：
    对所述至少一种体征数据进行特征提取，获取对应的特征数据集；
    对所述特征数据集进行情绪分类处理，获取所述目标对象的情绪特征。
  3. 根据权利要求1所述的方法，其特征在于，所述体征数据包括所述目标对象的面部图像、体温、血压、血糖、血氧、心率、声音及呼吸频次中的至少一项。
  4. 根据权利要求1所述的方法，其特征在于，响应于所述目标应用的执行内容满足第一模式，所述控制指令用于指示所述目标应用将所述目标应用的执行内容与所述目标对象的情绪特征进行关联。
  5. 根据权利要求4所述的方法，其特征在于，所述控制指令用于：
    在所述执行内容没有与情绪特征关联的情况下，指示所述目标应用将所述执行内容与所述目标对象的情绪特征进行关联；
    在所述执行内容已经与情绪特征关联的情况下，响应于已经关联的情绪特征和所述目标对象的情绪特征不匹配，指示所述目标应用将所述已经关联的情绪特征更新为所述目标对象的情绪特征。
  6. 根据权利要求1所述的方法，其特征在于，响应于所述目标应用的执行内容满足第二模式，所述控制指令用于指示所述目标应用调用并执行情绪内容列表中与所述目标对象的情绪特征相匹配的内容，所述情绪内容列表包括所述目标应用中已经与情绪特征关联的执行内容。
  7. 根据权利要求6所述的方法，其特征在于，所述情绪特征包括所述目标对象的情绪、所述目标对象的情绪对应的情绪类型，所述情绪类型包括用于指示正向情绪、负向情绪及中性情绪的三种类型；所述控制指令用于：
    指示所述目标应用从所述情绪内容列表中筛选出与所述目标对象的情绪对应的情绪类型相同的内容；
    根据所述目标对象的情绪，按照匹配度调用并执行与所述情绪类型相同的内容，所 述匹配度包括与所述情绪类型相同的内容关联的情绪和所述目标对象的情绪之间的匹配度。
  8. 根据权利要求1所述的方法，其特征在于，所述目标应用是所述目标对象当前使用的应用程序。
  9. 根据权利要求1所述的方法，其特征在于，获取目标对象的至少一种体征数据包括：
    响应于所述目标对象启动情绪服务功能，实时获取所述目标对象的至少一种体征数据。
  10. 根据权利要求4所述的方法，其特征在于，所述目标应用的界面包括启动情绪内容列表功能的选项，当所述目标对象没有点击所述情绪内容列表功能选项时，所述执行内容满足所述第一模式。
  11. 根据权利要求6所述的方法，其特征在于，当所述目标对象点击情绪内容列表功能选项时，所述执行内容满足所述第二模式。
  12. 根据权利要求2所述的方法，其特征在于，对所述特征数据集进行情绪分类处理，获取所述目标对象的情绪特征，包括：将所述特征数据集作为情绪分类网络的输入，以使所述情绪分类网络输出所述目标对象的情绪特征，其中，所述目标对象的情绪特征包括所述目标对象的情绪、所述情绪对应的情绪类型。
  13. 根据权利要求3所述的方法，其特征在于，所述方法还包括：
    对所述至少一种体征数据中的每种体征数据进行特征提取，分别得到所述面部图像序列对应的第一特征数据集和所述至少一种生理参数对应的第二特征数据集；
    对所述第一特征数据集进行人脸图像识别处理，得到所述目标对象的情绪分类为每一种情绪的概率；
    基于所述目标对象的情绪分类为每一种情绪的概率，确定第一情绪分类结果；
    基于至少一种生理参数对应的第二数据集，确定第二情绪分类结果；
    基于所述第一情绪分类结果和所述第二情绪分类结果，确定所述目标对象的情绪特征。
  14. 一种应用程序控制装置，其特征在于，所述装置包括：
    数据获取模块，获取目标对象的至少一种体征数据；
    情绪获取模块，根据所述至少一种体征数据，获取所述目标对象的情绪特征；
    控制执行模块，根据目标应用的执行内容和所述目标对象的情绪特征，向所述目标应用发送控制指令，以使所述目标应用根据所述控制指令执行操作。
  15. 一种电子设备，其特征在于，包括：处理器、存储器；
    所述存储器，用于存储计算机程序；
    所述处理器，用于通过调用所述计算机程序，执行如权利要求1-13中任一项所述的应用程序控制方法。
  16. 一种可读存储介质，其上存储有计算机程序，其特征在于，所述程序被处理器执行时实现如权利要求1-13中任一项所述的应用程序控制方法。
PCT/CN2023/097936 2023-02-01 2023-06-02 应用程序控制方法、装置、设备及存储介质 Ceased WO2024159679A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310127732.6A CN116027907A (zh) 2023-02-01 2023-02-01 程序控制方法、装置、设备及存储介质
CN202310127732.6 2023-02-01

Publications (1)

Publication Number Publication Date
WO2024159679A1 true WO2024159679A1 (zh) 2024-08-08

Family

ID=86073986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/097936 Ceased WO2024159679A1 (zh) 2023-02-01 2023-06-02 应用程序控制方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN116027907A (zh)
WO (1) WO2024159679A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116027907A (zh) * 2023-02-01 2023-04-28 浙江极氪智能科技有限公司 程序控制方法、装置、设备及存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150206523A1 (en) * 2014-01-23 2015-07-23 National Chiao Tung University Method for selecting music based on face recognition, music selecting system and electronic apparatus
WO2017096979A1 (zh) * 2015-12-08 2017-06-15 乐视控股（北京）有限公司 基于用户情绪的节目播放方法和系统
CN110110134A (zh) * 2019-05-07 2019-08-09 广东工业大学 一种音乐推荐信息的生成方法、系统及相关组件
US20200413135A1 (en) * 2017-10-09 2020-12-31 Alibaba Group Holding Limited Methods and devices for robotic interactions
CN112528150A (zh) * 2020-12-17 2021-03-19 Oppo广东移动通信有限公司 直播推荐方法、装置、电子设备及存储介质
CN114817582A (zh) * 2022-03-25 2022-07-29 青岛海尔科技有限公司 资源信息的推送方法和电子装置
CN114999534A (zh) * 2022-06-10 2022-09-02 中国第一汽车股份有限公司 一种车载音乐的播放控制方法、装置、设备和存储介质
CN116027907A (zh) * 2023-02-01 2023-04-28 浙江极氪智能科技有限公司 程序控制方法、装置、设备及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150206523A1 (en) * 2014-01-23 2015-07-23 National Chiao Tung University Method for selecting music based on face recognition, music selecting system and electronic apparatus
WO2017096979A1 (zh) * 2015-12-08 2017-06-15 乐视控股（北京）有限公司 基于用户情绪的节目播放方法和系统
US20200413135A1 (en) * 2017-10-09 2020-12-31 Alibaba Group Holding Limited Methods and devices for robotic interactions
CN110110134A (zh) * 2019-05-07 2019-08-09 广东工业大学 一种音乐推荐信息的生成方法、系统及相关组件
CN112528150A (zh) * 2020-12-17 2021-03-19 Oppo广东移动通信有限公司 直播推荐方法、装置、电子设备及存储介质
CN114817582A (zh) * 2022-03-25 2022-07-29 青岛海尔科技有限公司 资源信息的推送方法和电子装置
CN114999534A (zh) * 2022-06-10 2022-09-02 中国第一汽车股份有限公司 一种车载音乐的播放控制方法、装置、设备和存储介质
CN116027907A (zh) * 2023-02-01 2023-04-28 浙江极氪智能科技有限公司 程序控制方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN116027907A (zh) 2023-04-28

Similar Documents

Publication Publication Date Title
US8847884B2 (en) Electronic device and method for offering services according to user facial expressions
US8418193B2 (en) Information processing terminal, information processing method, and program
AU2018278562B2 (en) Method for pushing picture, mobile terminal, and storage medium
CN104714633A (zh) 一种终端配置的方法及终端
WO2019227630A1 (zh) 歌曲推荐方法和装置
CN110442867B (zh) 图像处理方法、装置、终端及计算机存储介质
US20220188304A1 (en) Method and system for handling query in iot network
CN108681390A (zh) 信息交互方法和装置、存储介质及电子装置
WO2019137391A1 (zh) 对视频进行分类匹配的方法、装置和挑选引擎
CN112306238A (zh) 交互方式的确定方法、装置、电子设备及存储介质
CN110148393A (zh) 音乐生成方法、装置和系统以及数据处理方法
WO2024159679A1 (zh) 应用程序控制方法、装置、设备及存储介质
WO2017143951A1 (zh) 一种表情反馈方法及智能机器人
CN111967380A (zh) 内容推荐方法及系统
JP2025537458A (ja) ＩｏＴセンサを使用した音声および視覚コンテンツ向けの自動コノテーション
CN116418611B (zh) 智能设备的交互方法和装置、存储介质及电子装置
JP2026021000A (ja) システム
Agrawal et al. Moodplayer: An emotion based music player
JP2026022489A (ja) システム
CN118068950A (zh) 交互方法及相关设备
JP2026063841A (ja) システム
JP2026051244A (ja) システム
JP2026072463A (ja) システム
JP2026041234A (ja) システム
JP2026045503A (ja) システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23919246

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23919246

Country of ref document: EP

Kind code of ref document: A1