CN116048316A - Vehicle-mounted genius control method and device, electronic equipment and storage medium - Google Patents

Vehicle-mounted genius control method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116048316A
CN116048316A CN202310004685.6A CN202310004685A CN116048316A CN 116048316 A CN116048316 A CN 116048316A CN 202310004685 A CN202310004685 A CN 202310004685A CN 116048316 A CN116048316 A CN 116048316A
Authority
CN
China
Prior art keywords
vehicle
target
eidolon
skin
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310004685.6A
Other languages
Chinese (zh)
Inventor
陈光银
魏来
陈楚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co Ltd filed Critical Chongqing Changan Automobile Co Ltd
Priority to CN202310004685.6A priority Critical patent/CN116048316A/en
Publication of CN116048316A publication Critical patent/CN116048316A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The embodiment of the application provides a vehicle-mounted eidolon control method, a device, electronic equipment and a storage medium, wherein the vehicle-mounted eidolon control method comprises the steps of receiving a registration request of a vehicle-mounted eidolon, wherein the registration request comprises a vehicle-mounted eidolon identifier, establishing a message channel between a vehicle-mounted intelligent assistant and the vehicle-mounted eidolon according to the vehicle-mounted eidolon identifier, generating a target instruction based on a preset data structure and an eidolon triggering event if a eidolon triggering event is monitored, and sending the target instruction through the message channel so as to control the vehicle-mounted eidolon according to the target instruction, so that the vehicle-mounted eidolon can be controlled through the target instruction generated by the vehicle-mounted intelligent assistant when the vehicle-mounted eidolon is dormant, and the real-time performance of controlling the vehicle-mounted eidolon is improved.

Description

Vehicle-mounted genius control method and device, electronic equipment and storage medium
Technical Field
The application relates to the technical field of internet of vehicles, in particular to a vehicle-mounted eidolon control method, a vehicle-mounted eidolon control device, electronic equipment and a computer-readable storage medium.
Background
With the development and popularization of the Internet of vehicles, the degree of diversification and intelligence of the functions of the vehicles is higher and higher, and the vehicles are no longer a simple walking tool in the life of people. The automobile AI (Artificial Intelligence ) intelligent assistant is already a standard, and in order to communicate with the automobile owner more personified, the AI intelligent assistant accompanies the automobile owner better, becomes an automobile 'partner' of the automobile owner, and the 3D (3D) eidolon the automobile is a new one.
At present, the existing 3D eidolon is simply displayed, the presentation mode is single and fixed, and the method is not provided for a vehicle owner to flexibly configure an operation method to be linked with the 3D eidolon. When the 3D eidolon moves back to the background, the 3D eidolon is in a dormant state, cannot receive the message, and cannot realize real-time control over the 3D eidolon.
Disclosure of Invention
In view of the above-mentioned drawbacks of the prior art, embodiments of the present application provide a vehicle-mounted puck control method, apparatus, electronic device, and computer-readable storage medium, so as to solve the technical problem that real-time control of a 3D puck cannot be performed when the 3D puck is dormant.
The embodiment of the application provides a vehicle-mounted eidolon control method, which comprises the following steps: receiving a registration request of a vehicle-mounted intelligent assistant, wherein the registration request comprises a vehicle-mounted intelligent assistant identifier, and a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent assistant is established according to the vehicle-mounted intelligent assistant identifier; if the eidolon triggering event is monitored, generating a target instruction based on a preset data structure and the eidolon triggering event; and sending the target instruction through the message channel so as to control the vehicle-mounted eidolon according to the target instruction.
In an embodiment of the present application, after the target instruction is sent through the message channel, the vehicle-mounted puck control method includes: receiving the target instruction; if the target instruction comprises an action parameter, matching target action data corresponding to the target action identifier from a database based on the target action identifier in the action parameter so as to control the vehicle-mounted eidolon to perform action display according to the target action data; if the target instruction comprises an expression parameter, matching target expression data corresponding to a target expression identifier in a database based on the target expression identifier in the expression parameter so as to control the vehicle-mounted eidolon to display the expression according to the target expression data; if the target instruction comprises voice parameters, matching target voice data corresponding to the target voice identifications from a database based on the target voice identifications in the voice parameters so as to control the vehicle-mounted genie to play voice according to the target voice data; and if the target instruction comprises a position parameter, adjusting the position of the vehicle-mounted genie based on target position information in the position parameter.
In an embodiment of the present application, after receiving the target instruction, the vehicle-mounted puck control method includes: and if the target instruction comprises a skin parameter, matching target skin data corresponding to the target skin identifier from a database based on the target skin identifier in the skin parameter so as to control the vehicle-mounted eidolon to change skin according to the target skin data.
In an embodiment of the present application, after matching target skin data corresponding to the target skin identifier based on the target skin identifier in the skin parameter, the vehicle-mounted genie control method includes: if the target skin replacement type in the skin parameters is try-on, controlling the vehicle-mounted genie to execute skin try-on according to the target skin data; and if the target skin change type in the skin parameters is the use, controlling the vehicle-mounted eidolon to execute the skin use according to the target skin data.
In an embodiment of the present application, before generating the target instruction based on the preset data structure and the puck triggering event, the vehicle-mounted puck control method includes: the method comprises the steps of obtaining preset image data of the vehicle-mounted genie, storing the preset image data in a database, and configuring a corresponding relation between the preset image data and preset image identifications, wherein the preset image data comprises at least one of preset action data, preset expression data, preset voice data and preset skin data, and the preset image identifications comprise at least one of preset action identifications, preset expression identifications, preset voice identifications and preset skin identifications.
In an embodiment of the present application, before generating the target instruction based on the preset data structure and the puck triggering event, the vehicle-mounted puck control method further includes: defining a preset data structure of the vehicle-mounted eidolon, wherein the preset data structure comprises at least one of an action parameter structure, an expression parameter structure, a voice parameter structure, a position parameter structure and a skin parameter structure.
In an embodiment of the present application, establishing a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted smart assistant according to the vehicle-mounted smart phone identifier includes: establishing a first messaging module for the vehicle-mounted intelligent assistant and a second messaging module for the vehicle-mounted intelligent assistant; binding the first messaging module with the second messaging module to obtain the message channel.
In an embodiment of the present application, there is also provided an in-vehicle smart control apparatus including: the system comprises a channel establishing module, a channel processing module and a channel processing module, wherein the channel establishing module is used for receiving a registration request of the vehicle-mounted eidolon, the registration request comprises a vehicle-mounted eidolon identifier, and a message channel between a vehicle-mounted intelligent assistant and the vehicle-mounted eidolon is established according to the vehicle-mounted eidolon identifier; the instruction generation module is used for generating a target instruction based on a preset data structure and the eidolon triggering event if the eidolon triggering event is monitored; and the instruction sending module is used for sending the target instruction through the message channel so as to control the vehicle-mounted eidolon according to the target instruction.
In an embodiment of the present application, there is also provided an electronic device including: one or more processors; and a storage means for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the vehicle-mounted puck control method as described above.
In an embodiment of the present application, there is also provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor of a computer, causes the computer to perform the vehicle-mounted puck control method as described above.
The beneficial effects of this application: the embodiment of the application provides a vehicle-mounted intelligent agent control method, a device, electronic equipment and a computer readable storage medium, wherein the vehicle-mounted intelligent agent control method establishes a message channel between a vehicle-mounted intelligent assistant and the vehicle-mounted intelligent agent according to a registration request of the received vehicle-mounted intelligent agent, generates a target instruction based on a preset data structure and an intelligent agent triggering event when the intelligent agent triggering event is monitored, and sends the target instruction through the message channel so as to control the vehicle-mounted intelligent agent according to the target instruction, and can also control the vehicle-mounted intelligent agent through the target instruction generated by the vehicle-mounted intelligent assistant when the vehicle-mounted intelligent agent sleeps, so that the real-time performance of controlling the vehicle-mounted intelligent agent is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. It is evident that the drawings in the following description are only some embodiments of the present application, from which other drawings can be obtained for a person of ordinary skill in the art without inventive effort. In the drawings:
FIG. 1 is a schematic illustration of an environment in which a vehicle-mounted puck control method is implemented, as shown in an exemplary embodiment of the present application;
FIG. 2 is a flow chart illustrating a method of vehicle-mounted puck control, according to an exemplary embodiment of the present application;
FIG. 3 is a schematic diagram of a particular vehicle-mounted puck control system architecture shown in an exemplary embodiment of the present application;
FIG. 4 is a schematic diagram of a skin interface in an exemplary application scenario;
FIG. 5 is a block diagram of an in-vehicle puck control device shown in an exemplary embodiment of the present application;
fig. 6 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application.
Detailed Description
Further advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure in the present specification, by describing embodiments of the present application with reference to the accompanying drawings and preferred examples. The present application may be embodied or carried out in other specific embodiments, and the details of the present application may be modified or changed from various points of view and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are presented by way of illustration only and not by way of limitation to the scope of the present application.
It should be noted that, the illustrations provided in the following embodiments merely illustrate the basic concepts of the application by way of illustration, and only the components related to the application are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complex.
It should be noted that, in this application, "first", "second", and the like are merely distinguishing between similar objects, and are not limited to the order or precedence of similar objects. The description of variations such as "comprising," "having," etc., means that the subject of the word is not exclusive, except for the examples shown by the word.
It should be understood that the various numbers, step numbers, etc. described in this application are for ease of description and are not intended to limit the scope of this application. The size of the reference numerals in this application does not mean the order of execution, and the order of execution of the processes should be determined by their functions and inherent logic.
In the following description, numerous details are set forth to provide a more thorough explanation of embodiments of the present application, however, it will be apparent to one skilled in the art that embodiments of the present application may be practiced without these specific details, in other embodiments, well-known structures and devices are shown in block diagram form, rather than in detail, in order to avoid obscuring the embodiments of the present application.
Embodiments of the present application, which will be described in detail below, respectively propose a vehicle-mounted puck control method, a vehicle-mounted puck control device, an electronic device, a computer-readable storage medium, and a computer program product.
Referring to fig. 1, fig. 1 is a schematic diagram of an implementation environment of a vehicle-mounted puck control method according to an exemplary embodiment of the present application.
Referring to FIG. 1, an implementation environment may include a server 101, an onboard intelligent assistant 102, and an onboard puck 103. The server 101 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network ), and basic cloud computing services such as big data and an artificial intelligence platform, which are not limited herein. In-vehicle puck 103 may be a three-dimensional or two-dimensional image, and in-vehicle puck 103 may be a system application, or a third party application, again without limitation. Vehicle-mounted intelligent assistant 102 is configured to control the visual presentation of vehicle-mounted puck 103 by receiving a registration request message, establishing a message channel, monitoring a puck triggering event, and sending a target command in conjunction with vehicle-mounted puck 103. In addition, the vehicle-mounted intelligent assistant 102 is further configured to acquire image data of the vehicle-mounted eidolon 103, and store the image data in a database, where the image data is basic data of the vehicle-mounted eidolon 103 for displaying actions, expressions, skin and playing voices; the server 101 is configured to provide the image data of the vehicle-mounted smart assistant 102 with the vehicle-mounted smart assistant 103. Vehicle-mounted smart assistant 102 controls vehicle-mounted smart assistant 103 by sending a registration request message and executing a target instruction.
Illustratively, the vehicle-mounted intelligent assistant 102 receives a registration request message sent by the vehicle-mounted intelligent assistant 103, establishes a message channel between the vehicle-mounted intelligent assistant 102 and the vehicle-mounted intelligent assistant 103 according to the vehicle-mounted intelligent assistant identification information in the registration request message, generates a target instruction based on a preset data structure and the intelligent assistant triggering event if the intelligent assistant triggering event is monitored, and sends the target instruction through the message channel so as to control the vehicle-mounted intelligent assistant 103 according to the target instruction. According to the technical scheme, when the vehicle-mounted eidolon sleeps, if the vehicle-mounted intelligent assistant monitors an eidolon triggering event, a target instruction can be sent according to the eidolon triggering event, so that the vehicle-mounted eidolon is controlled, and the real-time performance of controlling the vehicle-mounted eidolon is improved.
It should be noted that, the vehicle-mounted intelligent assistant 102 and the vehicle-mounted intelligent assistant 103 generally perform the vehicle-mounted intelligent control method provided in the embodiment of the present application, and the vehicle-mounted intelligent assistant 102 generally sets the vehicle-mounted intelligent control device.
Referring to fig. 2, fig. 2 is a flowchart illustrating a vehicle-mounted puck control method according to an exemplary embodiment of the present application. The method can be applied to the implementation environment shown in fig. 1, and is specifically executed by the server side 101, the vehicle-mounted intelligent assistant 102 and the vehicle-mounted puck 103 in the implementation environment. It should be understood that the method may be adapted for use in other exemplary embodiments and be specifically implemented by devices or applications in other embodiments, and that the present embodiment is not limited by the embodiment in which the method is adapted.
Referring to fig. 2, in an exemplary embodiment, the vehicle-mounted puck control method at least includes steps S210 to S230, and is described in detail below:
step S210, receiving a registration request of the vehicle-mounted eidolon, wherein the registration request comprises a vehicle-mounted eidolon identifier, and establishing a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted eidolon according to the vehicle-mounted eidolon identifier.
In one embodiment of the present application, when the vehicle-mounted puck goes back to the background, it is in a dormant state and cannot respond in time to the puck triggering event. In order to ensure timeliness of the image data display of the vehicle-mounted intelligent assistant, the vehicle-mounted intelligent assistant can control the vehicle-mounted intelligent assistant, so that the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent assistant can carry out cross-application linkage, and a user can obtain better experience. Therefore, in order to ensure communication between the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent sprite, the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent sprite need to be connected, and firstly, vehicle-mounted intelligent assistant registration information is needed to be stored in the vehicle-mounted intelligent assistant. The vehicle-mounted intelligent assistant establishes a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent assistant according to the vehicle-mounted intelligent assistant identifier in the registration request by sending the registration request to the vehicle-mounted intelligent assistant, so that the vehicle-mounted intelligent assistant can communicate with the vehicle-mounted intelligent assistant through the message channel. The message channel is used as a bridge for vehicle-mounted eidolon cross application linkage.
In one embodiment of the present application, establishing a message channel between an in-vehicle intelligent assistant and an in-vehicle puck according to an in-vehicle puck identification includes:
establishing a first message receiving and transmitting module for the vehicle-mounted intelligent assistant and a second message receiving and transmitting module for the vehicle-mounted intelligent assistant; binding the first messaging module with the second messaging module to obtain a message channel. The steps can realize bidirectional communication between the vehicle-mounted intelligent assistant and the vehicle-mounted eidolon.
In another embodiment of the present application, a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted puck is established according to the vehicle-mounted puck identifier, further comprising:
establishing a message sending module for the vehicle-mounted intelligent assistant and establishing a message receiving module for the vehicle-mounted intelligent assistant; and binding the message sending module with the message receiving module to obtain a message channel. The steps can realize one-way communication of the vehicle-mounted intelligent assistant sending a message or an instruction to the vehicle-mounted eidolon.
Step S220, if the eidolon triggering event is monitored, generating a target instruction based on the preset data structure and the eidolon triggering event.
In one embodiment of the present application, the smart assistant may monitor the current time, the user voice command, and the user touch command through the vehicle, by including at least one of a time trigger event, a voice trigger event, and a touch trigger event. For example, if there is image data related to holidays, for example, voice data representing holidays, when it is monitored that the current time is a holiday, if the current time is matched with a target image identifier corresponding to the holiday, a target instruction is generated according to a preset data structure and the target image identifier. When the user voice command is monitored to have the preset trigger keyword related to the vehicle-mounted genie, the target image identification corresponding to the preset trigger keyword is matched, the target command is generated according to the preset data structure and the target image identification, for example, if the motion data related to dancing exists, the user voice command comprises the preset trigger keyword of 'vehicle-mounted genie dancing', and the target command comprising the target motion identification corresponding to dancing is generated. For example, when it is monitored that the user touch instruction is skin change, a target instruction including a target skin identifier and a target skin change type is generated according to the touch selection information of the user and a preset data structure. For example, when the user touch instruction is monitored to be a music playing instruction, a target instruction can be generated, and the target instruction can include a target image identifier related to music, such as a motion identifier related to dancing, so that corresponding interaction of the vehicle-mounted fairy can be realized when the music is played.
It should be understood that the correspondence between the eidolon trigger event and the target character identifier is preset by those skilled in the art according to the actual application, and is not limited herein, but only provides reference opinion.
In one embodiment of the present application, the on-board puck control method includes, prior to generating a target instruction based on a preset data structure and a puck trigger event:
the method comprises the steps of obtaining preset image data of the vehicle-mounted fairy, storing the preset image data in a database, and configuring a corresponding relation between the preset image data and preset image identifications.
In one embodiment of the application, after each time the vehicle-mounted intelligent assistant starts up, initializing the preset image data of the vehicle-mounted intelligent assistant to update the preset image data of the vehicle-mounted intelligent assistant, sending an instruction to a server to acquire the preset image data, and storing the preset image data into a database to serve as basic data for rendering the vehicle-mounted intelligent assistant. Since the number of the preset image data may be plural, a preset image identifier corresponding to the preset image data needs to be configured for each preset image data. The preset image data comprises at least one of preset action data, preset expression data, preset voice data and preset skin data, and the corresponding preset image mark comprises at least one of preset action mark, preset expression mark, preset voice mark and preset skin mark. The preset character identifier may be composed of a character name and a character data number, for example: the preset action mark comprises an action name and an action number, the preset expression mark comprises an expression name and an expression number, the preset voice mark comprises a voice name and a voice number, and the preset skin mark comprises a skin name and a skin number. The number of the preset action data can be multiple, and a preset action identifier corresponding to the preset action data needs to be configured for each preset action data; the number of the preset expression data can be multiple, and preset expression identifiers corresponding to the preset expression data are required to be configured for each preset expression data; the number of the preset voice data can be multiple, and a preset voice identifier corresponding to the preset voice data needs to be configured for each preset voice data; the number of the preset skin data may be plural, and a preset skin identifier corresponding to the preset skin data needs to be configured for each preset skin data.
In one embodiment of the present application, before generating the target instruction based on the preset data structure and the puck triggering event, the on-board puck control method further includes:
defining a preset data structure of the vehicle-mounted eidolon, wherein the preset data structure comprises at least one of an action parameter structure, an expression parameter structure, a voice parameter structure, a position parameter structure and a skin parameter structure.
The preset data structure is defined so that both parties can parse data faster and more conveniently after receiving the message to execute the corresponding target instruction. In an actual control flow, a set of corresponding preset data structures is defined by the instruction corresponding to each target image identifier, and the same category can share one set of preset data structure, so that the target instruction is generated only by changing specific contents.
For example, the storage positions of the action name and the target action number may be set in the action parameter structure, the storage positions of the expression name and the target expression number may be set in the expression parameter structure, the storage positions of the voice name and the target voice number may be set in the voice parameter structure, and the storage positions of the position name and the target position information may be set in the position parameter structure. The skin name, the storage location of the target skin number, or the skin name, the storage location of the target skin number, and the storage location of the target skin change type may be set in the skin parameter. And generating a preset data structure based on at least one of the action parameter structure, the expression parameter structure number, the voice parameter structure, the position parameter structure and the skin parameter structure to obtain a plurality of preset data structures. For example, when skin replacement is required, only skin parameter structures are adopted in the preset data structures; if the user wants to broadcast voice when changing skin, the preset data structure consists of a skin parameter structure and a voice parameter structure, and when the vehicle-mounted genius receives a target instruction, the user can analyze the skin parameter and the voice parameter, and broadcast voice while executing skin change.
Step S230, a target instruction is sent through a message channel so as to control the vehicle-mounted eidolon according to the target instruction.
In one embodiment of the application, the vehicle-mounted intelligent assistant sends a target instruction to the vehicle-mounted eidolon through the established message channel, so that the vehicle-mounted eidolon responds to the target instruction, and accordingly image display is carried out. The vehicle-mounted intelligent assistant controls the vehicle-mounted intelligent agent through the target instruction, so that when the vehicle-mounted intelligent agent is in a dormant state, the vehicle-mounted intelligent agent can also timely receive the target instruction, wake up the target instruction, and perform corresponding image display according to the target instruction, thereby ensuring the timeliness of vehicle-mounted intelligent agent response.
In one embodiment of the present application, after sending a target instruction through a message channel, the vehicle-mounted puck control method includes the following steps:
in step S231, a target instruction is received.
In one embodiment of the present application, the vehicle-mounted puck receives a target instruction, parses the target instruction according to a preset data structure to determine an image parameter existing in the target instruction, where the image parameter in the target instruction may be one or more, in other words, the target instruction includes at least one image parameter of an action parameter, an expression parameter, a voice parameter, a position parameter, and a skin parameter. For example, the image name may be identified to determine which image parameter is specifically, for example, the action name of the action parameter may be "action", the skin name of the skin parameter may be "config", if "action" is identified from the target instruction, the action parameter is determined to be present in the target instruction, and if "config" is identified from the target instruction, the skin parameter is determined to be present in the target instruction.
Step S232, if the target instruction comprises the action parameters, matching target action data corresponding to the target action identifiers from the database based on the target action identifiers in the action parameters so as to control the vehicle-mounted eidolon to perform action display according to the target action data.
In one embodiment of the present application, if the motion parameter is parsed from the target instruction, the target motion identifier is extracted from the motion parameter, and the target motion data corresponding to the target motion identifier is matched from the database. For example, a path storing target motion data can be obtained from a database according to a motion name and a target motion number in the target motion identifier, the target motion data is read from the database according to the path, and the vehicle-mounted eidolon is rendered based on the target motion data, so that the vehicle-mounted eidolon performs motion display.
Step S233, if the target instruction comprises the expression parameter, matching target expression data corresponding to the target expression identifier from the database based on the target expression identifier in the expression parameter, so as to control the vehicle-mounted eidolon to display the expression according to the target expression data.
In one embodiment of the present application, if the expression parameter is parsed from the target instruction, the target expression identifier is extracted from the expression parameter, and the target expression data corresponding to the target expression identifier is matched from the database. The method comprises the steps that a path for storing target expression data can be obtained from a database according to an expression name and a target expression number in a target expression mark, the target expression data are read from the database according to the path, and the vehicle-mounted eidolon is rendered based on the target expression data, so that the vehicle-mounted eidolon can display the expression.
Step S234, if the target instruction includes a voice parameter, matching target voice data corresponding to the target voice identifier from the database based on the target voice identifier in the voice parameter, so as to control the vehicle-mounted fairy to play voice according to the target voice data.
In one embodiment of the present application, if the target instruction is parsed into a voice parameter, a target voice identifier is extracted from the voice parameter, and target voice data corresponding to the target voice identifier is matched from a database. The method comprises the steps of obtaining a path for storing target voice data from a database according to a voice name and a target voice number in a target voice identifier, reading the target voice data from the database according to the path, and rendering the vehicle-mounted eidolon based on the target voice data so as to enable the vehicle-mounted eidolon to display the expression.
In step S235, if the target instruction includes a location parameter, the location of the vehicle-mounted puck is adjusted based on the target location information in the location parameter.
In one embodiment of the present application, if a location parameter exists in the target instruction, since the location parameter stores the target location information, the location of the vehicle-mounted puck may be directly adjusted according to the target location information. For example, let the vehicle-mounted fairy be left or right in the position of the display interface. For example, if the monitored type of the eidolon triggering event is voice interaction, that is, the user wakes up the vehicle-mounted eidolon through a voice command, whether the voice command is from the main driver position/rear left position or from the auxiliary driver position/rear right position can be determined based on sound source positioning, and if the voice command is determined to be from the main driver position/rear left position, the generated target command includes target position information, where the target position information can be left-side position information, specifically preset by a person skilled in the art, and the position of the vehicle-mounted eidolon on the display interface is adjusted to the left based on the target position information.
In one embodiment of the present application, after receiving the target instruction, the vehicle-mounted puck control method includes:
and if the target instruction comprises the skin parameter, matching target skin data corresponding to the target skin identifier from the database based on the target skin identifier in the skin parameter so as to control the vehicle-mounted eidolon to change the skin according to the target skin data.
In this embodiment, if the skin parameter is parsed from the target instruction, the target skin identifier is extracted from the skin parameter, and the target skin data corresponding to the target skin identifier is matched from the database. For example, a path storing target skin data can be obtained from a database according to the skin name and the target skin number in the target skin identifier, the target skin data is read from the database according to the path, and the vehicle-mounted eidolon is rendered based on the target skin data, so that the vehicle-mounted eidolon is subjected to skin replacement display.
In one embodiment of the present application, after matching target skin data corresponding to a target skin identification based on the target skin identification in the skin parameters, the in-vehicle sprite control method includes the steps of:
in step S236, if the target skin type in the skin parameters is a try-on, the vehicle-mounted eidolon is controlled to perform a skin try-on according to the target skin data.
In an embodiment of the present application, a skin-changing type may be preset, including fitting, using, and exiting fitting, when generating the target instruction, if the skin-changing information is included in the eidolon triggering event, determining the target skin identifier according to the skin-changing information, and determining the target skin-changing type, so as to control the vehicle-mounted eidolon to execute the corresponding skin-changing mode according to the target skin-changing type. And if the target skin change type in the skin parameters is try-on, rendering the vehicle-mounted eidolon based on the target skin data so as to enable the vehicle-mounted eidolon to try on the corresponding skin.
In step S237, if the target skin type in the skin parameters is used, the vehicle-mounted sprite is controlled to perform skin use according to the target skin data.
In one embodiment of the application, if the target skin type is used, the vehicle-mounted eidolon is rendered based on the target skin data so that the vehicle-mounted eidolon uses the corresponding skin.
When trying on the skin, the user gives out a next operation according to the skin displayed by the vehicle-mounted eidolon to generate a new eidolon trigger event, and the vehicle-mounted intelligent assistant generates and sends a new target instruction according to the new eidolon trigger event and a preset data structure so that the vehicle-mounted eidolon receives the new target instruction. In the new target instruction, if the target skin change type in the skin parameters is the exit try-on, controlling the vehicle-mounted genie to exit the skin try-on state or page, and at the moment, reading the target skin data again; if the target skin change type in the skin parameters is used, controlling the vehicle-mounted genie to use the skin which is currently tried on, and reading the target skin data again is not needed.
According to the technical scheme, the action, the expression, the voice and the visual display of the skin of the vehicle-mounted eidolon are controlled through the target instruction, and the position of the vehicle-mounted eidolon is adjusted, so that the real-time performance of the vehicle-mounted eidolon control is improved, and the flexibility of the vehicle-mounted eidolon is also improved.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating a specific vehicle-mounted puck control system architecture according to an exemplary embodiment of the present application.
Referring to fig. 3, the system architecture includes a vehicle cloud (server), an AI intelligent assistant (AI assistant, vehicle-mounted intelligent assistant), a system database (database), and a 3D sprite (vehicle-mounted sprite). The AI assistant comprises a eidolon center, a message module, a data initialization module and an image data sharing module. The control flow of the vehicle-mounted eidolon is as follows:
and initializing data. The AI intelligent assistant can initialize the data of the 3D eidolon after starting up, acquire the latest image data (preset image data) of the vehicle-mounted eidolon from the vehicle cloud, and then store the image data into a system database through a data sharing module so as to update the image data of the vehicle-mounted eidolon in the database and serve as the basic data for rendering the 3D eidolon.
And (5) registering. Since only registered applications can communicate, for use in subsequent messaging. The 3D puck registration information (send registration request) is sent to the AI intelligent assistant in order to ensure that the AI intelligent assistant's data can be delivered to the registered 3D puck.
And establishing a message channel. The message channel provides data transmission services for cross-application linkage. After the AI intelligent assistant and the 3D intelligent assistant are started, the 3D intelligent assistant and the AI intelligent assistant establish a message channel through the message module, and can transmit a message or an instruction according to the message channel to serve as a bridge for the linkage of the 3D intelligent assistant across applications.
A message structure is defined (a preset data structure is defined). The message structure is defined so that both parties can parse data more quickly and more conveniently after receiving the message to execute the corresponding instruction. In an actual linkage flow, each operation defines a set of corresponding data structures, and the same type of data structures can be shared to achieve effects by changing the specific content of data, for example, the data structures of skin parameters can be: config: "configID", type 0/1/2, wherein config is skin name, configID indicates the location of the target skin number, specific preset skin number is preset by those skilled in the art, type 0 indicates that the target skin type is to exit from fitting, type 1 indicates that the target skin type is to be used. When generating the target instruction comprising the skin parameter, the configID in the data structure of the skin parameter is replaced by a specific target skin number, and the target skin type is determined. The above data structure of the skin-changing parameters is only a reference example, and a person skilled in the art may define other formats of data structures for the skin-changing parameters. If the voice needs to be broadcasted when the skin is changed, a parameter 'ttsText' of a voice text can be added, and when the 3D eidolon analyzes that the voice parameter exists, voice broadcasting is executed.
The AI intelligent assistant sends a message. After all the above processes have been completed, the AI intelligent assistant can send a message or a target instruction to the corresponding 3D sprite according to the defined message structure. Fig. 4 is a schematic diagram of a skin interface in an exemplary application scenario. In the skin interface shown in fig. 4, clicking on "try-on" or "use" sends a message (target instruction) to the 3D sprite side, which includes specific skin parameters.
The 3D eidolon receives the message. After the AI intelligent assistant sends the message through the message module, the system 3D eidolon receives the message and analyzes the message according to the defined message structure. For example, when a message "try-on" or "use" is received, the 3D eidolon parses the message and issues it to the execution module.
3D eidolon execution. And when the 3D eidolon receives the target instruction, the instruction can be completed according to the image parameters in the target instruction. For example, in fig. 4, when the clothing (skin) of the 3D eidolon is to be switched, the 3D eidolon on the left can be clicked for fitting (skin changing) and looking at operation immediately, and if the effect is satisfactory, the 3D eidolon is clicked for use, and is applied to all the following scenes, if the effect is not satisfactory, the user exits from the fitting page, and the original skin of the 3D eidolon is restored.
Fig. 5 is a block diagram of an in-vehicle puck control device shown in an exemplary embodiment of the present application. The apparatus may be applied to the implementation environment shown in fig. 1 and is specifically configured in the in-vehicle intelligent assistant 102. The apparatus may also be adapted to other exemplary implementation environments and may be specifically configured in other devices or applications, and the present embodiment is not limited to the implementation environments to which the apparatus is adapted.
As shown in fig. 5, the exemplary vehicle-mounted puck control device includes:
the channel establishing module 510 is configured to receive a registration request of the vehicle-mounted smart agent, where the registration request includes a vehicle-mounted smart agent identifier, and establish a message channel between the vehicle-mounted smart assistant and the vehicle-mounted smart agent according to the vehicle-mounted smart agent identifier; the instruction generating module 520 is configured to generate a target instruction based on a preset data structure and the eidolon trigger event if the eidolon trigger event is monitored; the instruction sending module 530 is configured to send a target instruction through the message channel, so as to control the vehicle-mounted puck according to the target instruction.
It should be noted that, the vehicle-mounted puck control device provided in the foregoing embodiment and the vehicle-mounted puck control method provided in the foregoing embodiment belong to the same concept, and a specific manner in which each module and unit perform an operation has been described in detail in the method embodiment, which is not described herein again. In practical application, the vehicle-mounted genie control device provided in the above embodiment can distribute the functions by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above, which is not limited herein.
The embodiment of the application also provides electronic equipment, which comprises: one or more processors; and a storage device for storing one or more programs, which when executed by the one or more processors, cause the electronic device to implement the vehicle-mounted puck control method provided in the above embodiments.
Fig. 6 shows a schematic diagram of a computer system suitable for use in implementing the electronic device of the embodiments of the present application. It should be noted that, the computer system 600 of the electronic device shown in fig. 6 is only an example, and should not impose any limitation on the functions and the application scope of the embodiments of the present application.
As shown in fig. 6, the computer system 600 includes a central processing unit (Central Processing Unit, CPU) 601, which can perform various appropriate actions and processes according to a program stored in a Read-Only Memory (ROM) 602 or a program loaded from a storage section 608 into a random access Memory (Random Access Memory, RAM) 603, for example, performing the method described in the above embodiment. In the RAM 603, various programs and data required for system operation are also stored. The CPU 601, ROM 602, and RAM 603 are connected to each other through a bus 604. An Input/Output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, mouse, etc.; an output portion 607 including a Cathode Ray Tube (CRT), a liquid crystal display (Liquid Crystal Display, LCD), and a speaker, etc.; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN (Local Area Network ) card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The drive 610 is also connected to the I/O interface 605 as needed. Removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is installed as needed on drive 610 so that a computer program read therefrom is installed as needed into storage section 608.
In particular, according to embodiments of the present application, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and/or installed from the removable medium 611. When executed by a Central Processing Unit (CPU) 601, performs the various functions defined in the system of the present application.
It should be noted that, the computer readable medium shown in the embodiments of the present application may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium may be, for example, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-Only Memory (ROM), an erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), flash Memory, an optical fiber, a portable compact disc read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with a computer-readable computer program embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. Where each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present application may be implemented by means of software, or may be implemented by means of hardware, and the described units may also be provided in a processor. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
Another aspect of the present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor of a computer, causes the computer to perform the vehicle-mounted puck control method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment or may exist alone without being incorporated in the electronic device.
Another aspect of the present application also provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the vehicle-mounted sprite control method provided in the above-described respective embodiments.
The above embodiments are merely illustrative of the principles of the present application and its effectiveness and are not intended to limit the present application. Modifications and variations may be made to the above-described embodiments by those of ordinary skill in the art without departing from the spirit and scope of the present application. It is therefore contemplated that the appended claims will cover all such equivalent modifications and changes as fall within the true spirit and scope of the disclosure.

Claims (10)

1. The vehicle-mounted eidolon control method is characterized by comprising the following steps of:
receiving a registration request of a vehicle-mounted intelligent assistant, wherein the registration request comprises a vehicle-mounted intelligent assistant identifier, and a message channel between the vehicle-mounted intelligent assistant and the vehicle-mounted intelligent assistant is established according to the vehicle-mounted intelligent assistant identifier;
if the eidolon triggering event is monitored, generating a target instruction based on a preset data structure and the eidolon triggering event;
and sending the target instruction through the message channel so as to control the vehicle-mounted eidolon according to the target instruction.
2. The in-vehicle sprite control method according to claim 1, wherein after the target instruction is transmitted through the message channel, the in-vehicle sprite control method comprises:
receiving the target instruction;
if the target instruction comprises an action parameter, matching target action data corresponding to the target action identifier from a database based on the target action identifier in the action parameter so as to control the vehicle-mounted eidolon to perform action display according to the target action data;
if the target instruction comprises an expression parameter, matching target expression data corresponding to a target expression identifier in a database based on the target expression identifier in the expression parameter so as to control the vehicle-mounted eidolon to display the expression according to the target expression data;
If the target instruction comprises voice parameters, matching target voice data corresponding to the target voice identifications from a database based on the target voice identifications in the voice parameters so as to control the vehicle-mounted genie to play voice according to the target voice data;
and if the target instruction comprises a position parameter, adjusting the position of the vehicle-mounted genie based on target position information in the position parameter.
3. The in-vehicle puck control method according to claim 2, wherein after receiving the target instruction, the in-vehicle puck control method includes:
and if the target instruction comprises a skin parameter, matching target skin data corresponding to the target skin identifier from a database based on the target skin identifier in the skin parameter so as to control the vehicle-mounted eidolon to change skin according to the target skin data.
4. A vehicle-mounted sprite control method as claimed in claim 3, wherein after matching target skin data corresponding to a target skin identification based on the target skin identification in the skin parameters, the vehicle-mounted sprite control method comprises:
if the target skin replacement type in the skin parameters is try-on, controlling the vehicle-mounted genie to execute skin try-on according to the target skin data;
And if the target skin change type in the skin parameters is the use, controlling the vehicle-mounted eidolon to execute the skin use according to the target skin data.
5. The in-vehicle puck control method according to any one of claims 2 to 4, characterized in that before generating a target instruction based on a preset data structure and the puck triggering event, the in-vehicle puck control method includes:
the method comprises the steps of obtaining preset image data of the vehicle-mounted genie, storing the preset image data in a database, and configuring a corresponding relation between the preset image data and preset image identifications, wherein the preset image data comprises at least one of preset action data, preset expression data, preset voice data and preset skin data, and the preset image identifications comprise at least one of preset action identifications, preset expression identifications, preset voice identifications and preset skin identifications.
6. The in-vehicle puck control method according to any one of claims 1 to 4, characterized in that before generating a target instruction based on a preset data structure and the puck triggering event, the in-vehicle puck control method further includes:
defining a preset data structure of the vehicle-mounted eidolon, wherein the preset data structure comprises at least one of an action parameter structure, an expression parameter structure, a voice parameter structure, a position parameter structure and a skin parameter structure.
7. The vehicle-mounted puck control method according to claim 1, wherein establishing a message channel between a vehicle-mounted intelligent assistant and the vehicle-mounted puck according to the vehicle-mounted puck identification includes:
establishing a first messaging module for the vehicle-mounted intelligent assistant and a second messaging module for the vehicle-mounted intelligent assistant;
binding the first messaging module with the second messaging module to obtain the message channel.
8. An in-vehicle puck control device, the in-vehicle puck control device comprising:
the system comprises a channel establishing module, a channel processing module and a channel processing module, wherein the channel establishing module is used for receiving a registration request of the vehicle-mounted eidolon, the registration request comprises a vehicle-mounted eidolon identifier, and a message channel between a vehicle-mounted intelligent assistant and the vehicle-mounted eidolon is established according to the vehicle-mounted eidolon identifier;
the instruction generation module is used for generating a target instruction based on a preset data structure and the eidolon triggering event if the eidolon triggering event is monitored;
and the instruction sending module is used for sending the target instruction through the message channel so as to control the vehicle-mounted eidolon according to the target instruction.
9. An electronic device, the electronic device comprising:
One or more processors;
storage means for storing one or more programs that, when executed by the one or more processors, cause the electronic device to implement the vehicle-mounted puck control method of any one of claims 1-7.
10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor of a computer, causes the computer to perform the vehicle-mounted puck control method according to any one of claims 1 to 7.
CN202310004685.6A 2023-01-03 2023-01-03 Vehicle-mounted genius control method and device, electronic equipment and storage medium Pending CN116048316A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310004685.6A CN116048316A (en) 2023-01-03 2023-01-03 Vehicle-mounted genius control method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310004685.6A CN116048316A (en) 2023-01-03 2023-01-03 Vehicle-mounted genius control method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116048316A true CN116048316A (en) 2023-05-02

Family

ID=86117662

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310004685.6A Pending CN116048316A (en) 2023-01-03 2023-01-03 Vehicle-mounted genius control method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116048316A (en)

Similar Documents

Publication Publication Date Title
CN110300175B (en) Message pushing method and device, storage medium and server
CN113691853B (en) Page display method and device and storage medium
CN112527528A (en) Data transmission method, device and storage medium based on message queue
CN112416599A (en) Resource scheduling method, device, equipment and computer readable storage medium
CN113723840B (en) Internet of vehicles scene calculation method, device and system
CN113094141A (en) Page display method and device, electronic equipment and storage medium
CN110781373A (en) List updating method and device, readable medium and electronic equipment
CN112702613A (en) Live video recording method and device, storage medium and electronic equipment
CN112818654A (en) Message storage method, message generation method, message storage device, electronic equipment and computer readable medium
CN116048316A (en) Vehicle-mounted genius control method and device, electronic equipment and storage medium
CN115292600A (en) Information display method, device, equipment and medium
CN117014640A (en) Data display method, device, apparatus, readable storage medium and program product
CN111641693B (en) Session data processing method and device and electronic equipment
CN111091303A (en) Skill customization method and device
CN111343172A (en) Network access authority dynamic processing method and device
CN111309960A (en) Singing bill recommendation method and device
CN116129908A (en) Voice triggering method, device, equipment and medium for car scene
CN113507620B (en) Live broadcast data processing method, device, equipment and storage medium
CN110958277B (en) Method and device for sending prompt information
CN115460245A (en) Vehicle service data pushing method, system, equipment and storage medium
CN116800775A (en) Data processing method, apparatus, device, readable storage medium, and program product
CN116400845A (en) Multi-screen interaction method and device for intelligent assistant of automobile, electronic equipment and storage medium
CN116302001A (en) Service registration management method, device, equipment and storage medium
CN116186428A (en) Vehicle remote upgrade information display method, system, equipment and storage medium
CN117376368A (en) Communication control method, device and system for online exhibition hall and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination