CN112069480A - Display method and device, storage medium and wearable device - Google Patents
Display method and device, storage medium and wearable device Download PDFInfo
- Publication number
- CN112069480A CN112069480A CN202010784653.9A CN202010784653A CN112069480A CN 112069480 A CN112069480 A CN 112069480A CN 202010784653 A CN202010784653 A CN 202010784653A CN 112069480 A CN112069480 A CN 112069480A
- Authority
- CN
- China
- Prior art keywords
- user
- information
- preset
- display
- wearable device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000004590 computer program Methods 0.000 claims description 19
- 239000004984 smart glass Substances 0.000 description 40
- 210000001508 eye Anatomy 0.000 description 20
- 239000011521 glass Substances 0.000 description 16
- 210000001747 pupil Anatomy 0.000 description 11
- 210000005252 bulbus oculi Anatomy 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 210000000744 eyelid Anatomy 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 210000003786 sclera Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Ophthalmology & Optometry (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a display method, a display device, a storage medium and wearable equipment. The display method can be applied to wearable equipment, and the method comprises the following steps: acquiring identity information of a user; identifying whether the user is a preset user or not according to the identity information; if so, acquiring preset display parameters of the corresponding user; and displaying the virtual information according to preset display parameters on the wearable device. According to the method and the device, the wearable device can identify the user identity and display the virtual information according to the preset display parameters of the corresponding user, different users can correspond to different preset display parameters, and the flexibility of the wearable device in displaying the virtual information is improved.
Description
Technical Field
The application belongs to the technical field of electronic equipment, and particularly relates to a display method, a display device, a storage medium and wearable equipment.
Background
With the development of technology, smart wearable devices are beginning to emerge and mature gradually. One type of smart wearable device that is common today includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, and the like. These intelligent wearable devices can realize powerful functions, such as displaying virtual information in a superimposed manner on a real image. However, in the related art, the wearable device has poor flexibility in displaying virtual information.
Disclosure of Invention
The embodiment of the application provides an equipment control method and device, a storage medium and wearable equipment, which can improve the flexibility of the wearable equipment in displaying virtual information.
In a first aspect, an embodiment of the present application provides a display method, which is applied to a wearable device, and the method includes:
acquiring identity information of a user;
identifying whether the user is a preset user or not according to the identity information;
if so, acquiring preset display parameters corresponding to the user;
and displaying virtual information on the wearable equipment according to the preset display parameters.
In a second aspect, an embodiment of the present application provides a display device, which is applied to a wearable device, and includes:
the identification module is used for acquiring the identity information of the user;
the judging module is used for identifying whether the user is a preset user according to the identity information;
the acquisition module is used for acquiring preset display parameters corresponding to the user if the preset display parameters correspond to the user;
and the display module is used for displaying the virtual information on the wearable equipment according to the preset display parameters.
In a third aspect, an embodiment of the present application provides a storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is caused to execute the method provided by the embodiment of the present application.
In a fourth aspect, an embodiment of the present application further provides a wearable device, which includes a memory and a processor, where the processor is configured to execute the method provided in the embodiment of the present application by calling a computer program stored in the memory.
In the embodiment of the application, the wearable device can acquire the identity information of the user; identifying whether the user is a preset user or not according to the identity information; if so, acquiring preset display parameters corresponding to the user; and displaying virtual information on the wearable equipment according to the preset display parameters. Wearable equipment can be with the virtual information stack show in real image, and wearable equipment can discern user's identity in this application embodiment to show virtual information according to corresponding user's the display parameter of predetermineeing, different users can correspond different display parameter of predetermineeing, can satisfy different users ' use habit, and convenience of customers looks over virtual information, thereby improves the flexibility of wearable equipment when showing virtual information.
Drawings
The technical solutions and advantages of the present application will become apparent from the following detailed description of specific embodiments of the present application when taken in conjunction with the accompanying drawings.
Fig. 1 is a schematic flowchart of an apparatus control method provided in an embodiment of the present application.
Fig. 2 is another schematic flow chart of the device control method according to the embodiment of the present application.
Fig. 3 to fig. 8 are schematic scene diagrams of a device control method according to an embodiment of the present application.
Fig. 9 is a schematic structural diagram of an apparatus control device according to an embodiment of the present application.
Fig. 10 is a schematic structural diagram of a wearable device provided in an embodiment of the present application.
Fig. 11 is another schematic structural diagram of a wearable device provided in an embodiment of the present application.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.
It is understood that the execution subject of the embodiment of the present application may be a wearable device such as a smartphone or smart glasses.
Referring to fig. 1, fig. 1 is a schematic flow chart of a display method according to an embodiment of the present disclosure. The device control method may be applied to a wearable device. The flow of the device control method provided by the embodiment of the application may include:
101. and acquiring the identity information of the user.
With the development of technology, smart wearable devices are beginning to emerge and mature gradually. One type of smart wearable device that is common today includes head-mounted smart devices, such as smart glasses, smart helmets, smart headbands, and the like. These intelligent wearable devices can realize powerful functions, such as displaying virtual information in a superimposed manner on a real image. However, in the related art, the wearable device has poor flexibility in displaying virtual information. For example, in the related art, the wearable device is a uniform display manner for each user when displaying virtual information.
In this application embodiment, wearable device can gather and store different user's identity information. When a different user is using the wearable device, the wearable device may be the current user's identity information,
the identity information of the user can be acquired by acquiring at least one of fingerprint information, iris information, voiceprint information, face information and account password information of the user.
In one embodiment, the wearable device may include a fingerprint recognition module, and fingerprint information of the user may be acquired through the fingerprint recognition module. For example, wearable equipment can be intelligent glasses, and then intelligent glasses side frame can set up fingerprint identification module, can acquire and store user's fingerprint information through fingerprint identification module.
In one embodiment, the wearable device may include an iris recognition module including an iris camera through which an iris image of the user may be acquired. For example, the wearable device may be smart glasses, and an iris recognition module may be disposed inside an eyeglass frame of the smart glasses, and the iris image of the user is acquired and stored through the iris recognition module.
It should be noted that, acquiring the identity information of the user may also acquire multiple kinds of identity information of the user at the same time, for example, acquiring both fingerprint information and iris information.
In 102, whether the user is a preset user is identified according to the identity information.
In the embodiment of the application, the wearable device can acquire the identity information of the user, and identify whether the user is a preset user according to the identity information, for example, the acquired identity information can be matched with the stored identity information, and if the acquired identity information is matched with the stored identity information, the current user is the preset user. In the embodiment of the application, the user can preset the display mode of the virtual information according to the use habit and the preference of the user. If the user is identified as the preset user, the display mode of the virtual information preset on the wearable device by the user is indicated.
In an implementation mode, the wearable device is, for example, smart glasses, the smart glasses are provided with a fingerprint identification module, fingerprint information of a user is acquired through the fingerprint identification module, the acquired fingerprint information is matched with fingerprint information stored in advance, and if the acquired fingerprint information is matched with the fingerprint information stored in advance, the current user is a preset user.
In one embodiment, the wearable device is, for example, a smart glasses, the smart glasses are provided with an iris recognition module, the iris recognition module includes an iris camera, an iris image of the user is acquired through the iris camera, the acquired iris image is matched with a pre-stored iris image, and if the iris image is matched with the pre-stored iris image, the current user is a preset user.
In an embodiment, wearable equipment can acquire user's multiple identity information, for example when the user uses for the first time, can gather and acquire user's multiple identity information, consequently when according to whether the user is for predetermineeing the user of identity information discernment, can discern through multiple identity information, improve and discern whether for predetermineeing user's success rate.
In 103, if yes, preset display parameters corresponding to the user are obtained.
Wearable equipment such as smart glasses can realize many functions, for example can show virtual information superpose in real image, and different users have different habits and hobbies to the display parameter of virtual information when using wearable equipment, have different demands to parameters such as the display size, colour and the position of virtual information. The virtual information may be text or picture information. The user can preset display parameters suitable for the user's own virtual information according to the user habit and preference.
In one embodiment, the user may set the display parameters according to the type of virtual information. For example, when a user receives a phone call, instant messaging, mail or push information while using a wearable device such as smart glasses, the information may also be displayed superimposed on the smart glasses to prompt the user. The user can set different display parameters according to different types of information, for example, the instant messaging information or the telephone of important family or colleagues can be displayed at the central position, larger and red fonts can be displayed to facilitate the user to check in time, and for example, the push information of some merchants can be displayed at the position close to the side, and smaller and light fonts can be displayed to avoid influencing the use of the user as much as possible.
In one embodiment, the user may set different display parameters for the virtual information according to different usage scenarios. For example, when the user uses wearable equipment such as intelligent glasses to travel, the relevant data of virtual all kinds of buildings can be shown to the intelligent glasses, or the relevant data of virtual all kinds of showpiece can be shown to the intelligent glasses when watching the exhibition, the user can be according to the colour of the self-defining typeface when showing relevant data of own hobby, size. For another example, when the user uses wearable equipment such as smart glasses to maintain the equipment, various auxiliary virtual information can be displayed to the user through the smart glasses, the auxiliary virtual information comprises a virtual instrument, a maintained equipment part diagram and the like, and the user can conveniently view the user-defined display position according to own use habits.
The wearable device can pre-store preset display parameters of different users, associate the identity information of the user with the preset display parameters, and if the user is identified to be the preset user, acquire the preset display parameters of the corresponding user.
At 104, virtual information is displayed on the wearable device according to preset display parameters.
After the preset display parameters of the corresponding user are obtained, the user can display the virtual information according to the preset display parameters of the corresponding user when using the wearable device. For example, the first user is a preset user, and when the first user uses the wearable device, if the first user receives a phone call from an important family or a colleague, the first user displays the incoming call information at the central position according to preset display parameters of the first user, and the font is large; and if the push information of the merchant is received, the incoming call information is displayed at the lower right corner near position according to the preset display parameters of the first user, and the font is smaller. For another example, the second user is also a preset user, and when the second user uses the wearable device, if the second user receives a call from an important family or a colleague, the second user displays the incoming call information at the upper middle position according to the preset display parameters of the second user, and the font color is darker and prompts the user in time; and if the push information of the merchant is received, displaying the incoming call information at the position close to the lower left corner according to the preset display parameters of the second user, wherein the font color is lighter.
In the embodiment of the application, different users can preset different display parameters of the virtual information according to own use habits and preferences. The wearable device can identify the user identity and display the virtual information according to the preset display parameters of the corresponding user, and different users can correspond to different preset display parameters. Therefore, the wearable device in the embodiment of the application can provide an individualized display mode for the user, the displayed virtual information can meet the use habits of different users, and the use preferences of different users are met, so that the flexibility of the wearable device in displaying the virtual information is improved, and the use experience of the user is also improved.
Referring to fig. 2, fig. 2 is another schematic flow chart of an apparatus control method according to an embodiment of the present disclosure. The flow of the device control method provided by the embodiment of the application may include:
in 201, identity information of a user is obtained.
In this application embodiment, wearable device can gather and store different user's identity information. When a different user is using the wearable device, the wearable device may be the current user's identity information,
the identity information of the user can be acquired by acquiring at least one of fingerprint information, iris information, voiceprint information, face information and account password information of the user.
In one embodiment, the wearable device may include an iris recognition module including an iris camera through which an iris image of the user may be acquired. For example, the wearable device may be smart glasses, and an iris recognition module may be disposed inside an eyeglass frame of the smart glasses, and the iris image of the user is acquired and stored through the iris recognition module.
It should be noted that, in the embodiment of the present application, how to obtain the identity information of the user is not limited. And the identity information of the user can be acquired, and various identity information of the user can be acquired at the same time, such as acquiring fingerprint information and iris information.
At 202, whether the user is a preset user is identified according to the identity information.
In the embodiment of the application, the wearable device can acquire the identity information of the user, and identify whether the user is a preset user according to the identity information, for example, the acquired identity information can be matched with the stored identity information, and if the acquired identity information is matched with the stored identity information, the current user is the preset user. In the embodiment of the application, the user can preset the display parameters of the virtual information according to the use habit and the preference of the user. If the user is identified as the preset user, the display parameters of the virtual information preset on the wearable device by the user are indicated.
In one embodiment, the wearable device is, for example, smart glasses, and the smart glasses are provided with an iris recognition module for recognizing whether the current user is a preset user through an iris recognition technology. The iris image recognition technology can comprise the following four steps: firstly, obtaining an iris image: the whole eyes of the person are shot through the camera, and the shot eye images are subjected to image preprocessing. Secondly, image preprocessing: the obtained iris image is processed as follows, so that the requirement of extracting iris features is met, and the iris is positioned: determining the positions of an inner circle, an outer circle and a quadratic curve in the image, wherein the inner circle is the boundary between the iris and the pupil, the outer circle is the boundary between the iris and the sclera, and the quadratic curve is the boundary between the iris and the upper eyelid and the lower eyelid; normalization of the iris image: adjusting the size of the iris in the image to a fixed size set by a recognition system; image enhancement: and processing the normalized image by brightness, contrast, smoothness and the like, so as to improve the recognition rate of the iris information in the image. Thirdly, extracting the characteristics, namely extracting the characteristic point information of the iris image from the iris image by adopting a specific algorithm and coding the characteristic point information. Fourthly, feature matching: and matching the feature codes obtained by feature extraction with the iris image feature codes in the database one by one, and judging whether the same iris image exists or not, thereby achieving the purpose of user identity recognition. If the iris images are matched, the user is a preset user, and if the iris images are not matched, the user is not the preset user.
In one embodiment, the wearable device may include an eyeball identification module, and when the user uses the wearable device and does not display an image, the eyeball identification module may acquire a gaze direction of the user, and it may be understood that when the eyes of the person look in different directions, the eyes may slightly change, for example, the position and the direction of the center of the pupil may change, and the wearable device may extract the changes through image capturing or scanning, so as to acquire the gaze direction of the user, that is, the gaze position of the user's eye according to the changes of the position and the direction of the center of the pupil.
In one embodiment, an identification module is disposed in an inner frame of a wearable device, such as smart glasses, and the eyeball identification module is designed with a miniature directional light source (e.g., an infrared LED) and a sensor (e.g., an infrared camera). Under the reflection of infrared light, the infrared camera obtains human eye images. First, a human eye region is determined based on a human eye image. Secondly, pupil area extraction is carried out, specifically, gray information of the image is analyzed, the color of the pupil position is darker, black pixels are concentrated in one area, the brightness of the edge part of the pupil is higher than that of the pupil, and a bright point is arranged in the center of the pupil. And fitting the pupil edge, fitting the shape of the pupil by adopting an elliptic equation, and determining the center of the eyeball, wherein when the human eyes look at different directions, the positions and the directions of the centers of the pupils are different. And finally, judging the sight line direction of the eyes based on the position of the center of the eyeball.
The eyeball identification module may acquire a plurality of sight directions of the user within a preset time period, such as a day, a week, or a month, and the specific time may be set as required, which is not limited in the embodiment of the present application. The method comprises the steps that the sight line direction with the longest accumulated stay time is determined from a plurality of sight line directions and is used as a target sight line direction; it can be understood that, if a sight line direction with the longest accumulated stay time is determined from the plurality of sight line directions, it indicates that the user is used to or prefers to view information in the sight line direction, and therefore the sight line direction is taken as the target sight line direction. Determining a target display position of the virtual information on the wearable device according to the target sight direction; and setting the virtual information displayed at the target display position as the preset display parameters of the corresponding user. Therefore, according to the embodiment of the application, the user does not need to set the preset display parameters of the virtual information, the wearable device can automatically acquire the eye use habit of the user, the virtual information is displayed according to the eye use habit of the user, and the user experience is improved.
In 203, if the user is a preset user, preset display parameters of the corresponding user are obtained.
Wearable equipment such as smart glasses can realize many functions, for example can show virtual information superpose in real image, and different users have different habits and hobbies to the display parameter of virtual information when using wearable equipment, have different demands to parameters such as the display size, colour and the position of virtual information. The virtual information may be text or picture information. The user can preset display parameters suitable for the user's own virtual information according to the user habit and preference.
In one embodiment, the user may set the display parameters according to the type of virtual information. For example, when a user receives a phone call, instant messaging, mail or push information while using a wearable device such as smart glasses, the information may also be displayed superimposed on the smart glasses to prompt the user. The user can set different display parameters according to different types of information, for example, the instant messaging information or the telephone of important family or colleagues can be displayed at the central position, larger and red fonts can be displayed to facilitate the user to check in time, and for example, the push information of some merchants can be displayed at the position close to the side, and smaller and light fonts can be displayed to avoid influencing the use of the user as much as possible.
In one embodiment, the user may set different display modes for the virtual information according to different usage scenarios. For example, when the user uses wearable equipment such as intelligent glasses to travel, the relevant data of virtual all kinds of buildings can be shown to the intelligent glasses, or the relevant data of virtual all kinds of showpiece can be shown to the intelligent glasses when watching the exhibition, the user can be according to the colour of the self-defining typeface when showing relevant data of own hobby, size. For another example, when the user uses wearable equipment such as smart glasses to maintain the equipment, various auxiliary virtual information can be displayed to the user through the smart glasses, the auxiliary virtual information comprises a virtual instrument, a maintained equipment part diagram and the like, and the user can conveniently view the user-defined display position according to own use habits.
The wearable device can pre-store preset display parameters of different users, associate the identity information of the user with the preset display parameters, and if the user is identified to be the preset user, acquire the preset display parameters of the corresponding user.
At 204, virtual information is displayed on the wearable device according to preset display parameters.
After the preset display parameters of the corresponding user are obtained, the user can display the virtual information according to the preset display parameters of the corresponding user when using the wearable device. For example, the first user is a preset user, and when the first user uses the wearable device, if the first user receives a phone call from an important family or a colleague, the first user displays the incoming call information at the central position according to preset display parameters of the first user, and the font is large; and if the push information of the merchant is received, the incoming call information is displayed at the lower right corner near position according to the preset display parameters of the first user, and the font is smaller. For another example, the second user is also a preset user, and when the second user uses the wearable device, if the second user receives a call from an important family or a colleague, the second user displays the incoming call information at the upper middle position according to the preset display parameters of the second user, and the font color is darker and prompts the user in time; and if the push information of the merchant is received, displaying the incoming call information at the position close to the lower left corner according to the preset display parameters of the second user, wherein the font color is lighter.
In 205, if the user is not a preset user, the user is prompted whether to set display parameters.
If the user is not the preset user, it is indicated that the preset display parameters corresponding to the user are not stored in the wearable device. For example, when the user uses the wearable device for the first time, or when the user uses the wearable device before, the user is prompted whether to set the display parameters, and the user can set the display parameters according to the use habit and preference of the user, for example, the display parameters of the virtual information are set, so that the display mode of the virtual information conforms to the use habit and preference of the user, but the display mode of the virtual information is not the same for each user.
In one embodiment, if the user is not a preset user and the user does not set display parameters, the wearable device may acquire a current gaze direction of the user when displaying the virtual information, and determine a display position of the virtual information on the wearable device according to the gaze direction; virtual information is displayed at the display position. It can be understood that by acquiring the current sight direction of the user, the virtual information is automatically displayed in the sight direction of the user, so that the user can directly and quickly see the virtual information without easily missing important virtual information.
In an embodiment, the importance of the virtual information to be displayed may be obtained, if the importance is greater than a preset importance threshold, the virtual information to be displayed is displayed in the current sight line direction or at an intermediate position on the wearable device, and if the importance is less than the preset importance threshold, the information to be displayed is displayed in an area outside the current sight line direction or at an edge position on the wearable device.
It should be noted that, if the user is not a preset user and the user does not set display parameters, the wearable device may also display the virtual information according to default display parameters when displaying the virtual information.
At 206, if an instruction for the user to select the setting of the display parameters is received, a setting interface is displayed.
If the user confirms that the display parameters are to be set, a setting interface is displayed on the wearable device, the user can set the display parameters of the virtual information according to the use habit and the preference of the user on the display setting interface, the user can set the display mode according to the type, the use scene or the importance of the virtual information, the virtual information comprises information such as characters or pictures, the display parameters of the virtual information comprise and are not limited to display position, size, font, color and the like, and can be background color or various effects such as various light emitting or shadows.
In 207, the setting information input in the setting interface is obtained, and preset display parameters corresponding to the user are formed according to the setting information.
And the user confirms that the display parameters are required to be set, and the user sets the display parameters for the virtual information on the setting interface, so that the wearable device acquires the setting information input by the user on the setting interface and forms preset display parameters corresponding to the user according to the setting information. For example, when the first user sets that a family has an incoming call, the incoming call information is displayed at the central position, and a large red font is displayed, when some pushed information of merchants is received, the pushed information is displayed at the side position, and a small black font is displayed, so that the setting information input by the first user forms preset display parameters corresponding to the first user. For example, when the second user sets that when the important family calls, the calling information is displayed at the upper position of the display area, and a larger and green font is displayed, when the pushing information of some merchants is received, the pushing information is displayed at the lower position, and a smaller and gray font is displayed, so that the setting information input by the second user forms preset display parameters corresponding to the second user.
After the display parameters are set, the wearable device can associate and store the identity information of the user and the preset display parameters. Therefore, when the first user or the second user uses the wearable device, the wearable device can identify the user identity and display the virtual information according to the preset display parameters of the corresponding user.
The wearable device can identify the user identity, and when the user is a preset user, the virtual information is displayed according to the preset display parameters of the corresponding user; when the user is not a preset user, that is, the user does not have corresponding preset display parameters, the user can be prompted to set the display parameters according to own use habits and preferences, the eye use habits of the user can also be automatically acquired, and the virtual information is displayed according to the eye use habits of the user. Different users can correspond to different preset display parameters in the embodiment of the application, so that a personalized display mode can be provided for the users on the wearable device, displayed virtual information can meet the use habits of different users, and the use preferences of different users are met, so that the flexibility of the wearable device in displaying the virtual information is improved, and the use experience of the users is also improved.
Referring to fig. 3 to 7, fig. 3 to 7 are schematic views of scenes of a display method according to an embodiment of the present application.
In the embodiment of the present application, the wearable device may be, for example, smart glasses. The intelligent glasses can collect and store identity information of different users. When different users use the smart glasses, the smart glasses can acquire the identity information of the current user, and identify whether the user is a preset user according to the identity information, for example, the acquired identity information can be matched with the stored identity information, and if the acquired identity information is matched with the stored identity information, the current user is the preset user.
Referring to fig. 3, in an embodiment, a fingerprint identification module may be disposed on a side frame of the smart glasses, fingerprint information of the user may be collected and stored through the fingerprint identification module, when the user uses the smart glasses, the obtained fingerprint information is matched with the fingerprint information stored in advance, and if the obtained fingerprint information is matched with the fingerprint information stored in advance, the current user is a preset user. If the user is identified as the preset user, the display parameters of the virtual information preset on the wearable device by the user are indicated.
Referring to fig. 4, in an embodiment, an iris recognition module may be disposed inside a glasses frame of the smart glasses, an iris image of the user may be collected and stored through the iris recognition module, when the user uses the smart glasses, the obtained iris image is matched with a pre-stored iris image, and if the iris image is matched with the pre-stored iris image, the current user is a preset user.
In the embodiment of the application, the smart glasses can pre-store the preset display parameters of different users, and if the user is identified to be the preset user, the preset display parameters of the corresponding user are obtained.
The intelligent glasses can realize a plurality of functions, for example, the virtual information can be displayed in a real image in an overlapping mode, and different users have different use habits and preferences for the display parameters of the virtual information when using the intelligent glasses, for example, the display size, the color, the position and the like of the virtual information have different requirements. In the embodiment of the application, the user can preset the display parameters suitable for the own virtual information according to the own use habit and preference.
After the preset display parameters of the corresponding user are obtained, the user can display the virtual information according to the preset display parameters of the corresponding user when using the intelligent glasses. As shown in fig. 5, for example, the first user is a preset user, and when the first user uses the smart glasses, if the first user receives a phone call from an important family or a colleague, the first user displays the incoming call information at a central position according to preset display parameters of the first user, and the font is large; and if the push information of the merchant is received, the push information is displayed at the lower right corner near the side according to the preset display parameters of the first user, and the font is smaller. For another example, as shown in fig. 6, the second user is also a preset user, and when the second user uses the smart glasses, if the second user receives a phone call from an important family or a colleague, the second user displays the incoming call information at the upper middle position according to the preset display parameters of the second user, and the font color is darker and prompts the user; and if the push information of the merchant is received, displaying the push information at the position close to the lower left corner according to the preset display parameters of the second user, wherein the font color is lighter.
In the embodiment of the application, if the user is not the preset user, the user is prompted whether to set the display parameters. If the user is not the preset user, it indicates that the preset display parameters corresponding to the user are not stored on the smart glasses. For example, when the user uses the smart glasses for the first time, or when the user uses the smart glasses before, the user is prompted whether to set the display parameters, the display parameters of the virtual information include, but are not limited to, display position, size, font, color, and the like, and may also be background color or various effects such as light emission or shadow, and the virtual information may be information such as characters or pictures, so that the display of the virtual information conforms to the use habits and preferences of the user, but the display parameters of the virtual information are not the same for each user.
As shown in fig. 7, when the user confirms that the display parameters are to be set, and the user sets the display parameters for the virtual information on the setting interface, the smart glasses obtain the setting information input by the user on the setting interface, form preset display parameters corresponding to the user according to the setting information, and associate and store the user identity information and the preset display parameters. And then, when the user uses the intelligent glasses, the intelligent glasses can identify the user identity and display the virtual information according to the preset display parameters of the corresponding user.
As shown in fig. 8, in an embodiment, the smart glasses may include an eyeball identification module, when the user uses the wearable device, when no image is displayed, the eyeball identification module may acquire the gaze direction of the user, it may be understood that when the eyes of the user look in different directions, the eyes may slightly change, for example, the position and direction of the pupil center may change, and the wearable device may extract the changes through image capturing or scanning, so as to acquire the gaze direction of the user, that is, the gaze position of the glasses of the user, according to the changes of the position and direction of the pupil center.
The eyeball identification module may acquire a plurality of sight directions of the user within a preset time period, such as a day, a week, or a month, and the specific time may be set according to needs, and is not limited in this embodiment of the present application. Determining the sight line direction with the longest accumulated stay time from the plurality of sight line directions as a target sight line direction; it can be understood that, if a sight line direction with the longest accumulated stay time is determined from the plurality of sight line directions, it indicates that the user is used to or prefers to view information in the sight line direction, and therefore the sight line direction is taken as a target implementation direction. Determining a target display position of the virtual information on the wearable device according to the target sight direction; and setting the virtual information displayed at the target display position as the preset display parameters of the corresponding user. Therefore, the user does not need to set the preset display parameters of the virtual information, the wearable device can automatically acquire the eye using habit of the user, the virtual information is displayed according to the eye using habit of the user, and the user experience is improved.
If the user is not the preset user and the user does not set the display parameters, the wearable device can display the virtual information according to the default display parameters.
Referring to fig. 9, fig. 9 is a schematic structural diagram of a display device according to an embodiment of the present application. The display device 300 may be applied to a wearable apparatus, and the display device 300 may include: identity acquisition module 301, identity recognition module 302, acquisition module 303 and display device 304.
The identity acquisition module 301 is configured to: acquiring identity information of a user;
the identity module 302 is configured to: identifying whether the user is a preset user or not according to the identity information;
the obtaining module 303 is configured to: if so, acquiring preset display parameters of the corresponding user;
the display module 304 is configured to: and displaying the virtual information according to preset display parameters on the wearable device.
In one embodiment, the obtaining module 303 may be configured to:
at least one of a display position, a size, a font, and a color of the virtual information corresponding to the user is acquired.
In one embodiment, the display device further includes an eye recognition module 305, and the eye recognition module 305 may be configured to:
acquiring a plurality of sight directions of a user within a preset time period;
determining the sight line direction with the longest accumulated stay time from the plurality of sight line directions as a target sight line direction;
determining a target display position of the virtual information on the wearable device according to the target sight direction;
and setting the target display position as a preset display parameter of the corresponding user.
In one embodiment, the obtaining module 303 may be configured to:
if not, acquiring the current sight direction of the user;
determining the display position of the virtual information on the wearable device according to the sight direction;
displaying the virtual information at the display position.
In one embodiment, the obtaining module 303 may be configured to:
if the user is not the preset user, prompting the user whether to set display parameters;
if an instruction that a user selects to set display parameters is received, a setting interface is displayed;
and acquiring the setting information input on the setting interface, and forming preset display parameters corresponding to the user according to the setting information.
In one embodiment, the identity acquisition module 301 may be configured to:
at least one of fingerprint information, iris information, voice print information, face information and account password information of the user is acquired.
The application embodiment provides a computer-readable storage medium on which a computer program is stored, which, when executed on a computer, causes the computer to execute the flow in the device control method provided in this embodiment.
The embodiment of the present application further provides a wearable device, which includes a memory and a processor, where the processor is configured to execute the flow in the device control method provided in this embodiment by calling a computer program stored in the memory.
For example, the wearable device may be a mobile terminal such as smart glasses or a smart phone. Referring to fig. 10, fig. 10 is a schematic structural diagram of a wearable device according to an embodiment of the present application.
The processor 401 is a control center of the wearable device 400, connects various parts of the entire wearable device by various interfaces and lines, and performs various functions of the wearable device and processes data by running or calling a computer program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the wearable device.
The display screen 403 may be used to display information entered by or provided to the user as well as various graphical user interfaces of the wearable device, which may be comprised of images, text, icons, video, and any combination thereof.
In this embodiment, the processor 401 in the wearable device 400 loads instructions corresponding to one or more processes of the computer program into the memory 402, and the processor 401 executes the computer program stored in the memory 402 according to the following steps, so as to implement various functions:
acquiring identity information of a user;
identifying whether the user is a preset user or not according to the identity information;
if so, acquiring preset display parameters of the corresponding user;
and displaying the virtual information according to preset display parameters on the wearable device.
In some embodiments, please refer to fig. 11, where fig. 11 is a second structural diagram of a wearable device provided in the embodiments of the present application. The wearable device 400 further includes: radio frequency circuit 404, control circuit 405, input unit 406, audio circuit 407, sensor 408, and power supply 409. The processor 401 is electrically connected to the display 403, the rf circuit 404, the control circuit 405, the input unit 406, the audio circuit 407, the sensor 408, and the power source 409.
The radio frequency circuit 404 is configured to transceive radio frequency signals to communicate with a network device or other wearable device via wireless communication.
The control circuit 405 is electrically connected to the display 403, and is configured to control the display 403 to display information.
The input unit 406 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. The input unit 406 may include a fingerprint recognition module.
The sensor 408 is used to collect external environmental information. The sensors 408 may include one or more of ambient light sensors, acceleration sensors, gyroscopes, etc.
The power source 409 is used to power the various components of the wearable device 400. In some embodiments, the power source 409 may be logically connected to the processor 401 through a power management system, so that functions of managing charging, discharging, and power consumption are implemented through the power management system.
Although not shown in the figure, the wearable device 400 may further include a camera, a bluetooth module, a fingerprint recognition module, an iris recognition module, a face recognition module, a voiceprint recognition module, an eyeball recognition module, and the like, which are not described herein again.
In this embodiment, the processor 401 in the wearable device 400 loads instructions corresponding to one or more processes of the computer program into the memory 402, and the processor 401 executes the computer program stored in the memory 402 according to the following steps, so as to implement various functions:
in one embodiment, in acquiring the preset display parameter of the corresponding user, the processor 401 performs acquiring at least one of a display position, a size, a font, and a color of the virtual information of the corresponding user.
In one embodiment, before acquiring the identity information of the user, the processor 401 further performs acquiring a plurality of gaze directions of the user within a preset time period;
determining the sight line direction with the longest accumulated stay time from the plurality of sight line directions as a target sight line direction;
determining a target display position of the virtual information on the wearable device according to the target sight direction;
and setting the target display position as a preset display parameter of the corresponding user.
In one embodiment, after identifying whether the user is a preset user according to the identity information, the processor 401 further performs, if the user is not the preset user, acquiring a current sight direction of the user;
determining the display position of the virtual information on the wearable device according to the sight direction;
displaying the virtual information at the display position.
In one embodiment, after identifying whether the user is a preset user according to the identity information, the processor 401 further prompts the user whether to set a display parameter if the user is not a preset user;
if an instruction that a user selects to set display parameters is received, a setting interface is displayed;
and acquiring the setting information input on the setting interface, and forming preset display parameters corresponding to the user according to the setting information.
In one embodiment, in acquiring the identity information of the user, the processor 401 performs acquiring at least one of fingerprint information, iris information, voiceprint information, face information, and account password information of the user.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the device control method, and are not described herein again.
The device control apparatus provided in the embodiment of the present application and the device control method in the above embodiments belong to the same concept, and any method provided in the device control method embodiment may be run on the device control apparatus, and a specific implementation process thereof is described in detail in the device control method embodiment, and is not described herein again.
It should be noted that, for the apparatus control method of the embodiment of the present application, it can be understood by those skilled in the art that all or part of the process for implementing the apparatus control method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program, the computer program can be stored in a computer readable storage medium, such as a memory, and executed by at least one processor, and during the execution process, the process of the embodiment of the apparatus control method can be included. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the device control apparatus according to the embodiment of the present application, each functional module may be integrated into one processing chip, each module may exist alone physically, or two or more modules may be integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.
The foregoing describes in detail a device control method, an apparatus, a storage medium, and a wearable device provided in the embodiments of the present application, and a specific example is applied in the present application to explain the principles and embodiments of the present application, and the description of the foregoing embodiments is only used to help understand the method and core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. A display method is applied to a wearable device, and is characterized by comprising the following steps:
acquiring identity information of a user;
identifying whether the user is a preset user or not according to the identity information;
if so, acquiring preset display parameters corresponding to the user;
and displaying virtual information on the wearable equipment according to the preset display parameters.
2. The display method according to claim 1, wherein the obtaining of the preset display parameters corresponding to the user comprises:
and acquiring at least one of a display position, a size, a font and a color of the virtual information corresponding to the user.
3. The display method according to claim 1, wherein before obtaining the identity information of the user, the method further comprises:
acquiring a plurality of sight directions of a user within a preset time period;
determining a sight line direction with the longest accumulated stay time from the plurality of sight line directions as a target sight line direction;
determining a target display position of virtual information on the wearable device according to the target sight line direction;
and setting the target display position as a preset display parameter corresponding to the user.
4. The display method according to claim 1, wherein after identifying whether the user is a preset user according to the identity information, the method further comprises:
if the user is not the preset user, acquiring the current sight direction of the user;
determining a display position of virtual information on the wearable device according to the sight line direction;
and displaying the virtual information at the display position.
5. The display method according to claim 1, wherein after identifying whether the user is a preset user according to the identity information, the method further comprises:
if the user is not the preset user, prompting the user whether to set display parameters;
if an instruction that a user selects to set display parameters is received, a setting interface is displayed;
and acquiring the setting information input on the setting interface, and forming preset display parameters corresponding to the user according to the setting information.
6. The display method according to claim 1, wherein the obtaining identity information of the user comprises:
at least one of fingerprint information, iris information, voice print information, face information and account password information of the user is acquired.
7. A display device applied to wearable equipment is characterized by comprising:
the identity acquisition module is used for acquiring identity information of a user;
the identity identification module is used for identifying whether the user is a preset user according to the identity information;
the acquisition module is used for acquiring preset display parameters corresponding to the user if the preset display parameters correspond to the user;
and the display module is used for displaying the virtual information on the wearable equipment according to the preset display parameters.
8. The display device according to claim 7, further comprising an eye recognition module configured to:
acquiring a plurality of sight directions of a user within a preset time period;
determining a sight line direction with the longest accumulated stay time from the plurality of sight line directions as a target sight line direction;
determining a target display position of virtual information on the wearable device according to the target sight line direction;
and setting the target display position as a preset display parameter corresponding to the user.
9. A storage medium having stored thereon a computer program, characterized in that the computer program, when executed on a computer, causes the computer to execute the method according to any of claims 1 to 6.
10. A wearable device comprising a memory, a processor, wherein the processor is configured to perform the method of any of claims 1-6 by invoking a computer program stored in the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010784653.9A CN112069480A (en) | 2020-08-06 | 2020-08-06 | Display method and device, storage medium and wearable device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010784653.9A CN112069480A (en) | 2020-08-06 | 2020-08-06 | Display method and device, storage medium and wearable device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112069480A true CN112069480A (en) | 2020-12-11 |
Family
ID=73660762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010784653.9A Pending CN112069480A (en) | 2020-08-06 | 2020-08-06 | Display method and device, storage medium and wearable device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112069480A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488079A (en) * | 2020-12-23 | 2021-03-12 | 廉志伟 | Intelligent wearable device with fingerprint identification function |
| CN113359297A (en) * | 2021-06-17 | 2021-09-07 | 江苏和辰软件技术有限公司 | AR intelligent glasses of intelligent vision training |
| CN114596866A (en) * | 2021-12-20 | 2022-06-07 | 深圳创通联达智能技术有限公司 | VR (virtual reality) glasses adjusting method and device, VR glasses and medium |
| CN116033431A (en) * | 2022-08-18 | 2023-04-28 | 荣耀终端有限公司 | Connection method and device of wearable device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015109937A1 (en) * | 2014-01-24 | 2015-07-30 | 北京奇虎科技有限公司 | Head-mounted intelligent device and identity authentication method |
| CN204904276U (en) * | 2015-09-08 | 2015-12-23 | 京东方科技集团股份有限公司 | Wearable equipment and identity identification system |
| CN105631275A (en) * | 2015-04-15 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Information display method, information display device and terminal |
| US20160363763A1 (en) * | 2015-06-15 | 2016-12-15 | Electronics And Telecommunications Research Institute | Human factor-based wearable display apparatus |
| CN107239725A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of information displaying method, apparatus and system |
| WO2018120554A1 (en) * | 2016-12-26 | 2018-07-05 | 华为技术有限公司 | Image display method and head-mounted display device |
| CN109298780A (en) * | 2018-08-24 | 2019-02-01 | 百度在线网络技术（北京）有限公司 | Information processing method, device, AR equipment and storage medium based on AR |
| CN109451295A (en) * | 2017-08-29 | 2019-03-08 | 深圳市掌网科技股份有限公司 | A kind of method and system obtaining virtual information |
| WO2019153927A1 (en) * | 2018-02-11 | 2019-08-15 | 中国移动通信集团终端有限公司 | Screen display method, device having display screen, apparatus, and storage medium |
-
2020
- 2020-08-06 CN CN202010784653.9A patent/CN112069480A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015109937A1 (en) * | 2014-01-24 | 2015-07-30 | 北京奇虎科技有限公司 | Head-mounted intelligent device and identity authentication method |
| CN105631275A (en) * | 2015-04-15 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Information display method, information display device and terminal |
| US20160363763A1 (en) * | 2015-06-15 | 2016-12-15 | Electronics And Telecommunications Research Institute | Human factor-based wearable display apparatus |
| CN204904276U (en) * | 2015-09-08 | 2015-12-23 | 京东方科技集团股份有限公司 | Wearable equipment and identity identification system |
| CN107239725A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of information displaying method, apparatus and system |
| US20190026559A1 (en) * | 2016-03-29 | 2019-01-24 | Alibaba Group Holding Limited | Information display method, device, and system |
| WO2018120554A1 (en) * | 2016-12-26 | 2018-07-05 | 华为技术有限公司 | Image display method and head-mounted display device |
| CN109451295A (en) * | 2017-08-29 | 2019-03-08 | 深圳市掌网科技股份有限公司 | A kind of method and system obtaining virtual information |
| WO2019153927A1 (en) * | 2018-02-11 | 2019-08-15 | 中国移动通信集团终端有限公司 | Screen display method, device having display screen, apparatus, and storage medium |
| CN110162232A (en) * | 2018-02-11 | 2019-08-23 | 中国移动通信集团终端有限公司 | Screen display method, device, equipment and storage medium with display screen |
| CN109298780A (en) * | 2018-08-24 | 2019-02-01 | 百度在线网络技术（北京）有限公司 | Information processing method, device, AR equipment and storage medium based on AR |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112488079A (en) * | 2020-12-23 | 2021-03-12 | 廉志伟 | Intelligent wearable device with fingerprint identification function |
| CN113359297A (en) * | 2021-06-17 | 2021-09-07 | 江苏和辰软件技术有限公司 | AR intelligent glasses of intelligent vision training |
| CN114596866A (en) * | 2021-12-20 | 2022-06-07 | 深圳创通联达智能技术有限公司 | VR (virtual reality) glasses adjusting method and device, VR glasses and medium |
| CN116033431A (en) * | 2022-08-18 | 2023-04-28 | 荣耀终端有限公司 | Connection method and device of wearable device |
| CN116033431B (en) * | 2022-08-18 | 2023-10-31 | 荣耀终端有限公司 | Connection method and device of wearable device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12014663B2 (en) | Dark mode display interface processing method, electronic device, and storage medium | |
| US11443462B2 (en) | Method and apparatus for generating cartoon face image, and computer storage medium | |
| CN112069480A (en) | Display method and device, storage medium and wearable device | |
| CN109191410B (en) | Face image fusion method and device and storage medium | |
| EP3582187B1 (en) | Face image processing method and apparatus | |
| CN109993115B (en) | Image processing method and device and wearable device | |
| CN108076290B (en) | Image processing method and mobile terminal | |
| CN108712603B (en) | Image processing method and mobile terminal | |
| CN108234882B (en) | Image blurring method and mobile terminal | |
| CN109155053B (en) | Information processing apparatus, information processing method, and recording medium | |
| US20240005695A1 (en) | Fingerprint Recognition Method and Electronic Device | |
| CN110933312B (en) | Photographing control method and related product | |
| KR102287109B1 (en) | Method and device for correcting image processing area corresponding to skin | |
| CN107730448B (en) | Beautifying method and device based on image processing | |
| CN111161131A (en) | Image processing method, terminal and computer storage medium | |
| CN109544441B (en) | Image processing method and device, and skin color processing method and device in live broadcast | |
| CN111445413A (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN113672085A (en) | Parameter control method and device, head-mounted display equipment and storage medium | |
| CN111080747B (en) | Face image processing method and electronic equipment | |
| US11812183B2 (en) | Information processing device and program | |
| US11587205B2 (en) | Method and device for generating avatar on basis of corrected image | |
| CN108491780A (en) | Image landscaping treatment method, apparatus, storage medium and terminal device | |
| CN110473156B (en) | Image information processing method and device, storage medium and electronic equipment | |
| CN109639981B (en) | Image shooting method and mobile terminal | |
| CN111373409B (en) | Method and terminal for obtaining color value change |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |