CN111347845B - Electrochromic glass adjusting method and device and electronic equipment - Google Patents
Electrochromic glass adjusting method and device and electronic equipment Download PDFInfo
- Publication number
- CN111347845B CN111347845B CN202010185011.7A CN202010185011A CN111347845B CN 111347845 B CN111347845 B CN 111347845B CN 202010185011 A CN202010185011 A CN 202010185011A CN 111347845 B CN111347845 B CN 111347845B
- Authority
- CN
- China
- Prior art keywords
- eye
- value
- current output
- obtaining
- output value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60J—WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES; REMOVABLE EXTERNAL PROTECTIVE COVERINGS SPECIALLY ADAPTED FOR VEHICLES
- B60J3/00—Antiglare equipment associated with windows or windscreens; Sun visors for vehicles
- B60J3/04—Antiglare equipment associated with windows or windscreens; Sun visors for vehicles adjustable in transparency
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on an electrochromic effect
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/15—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on an electrochromic effect
- G02F1/163—Operation of electrochromic cells, e.g. electrodeposition cells; Circuit arrangements therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Abstract
The application discloses an electrochromic glass adjusting method, an electrochromic glass adjusting device and electronic equipment, and relates to the technical field of artificial intelligence. The specific implementation scheme is as follows: obtaining an eye image of a target object; according to the eye image, obtaining an eye stimulation degree value of the target object; obtaining a current output value by using the eye stimulation degree value; and adjusting the light transmittance of the electrochromic glass according to the current output value. Because the adjustment of the light transmission of the electrochromic glass is determined based on the eye image of the target object, the basis for adjusting the light transmission of the electrochromic glass is more accurate and meets the requirements of users.
Description
Technical Field
The application relates to an artificial intelligence technology in the technical field of computers, in particular to an electrochromic glass adjusting method, an electrochromic glass adjusting device and electronic equipment.
Background
The color of the color-changing glass can be changed along with the intensity of light, for example, when the light is stronger, the color of the glass is darker; when light is weaker, the color of the glass is lightened, and the color-changing glass is applied to a vehicle, so that driving interference of a driver caused by the change of the light intensity can be avoided, and safety accidents are caused.
However, in the above-mentioned photosensitive adjustment method, if strong lateral light is irradiated on the front windshield, the strong lateral light does not greatly affect the sight of the driver, but the color-changing glass still adjusts the color, and the color adjustment in this case may affect the sight of the driver.
That is to say, the current photochromic adjusting method based on photosensitive triggering has poor adjusting effect.
Disclosure of Invention
The embodiment of the application provides an electrochromic glass adjusting method, an electrochromic glass adjusting device and electronic equipment, and aims to solve the problem that an existing glass color changing adjusting method is poor in adjusting effect.
In order to solve the above technical problem, the present application is implemented as follows:
in a first aspect, the present application provides an electrochromic glass conditioning method comprising:
acquiring an eye image of a target object;
according to the eye image, obtaining an eye stimulation degree value of the target object;
obtaining a current output value by using the eye stimulation degree value;
and adjusting the light transmittance of the electrochromic glass according to the current output value.
Further, the obtaining an eye stimulation level value of the target object according to the eye image includes:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object;
wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
Further, the obtaining a current output value by using the eye stimulation degree value includes:
obtaining a middle current output value by using the eye stimulation degree value;
obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
inputting the deviation value into a second network model to obtain a plurality of parameter values, wherein the second network model is obtained by training a neural network model through an input sample and an expected output value;
and inputting the parameter values into a Proportional Integral Derivative (PID) controller to obtain the current output value.
Further, the determining an eye irritation level value of the target object according to the eye image includes:
if the eye images comprise N eye images which are sequentially acquired within a preset time period, acquiring eye stimulation degree values according to the eye images in the N eye images respectively to determine N eye stimulation degree values, wherein N is an integer greater than 1;
updating the Nth eye stimulation level value by using the eye stimulation level value which is acquired before the Nth eye stimulation level value in the N eye stimulation level values;
taking the updated Nth eye stimulation degree value as the eye stimulation degree value of the target object.
In a second aspect, the present application provides an electrochromic glass conditioning device comprising:
the first acquisition module is used for acquiring an eye image of a target object;
the second acquisition module is used for acquiring the eye stimulation degree value of the target object according to the eye image;
the third acquisition module is used for acquiring a current output value by utilizing the eye stimulation degree value;
and the adjusting module is used for adjusting the light transmittance of the electrochromic glass according to the current output value.
Further, the second obtaining module is configured to:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object;
wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
Further, the third obtaining module includes:
the first acquisition submodule is used for acquiring a middle current output value by utilizing the eye stimulation degree value;
the second obtaining submodule is used for obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
the third obtaining submodule is used for inputting the deviation value into a second network model to obtain a plurality of parameter values, and the second network model is obtained by training a neural network model through an input sample and an expected output value;
and the fourth acquisition submodule is used for inputting the parameter values into a proportional-integral-derivative (PID) controller to acquire the current output value.
Further, the second obtaining module includes:
the first determining submodule is used for obtaining eye stimulation degree values according to eye images in the N eye images respectively to determine the N eye stimulation degree values if the eye images comprise the N eye images which are obtained in sequence within a preset time period, wherein N is an integer greater than 1;
an updating submodule, configured to update an nth eye stimulation level value with an eye stimulation level value that is obtained before the nth eye stimulation level value among the N eye stimulation level values;
a second determining submodule, configured to use the updated nth eye stimulation degree value as the eye stimulation degree value of the target object.
A third aspect of the present application provides an electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor;
wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect.
A fourth aspect of the present application provides a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of the first aspect.
One embodiment in the above application has the following advantages or benefits:
obtaining an eye image of a target object; according to the eye image, obtaining an eye stimulation degree value of the target object; obtaining a current output value by using the eye stimulation degree value; and adjusting the light transmittance of the electrochromic glass according to the current output value. Because the adjustment of the light transmission of the electrochromic glass is determined based on the eye image of the target object, the adjustment method is more accurate in the basis of the adjustment of the light transmission of the electrochromic glass and better meets the requirements of users.
Obtaining an eye irritation degree value of the target object by inputting the eye image into a first network model; wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network. The first network model is utilized to obtain the eye stimulation degree value according to the eye image, so that the accuracy of the eye stimulation degree value can be improved, the subsequent light transmittance of the electrochromic glass can be adjusted more accurately, and the requirements of users can be met better.
The current output value is predicted by the second network model, so that the accuracy of the current output value can be improved, the adjustment accuracy is higher when the light transmittance of the electrochromic glass is adjusted based on the current output value, and the optimal adjustment effect of the sight line of the target object can be obtained.
When a plurality of eye images are acquired, the acquired eye stimulation degree value is smoothed, so that shaking is avoided, the electrochromic glass can be prevented from flickering, and the adjusting effect of the electrochromic glass is improved.
Other effects of the above-described alternative will be described below with reference to specific embodiments.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a flow chart of an electrochromic glass conditioning method provided in an embodiment of the present application;
FIG. 2 is a block diagram of an eye detection system provided in an embodiment of the present application;
FIG. 3 is a block diagram of an embodiment of the present application for adjusting an electrochromic glazing according to the degree of eye irritation;
FIG. 4 is another flow chart of an electrochromic glass conditioning method provided in an embodiment of the present application;
FIG. 5 is a block diagram of an electrochromic glass conditioning device as provided in an embodiment of the present application;
FIG. 6 is a block diagram of an electronic device for implementing the electrochromic glass conditioning method of an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
Referring to fig. 1, fig. 1 is a flowchart of an electrochromic glass conditioning method provided in an embodiment of the present application, and as shown in fig. 1, the embodiment provides an electrochromic glass conditioning method applied to an electronic device, including the following steps:
The target object may be a user, such as a driver, using electrochromic glazing. The method comprises the steps of collecting a facial image of a user through a camera device, then regressing the facial image through face key points, obtaining coordinates of eye key points, and intercepting an eye image from the facial image. As shown in fig. 2, the camera sends the acquired face image to the image acquisition device, the image acquisition device sends the face image to the computing device, the computing device obtains the coordinates of the eye key points, and the eye image is intercepted from the face image. The eye detection algorithm is deployed on a computing device, and can detect the eye stimulation state according to the acquired real-time eye image.
And step 102, obtaining an eye stimulation degree value of the target object according to the eye image.
The eye image is analyzed, for example, the size of the pupil in the eye image can be analyzed, so as to determine the eye irritation degree value of the target object, and the eye irritation degree value can be used for representing the irritation degree of the eye.
And 103, obtaining a current output value by using the eye stimulation degree value.
The eye stimulation degree value and the current output value can be in a linear relation or a nonlinear relation. For example, a network model may be pre-trained to obtain current output values based on eye stimulus level values.
And 104, adjusting the light transmittance of the electrochromic glass according to the current output value.
The electrochromic glass can realize the purpose of regulating the illumination by utilizing the adjustability of the light transmission (or absorption) performance of the electrochromic material under the action of an electric field. The electrochromic system can keep the interior of the vehicle cool in summer and warm in winter by selectively absorbing or reflecting external heat radiation and preventing internal heat from being diffused.
The light transmittance of the electrochromic glass is adjusted based on the current output value, and the current output value is obtained based on the eye image of the target object, so that the aim of automatically and intelligently adjusting the light transmittance of the electrochromic glass based on the eye image of the target object can be fulfilled.
In the embodiment, an eye image of a target object is obtained; according to the eye image, obtaining an eye stimulation degree value of the target object; obtaining a current output value by using the eye stimulation degree value; and adjusting the light transmittance of the electrochromic glass according to the current output value. Because the adjustment of the light transmission of the electrochromic glass is determined based on the eye image of the target object, the adjustment method is more accurate in the basis of the adjustment of the light transmission of the electrochromic glass and better meets the requirements of users.
In an embodiment of the present application, the obtaining 102 an eye irritation level value of the target object according to the eye image includes:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object; wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
In this embodiment, the first network model is an algorithm model based on a convolutional neural network, and since the pupil is a light entrance door in the eye, it is narrowed at the bright light and largely diverged at the dark light, and therefore, based on the eye image, the degree of the eye stimulation by the light can be determined.
In this embodiment, in the stage of training the convolutional neural network model, a large number of images of eyes stimulated by light rays are collected first, and the images are labeled, and then the images and labeled data are input into the convolutional neural network to perform model parameter training, so as to obtain the first network model. The first network model can extract specific eye pattern features and is used for outputting eye stimulation degree values of eyes stimulated by light.
The first network model inputs an eye image with a preset size in a detection stage, obtains weight parameters through training, performs layer-by-layer convolution calculation to extract eye features from the eye image, and finally outputs an eye stimulation degree value.
In this embodiment, the eye stimulation level value of the target object is obtained by inputting the eye image into a first network model; wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network. The first network model is utilized to obtain the eye stimulation degree value according to the eye image, so that the accuracy of the eye stimulation degree value can be improved, the subsequent light transmittance of the electrochromic glass can be adjusted more accurately, and the requirements of users can be met better.
In an embodiment of the present application, obtaining the current output value by using the eye stimulation level value includes:
obtaining a middle current output value by using the eye stimulation degree value;
obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
inputting the deviation value into a second network model to obtain a plurality of parameter values, wherein the second network model is obtained by training a neural network model through an input sample and an expected output value;
and inputting the parameter values into a Proportional Integral Derivative (PID) controller to obtain the current output value.
In this embodiment, the eye stimulation level value and the intermediate current output value may have a linear relationship, and the linear relationship may be preset. The second network model is obtained by training the neural network model, the training phase of the neural network model is performed off-line, and a step signal is used as an input during training, namely, the input sample is the step signal. Loss function of neural network model training:
model training was performed by gradient descent. Wherein e (t) represents an error between the current output value obtained by using the predicted plurality of parameter values and the expected output value, that is, after the neural network model obtains the plurality of parameter values based on the input sample, the current output value is obtained based on the plurality of parameter values by a Proportional Integral Derivative (PID) controller, and then the model training is performed by gradient descent based on the error between the current output value and the expected output value. And after the training is finished, obtaining the weight parameters of the neural network model, namely obtaining a second network model, wherein the second network model can be used for online prediction.
The second network model obtains a plurality of parameter values based on the deviation values of the intermediate current output value and the feedback current value, the feedback current value is the current output value obtained at the last moment, and the intermediate current output value is the current output value obtained at the current moment based on the eye stimulation degree value. Initially, the current output value obtained at the previous time is 0.
Fig. 3 is a schematic structural diagram of adjusting electrochromic glass according to an eye stimulation degree value, a PID parameter prediction module in fig. 3 is a second network model, and in fig. 3, a deviation value between an output current (i.e., a feedback current value) and a middle current output value at a previous time is input to the PID parameter prediction module to obtain a plurality of parameter values. Fig. 4 is a flowchart of an electrochromic glass adjustment method provided in an embodiment of the present application, in which the eye irritation detection device is configured to output a plurality of parameter values, and the control system may be understood as a PID controller, and the current output by the PID controller adjusts the color of the electrochromic glass.
The plurality of parameter values can comprise three parameter values which are respectively a proportional parameter value, an integral parameter value and a differential parameter value, and the three parameter values are input into the PID controller to obtain a current output value so as to adjust the electrochromic glass. The PID controller adopts a plurality of parameter values as input, outputs a current output value as a control quantity to control the color of the electrochromic glass, and can realize intelligent adjustment of the electrochromic glass along with stimulation of human eyes.
In this embodiment, when obtaining the current output value by using the eye stimulation degree value, obtaining an intermediate current output value by using the eye stimulation degree value; obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment; inputting the deviation value into a second network model to obtain a plurality of parameter values, wherein the second network model is obtained by training a neural network model through an input sample and an expected output value; and inputting the parameter values into a Proportional Integral Derivative (PID) controller to obtain the current output value. The current output value is predicted by the second network model, so that the accuracy of the current output value can be improved, the adjustment accuracy is higher when the light transmittance of the electrochromic glass is adjusted based on the current output value, and the optimal adjustment effect of the sight line of the target object can be obtained.
In one embodiment of the present application, the determining an eye irritation level value of the target object according to the eye image includes:
if the eye images comprise N eye images which are sequentially acquired within a preset time period, acquiring eye stimulation degree values according to the eye images in the N eye images respectively to determine N eye stimulation degree values, wherein N is an integer greater than 1;
updating the Nth eye stimulation level value by using the eye stimulation level value which is acquired before the Nth eye stimulation level value in the N eye stimulation level values;
taking the updated Nth eye stimulation degree value as the eye stimulation degree value of the target object.
In this embodiment, when the eye image of the target object is obtained, one eye image may be obtained at intervals of a preset time to determine the eye stimulation level value of the target object, or a plurality of eye images may be obtained within a preset time period, for example, 25 eye images may be obtained in one minute. In the case of acquiring a plurality of eye images, in order to avoid the flicker effect of the electrochromic glass caused by the jitter of the obtained eye stimulation degree values, the smoothing can be performed by adopting a low-pass filtering mode. Namely, for a first eye image and a second eye image acquired at adjacent time, a first eye stimulation degree value and a second eye stimulation degree value are acquired, and then the second eye stimulation degree value is updated by using the first eye stimulation degree value.
The eye stimulation level values of the eye images acquired at adjacent times are updated using low pass filtering p _ cur' ═ e _ cur + (1-e) × p _ prev. Wherein e is a filter coefficient, the value range is 0 to 1, and p _ cur is the eye stimulation degree value at the current moment; p _ prev is the eye stimulation level value at the last moment; p _ cur' is the updated eye stimulation level value at the current time. And weighting the eye stimulation degree value at the current moment and the eye stimulation degree value at the previous moment to obtain the updated eye stimulation degree value at the current moment.
According to the N eye images which are acquired in sequence, N eye stimulation degree values can be acquired, and the sequence of each eye stimulation degree value in the N eye stimulation degree values corresponds to the N eye images, for example, the first eye image and the second eye image are sequentially acquired at adjacent time, so that the first eye stimulation degree value determined according to the first eye image is adjacent to the second eye stimulation degree value determined according to the second eye image and are sequentially sequenced.
And sequentially updating the eye stimulation level values except the first eye stimulation level value in the N eye stimulation level values. And updating the (i + 1) th eye stimulation degree value by using the ith eye stimulation degree value, wherein i is a positive integer less than N. For example, the second eye stimulation level value is updated with the first eye stimulation level value, and then the third eye stimulation level value is updated with the second eye stimulation level value (at this time, the second eye stimulation level value is updated), which are sequentially performed until the nth eye stimulation level value is updated. That is, the update of the nth eye stimulation level value depends on the N-1 eye stimulation level values that are arranged in front thereof. And then, taking the updated Nth eye stimulation degree value as the eye stimulation degree value of the target object, so as to smooth the obtained eye stimulation degree value when a plurality of eye images are obtained, avoid shaking, prevent the electrochromic glass from flickering and improve the adjusting effect of the electrochromic glass.
In this embodiment, when determining the eye irritation level value of the target object according to the eye image, if the eye image includes N eye images sequentially acquired within a preset time period, the eye irritation level value is acquired according to each of the N eye images, so as to determine N eye irritation level values, where N is an integer greater than 1; updating the Nth eye stimulation level value by using the eye stimulation level value which is acquired before the Nth eye stimulation level value in the N eye stimulation level values; taking the updated Nth eye stimulation degree value as the eye stimulation degree value of the target object. When a plurality of eye images are acquired, the acquired eye stimulation degree value is smoothed, so that shaking is avoided, the electrochromic glass can be prevented from flickering, and the adjusting effect of the electrochromic glass is improved.
Referring to fig. 5, fig. 5 is a structural diagram of an electrochromic glass conditioning device provided in the present embodiment, and as shown in fig. 5, the present embodiment provides an electrochromic glass conditioning device 500, including:
a first obtaining module 501, configured to obtain an eye image of a target object;
a second obtaining module 502, configured to obtain an eye stimulation level value of the target object according to the eye image;
a third obtaining module 503, configured to obtain a current output value by using the eye stimulation level value;
and the adjusting module 504 is used for adjusting the light transmittance of the electrochromic glass according to the current output value.
In an embodiment of the present application, the second obtaining module 502 is configured to:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object;
wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
In an embodiment of the present application, the third obtaining module 503 includes:
the first acquisition submodule is used for acquiring a middle current output value by utilizing the eye stimulation degree value;
the second obtaining submodule is used for obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
the third obtaining submodule is used for inputting the deviation value into a second network model to obtain a plurality of parameter values, and the second network model is obtained by training a neural network model through an input sample and an expected output value;
and the fourth acquisition submodule is used for inputting the parameter values into a proportional-integral-derivative (PID) controller to acquire the current output value.
In an embodiment of the present application, the second obtaining module 502 includes:
the first determining submodule is used for obtaining eye stimulation degree values according to eye images in the N eye images respectively to determine the N eye stimulation degree values if the eye images comprise the N eye images which are obtained in sequence within a preset time period, wherein N is an integer greater than 1;
an updating submodule, configured to update an nth eye stimulation level value with an eye stimulation level value that is obtained before the nth eye stimulation level value among the N eye stimulation level values;
a second determining submodule, configured to use the updated nth eye stimulation degree value as the eye stimulation degree value of the target object.
The electrochromic glass adjusting apparatus 500 can implement the processes implemented by the electronic device in the method embodiment shown in fig. 1, and in order to avoid repetition, the details are not described here.
The electrochromic glass adjusting device 500 of the embodiment of the application obtains an eye image of a target object; according to the eye image, obtaining an eye stimulation degree value of the target object; obtaining a current output value by using the eye stimulation degree value; and adjusting the light transmittance of the electrochromic glass according to the current output value. Because the adjustment of the light transmission of the electrochromic glass is determined based on the eye image of the target object, the adjustment method is more accurate in the basis of the adjustment of the light transmission of the electrochromic glass and better meets the requirements of users.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 6, is a block diagram of an electronic device of an electrochromic glass conditioning method according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 6, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 6, one processor 601 is taken as an example.
The memory 602 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the electrochromic glass conditioning method provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the electrochromic glass conditioning method provided herein.
The memory 602, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the first obtaining module 501, the second obtaining module 502, the third obtaining module 503, and the adjusting module 504 shown in fig. 5) corresponding to the electrochromic glass adjusting method in the embodiments of the present application. The processor 601 executes various functional applications of the server and data processing by running non-transitory software programs, instructions and modules stored in the memory 602, namely, implements the electrochromic glass conditioning method in the above method embodiment.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the electronic device implementing the electrochromic glass adjusting method, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected over a network to an electronic device implementing the electrochromic glass conditioning method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device implementing the electrochromic glass conditioning method may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 6 illustrates the connection by a bus as an example.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of an electronic device implementing the electrochromic glass conditioning method, such as a touch screen, keypad, mouse, track pad, touch pad, pointer stick, one or more mouse buttons, track ball, joystick, or like input device. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the eye image of the target object is obtained; according to the eye image, obtaining an eye stimulation degree value of the target object; obtaining a current output value by using the eye stimulation degree value; and adjusting the light transmittance of the electrochromic glass according to the current output value. Because the adjustment of the light transmission of the electrochromic glass is determined based on the eye image of the target object, the adjustment method is more accurate in the basis of the adjustment of the light transmission of the electrochromic glass and better meets the requirements of users.
Obtaining an eye irritation degree value of the target object by inputting the eye image into a first network model; wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network. The first network model is utilized to obtain the eye stimulation degree value according to the eye image, so that the accuracy of the eye stimulation degree value can be improved, the subsequent light transmittance of the electrochromic glass can be adjusted more accurately, and the requirements of users can be met better.
The current output value is predicted by the second network model, so that the accuracy of the current output value can be improved, the adjustment accuracy is higher when the light transmittance of the electrochromic glass is adjusted based on the current output value, and the optimal adjustment effect of the sight line of the target object can be obtained.
When a plurality of eye images are acquired, the acquired eye stimulation degree value is smoothed, so that shaking is avoided, the electrochromic glass can be prevented from flickering, and the adjusting effect of the electrochromic glass is improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (8)
1. An electrochromic glass conditioning method, comprising:
acquiring an eye image of a target object;
according to the eye image, obtaining an eye stimulation degree value of the target object;
obtaining a current output value by using the eye stimulation degree value;
adjusting the light transmittance of the electrochromic glass according to the current output value;
obtaining a current output value by using the eye stimulation degree value, wherein the current output value comprises:
obtaining a middle current output value by using the eye stimulation degree value;
obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
inputting the deviation value into a second network model to obtain a plurality of parameter values, wherein the second network model is obtained by training a neural network model through an input sample and an expected output value;
and inputting the parameter values into a Proportional Integral Derivative (PID) controller to obtain the current output value.
2. The method of claim 1, wherein obtaining the eye irritation level value of the target subject from the eye image comprises:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object;
wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
3. The method of claim 1, wherein determining the eye irritation level value of the target object from the eye image comprises:
if the eye images comprise N eye images which are sequentially acquired within a preset time period, acquiring eye stimulation degree values according to the eye images in the N eye images respectively to determine N eye stimulation degree values, wherein N is an integer greater than 1;
updating the Nth eye stimulation level value by using the eye stimulation level value which is acquired before the Nth eye stimulation level value in the N eye stimulation level values;
taking the updated Nth eye stimulation degree value as the eye stimulation degree value of the target object.
4. An electrochromic glass conditioning device, comprising:
the first acquisition module is used for acquiring an eye image of a target object;
the second acquisition module is used for acquiring the eye stimulation degree value of the target object according to the eye image;
the third acquisition module is used for acquiring a current output value by utilizing the eye stimulation degree value;
the adjusting module is used for adjusting the light transmittance of the electrochromic glass according to the current output value;
the third obtaining module includes:
the first acquisition submodule is used for acquiring a middle current output value by utilizing the eye stimulation degree value;
the second obtaining submodule is used for obtaining a deviation value of the intermediate current output value and a feedback current value, wherein the feedback current value is a current output value obtained at the last moment;
the third obtaining submodule is used for inputting the deviation value into a second network model to obtain a plurality of parameter values, and the second network model is obtained by training a neural network model through an input sample and an expected output value;
and the fourth acquisition submodule is used for inputting the parameter values into a proportional-integral-derivative (PID) controller to acquire the current output value.
5. The apparatus of claim 4, wherein the second obtaining module is configured to:
inputting the eye image into a first network model to obtain an eye stimulation degree value of the target object;
wherein the first network model is obtained by training the labeled eye sample image by using a convolutional neural network.
6. The apparatus of claim 4, wherein the second obtaining module comprises:
the first determining submodule is used for obtaining eye stimulation degree values according to eye images in the N eye images respectively to determine the N eye stimulation degree values if the eye images comprise the N eye images which are obtained in sequence within a preset time period, wherein N is an integer greater than 1;
an updating submodule, configured to update an nth eye stimulation level value with an eye stimulation level value that is obtained before the nth eye stimulation level value among the N eye stimulation level values;
a second determining submodule, configured to use the updated nth eye stimulation degree value as the eye stimulation degree value of the target object.
7. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor;
wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-3.
8. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-3.
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111130223.6A CN113771601B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202110895417.9A CN113580893B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111131649.3A CN113771602B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202010185011.7A CN111347845B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010185011.7A CN111347845B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Related Child Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110895417.9A Division CN113580893B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111131649.3A Division CN113771602B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111130223.6A Division CN113771601B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111347845A CN111347845A (en) | 2020-06-30 |
| CN111347845B true CN111347845B (en) | 2021-09-21 |
Family
ID=71191774
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110895417.9A Active CN113580893B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111130223.6A Active CN113771601B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202010185011.7A Active CN111347845B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111131649.3A Active CN113771602B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110895417.9A Active CN113580893B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
| CN202111130223.6A Active CN113771601B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111131649.3A Active CN113771602B (en) | 2020-03-17 | 2020-03-17 | Electrochromic glass adjusting method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (4) | CN113580893B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111273776A (en) * | 2020-01-20 | 2020-06-12 | 芋头科技（杭州）有限公司 | Opacity control method, opacity control device, AR/MR device, controller and medium |
| CN115712363A (en) * | 2022-11-21 | 2023-02-24 | 北京中科睿医信息科技有限公司 | Interface color display method, device, equipment and medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107728770A (en) * | 2017-09-26 | 2018-02-23 | 努比亚技术有限公司 | Screen luminance of terminal method of adjustment, mobile terminal and computer-readable recording medium |
| CN107844780A (en) * | 2017-11-24 | 2018-03-27 | 中南大学 | A kind of the human health characteristic big data wisdom computational methods and device of fusion ZED visions |
| CN107962935A (en) * | 2016-10-20 | 2018-04-27 | 福特全球技术公司 | Vehicle glazing light transmittance control device and method |
| WO2018197381A1 (en) * | 2017-04-27 | 2018-11-01 | Robert Bosch Gmbh | Vehicle mounted virtual visor system and method thereof |
| CN109849626A (en) * | 2019-01-16 | 2019-06-07 | 深圳壹账通智能科技有限公司 | Method for regulating transmittance, device, computer readable storage medium and terminal device |
| CN110309774A (en) * | 2019-06-28 | 2019-10-08 | 京东数字科技控股有限公司 | Iris segmentation method, apparatus, storage medium and electronic equipment |
| CN110334575A (en) * | 2019-04-29 | 2019-10-15 | 上海交通大学 | Fundus photograph recognition methods, device, equipment and storage medium |
| CN110728242A (en) * | 2019-10-15 | 2020-01-24 | 苏州金羲智慧科技有限公司 | Image matching method and device based on portrait recognition, storage medium and application |
| CN110834523A (en) * | 2019-11-26 | 2020-02-25 | 奇瑞汽车股份有限公司 | Self-adaptive electronic sun shield and control method thereof |
| CN110866962A (en) * | 2019-11-20 | 2020-03-06 | 成都威爱新经济技术研究院有限公司 | Virtual portrait and expression synchronization method based on convolutional neural network |
| CN110874577A (en) * | 2019-11-15 | 2020-03-10 | 杭州东信北邮信息技术有限公司 | Automatic verification method of certificate photo based on deep learning |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6039139A (en) * | 1992-05-05 | 2000-03-21 | Automotive Technologies International, Inc. | Method and system for optimizing comfort of an occupant |
| CN201642543U (en) * | 2010-04-13 | 2010-11-24 | 杨乐 | Light-variable liquid crystal welding eye-protection glasses |
| CN203573065U (en) * | 2013-12-04 | 2014-04-30 | 福建师范大学 | Self-adjusting system of electrochromic glass wall capable of adjusting light transmittance automatically |
| CN106143072A (en) * | 2015-03-11 | 2016-11-23 | 刘韵凯 | A kind of vehicle front-viewing intelligence anti-dazzle system based on electrochomeric glass |
| WO2017053040A1 (en) * | 2015-09-21 | 2017-03-30 | Proteq Technologies Llc | Active glare suppression system |
| US9702183B1 (en) * | 2016-02-26 | 2017-07-11 | Toyota Motor Engineering & Manufacturing North America, Inc. | Smart sunshade for a vehicle window |
| CN105904947B (en) * | 2016-05-10 | 2018-10-30 | 潘磊 | A kind of strong light filtration system |
| US10262211B2 (en) * | 2016-09-28 | 2019-04-16 | Wipro Limited | Windshield and a method for mitigating glare from a windshield of an automobile |
| CN106985640B (en) * | 2017-04-26 | 2023-11-24 | 华域视觉科技(上海)有限公司 | Active anti-dazzling method and active anti-dazzling device for automobile |
| CN207264071U (en) * | 2017-09-25 | 2018-04-20 | 浙江上方电子装备有限公司 | A kind of electrochromism vehicle glass |
| US10389989B2 (en) * | 2017-09-27 | 2019-08-20 | University Of Miami | Vision defect determination and enhancement using a prediction model |
| CN108454358A (en) * | 2018-03-27 | 2018-08-28 | 京东方科技集团股份有限公司 | A kind of anti-dazzle apparatus and its control method, vehicle |
| US10528131B2 (en) * | 2018-05-16 | 2020-01-07 | Tobii Ab | Method to reliably detect correlations between gaze and stimuli |
| CN109674579B (en) * | 2019-01-15 | 2021-03-30 | 武汉工程大学 | Active shading eye protection glasses structure and control method |
-
2020
- 2020-03-17 CN CN202110895417.9A patent/CN113580893B/en active Active
- 2020-03-17 CN CN202111130223.6A patent/CN113771601B/en active Active
- 2020-03-17 CN CN202010185011.7A patent/CN111347845B/en active Active
- 2020-03-17 CN CN202111131649.3A patent/CN113771602B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107962935A (en) * | 2016-10-20 | 2018-04-27 | 福特全球技术公司 | Vehicle glazing light transmittance control device and method |
| WO2018197381A1 (en) * | 2017-04-27 | 2018-11-01 | Robert Bosch Gmbh | Vehicle mounted virtual visor system and method thereof |
| CN107728770A (en) * | 2017-09-26 | 2018-02-23 | 努比亚技术有限公司 | Screen luminance of terminal method of adjustment, mobile terminal and computer-readable recording medium |
| CN107844780A (en) * | 2017-11-24 | 2018-03-27 | 中南大学 | A kind of the human health characteristic big data wisdom computational methods and device of fusion ZED visions |
| CN109849626A (en) * | 2019-01-16 | 2019-06-07 | 深圳壹账通智能科技有限公司 | Method for regulating transmittance, device, computer readable storage medium and terminal device |
| CN110334575A (en) * | 2019-04-29 | 2019-10-15 | 上海交通大学 | Fundus photograph recognition methods, device, equipment and storage medium |
| CN110309774A (en) * | 2019-06-28 | 2019-10-08 | 京东数字科技控股有限公司 | Iris segmentation method, apparatus, storage medium and electronic equipment |
| CN110728242A (en) * | 2019-10-15 | 2020-01-24 | 苏州金羲智慧科技有限公司 | Image matching method and device based on portrait recognition, storage medium and application |
| CN110874577A (en) * | 2019-11-15 | 2020-03-10 | 杭州东信北邮信息技术有限公司 | Automatic verification method of certificate photo based on deep learning |
| CN110866962A (en) * | 2019-11-20 | 2020-03-06 | 成都威爱新经济技术研究院有限公司 | Virtual portrait and expression synchronization method based on convolutional neural network |
| CN110834523A (en) * | 2019-11-26 | 2020-02-25 | 奇瑞汽车股份有限公司 | Self-adaptive electronic sun shield and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113580893B (en) | 2022-12-09 |
| CN113771602B (en) | 2023-01-10 |
| CN113771602A (en) | 2021-12-10 |
| CN113771601B (en) | 2023-01-10 |
| CN113771601A (en) | 2021-12-10 |
| CN113580893A (en) | 2021-11-02 |
| CN111347845A (en) | 2020-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11861873B2 (en) | Event camera-based gaze tracking using neural networks | |
| CN111347845B (en) | Electrochromic glass adjusting method and device and electronic equipment | |
| US10114456B2 (en) | Sight tracking method and device | |
| US11056077B2 (en) | Approach for automatically adjusting display screen setting based on machine learning | |
| CN108153424B (en) | Eye movement and head movement interaction method of head display equipment | |
| CN110910658B (en) | Traffic signal control method, traffic signal control device, computer equipment and storage medium | |
| DE112015002673T5 (en) | Display for information management | |
| CN109808464B (en) | Method and device for adjusting light transmittance of front windshield | |
| CN110415653B (en) | Backlight brightness adjusting system and method and liquid crystal display device | |
| CN114236834B (en) | Screen brightness adjusting method and device of head-mounted display equipment and head-mounted display equipment | |
| CN106200961A (en) | Mobile terminal, wearable device and input method | |
| CN116228867B (en) | Pose determination method, pose determination device, electronic equipment and medium | |
| DE102020133445A1 (en) | CAMERA ARCHESTRY TECHNOLOGY TO IMPROVE AUTOMATIC PERSONAL IDENTIFICATION | |
| CN107229125A (en) | VR eyeglass control method and device | |
| CN112949467B (en) | Face detection method, device, electronic equipment and storage medium | |
| CN111273776A (en) | Opacity control method, opacity control device, AR/MR device, controller and medium | |
| CN114280781A (en) | Intelligent glasses and control method and device of intelligent glasses | |
| CN111724598B (en) | Method, device, equipment and storage medium for automatically driving and planning path | |
| CN113419624A (en) | Eye movement interaction method and device based on head time sequence signal correction | |
| DE102014216053A1 (en) | Adjustment of the illumination wavelength during eye detection | |
| CN114612635B (en) | Method and device capable of switching between augmented reality mode and virtual reality mode | |
| CN105748270A (en) | Wearable gradually-changing focal point combined lens device based on Internet of Things and using method thereof | |
| DE102012008736A1 (en) | Dynamic light flux filtering system for use in motor car to minimize glare effect on eyes of driver, has central computing and control unit transmitting signal for adjusting light transmittance of partial surface of filter | |
| EP4242736A1 (en) | System comprising an optical device and a controller | |
| CN110244472B (en) | Glasses local light transmittance adjusting method and system and glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211012 Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, Beijing Economic and Technological Development Zone, Daxing District, Beijing Patentee after: Apollo Zhilian (Beijing) Technology Co.,Ltd. Address before: 2 / F, baidu building, 10 Shangdi 10th Street, Haidian District, Beijing 100085 Patentee before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |