CN114935976A - Partition display method, system, electronic equipment and storage medium - Google Patents

Partition display method, system, electronic equipment and storage medium Download PDF

Info

Publication number
CN114935976A
CN114935976A CN202210711264.2A CN202210711264A CN114935976A CN 114935976 A CN114935976 A CN 114935976A CN 202210711264 A CN202210711264 A CN 202210711264A CN 114935976 A CN114935976 A CN 114935976A
Authority
CN
China
Prior art keywords
information
display screen
human eye
offset
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210711264.2A
Other languages
Chinese (zh)
Inventor
郭可升
刘乔
胡强
杨振怀
肖永能
黄丽玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ji Hua Laboratory
Original Assignee
Ji Hua Laboratory
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ji Hua Laboratory filed Critical Ji Hua Laboratory
Priority to CN202210711264.2A priority Critical patent/CN114935976A/en
Publication of CN114935976A publication Critical patent/CN114935976A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application relates to the technical field of screen display, and particularly provides a partition display method, a partition display system, electronic equipment and a storage medium, wherein the partition display method, the system, the electronic equipment and the storage medium are applied to the partition display system, the partition display system comprises a visual camera and a display screen, the visual camera is used for generating and acquiring image information in front of the display screen, and the partition display method comprises the following steps: acquiring first human eye size information of any human eye according to the image information; acquiring first distance information from human eyes to a display screen according to the first human eye size information; acquiring first offset information of the first human eye size information corresponding to the human eye and second offset information of the pupil in the human eye according to the image information; acquiring a watching area of the corresponding human eye on the display screen according to the first distance information, the first offset information and the second offset information; controlling the display screen to display high-refresh-rate picture information in the gazing area; the partition display method enables the display screen to achieve high refresh rate display and reduce power consumption at the same time.

Description

Partition display method, system, electronic equipment and storage medium
Technical Field
The present disclosure relates to the field of screen display technologies, and in particular, to a method and a system for partitioned display, an electronic device, and a storage medium.
Background
The display screen has the advantages of smooth picture, smooth picture rolling, rapid touch feedback and the like, but the display screen also has the defects of easy heating and high power consumption in operation, the prior art generally solves the defects of the display screen with high refresh frequency by reducing the refresh rate of static picture images, but the display screen in the prior art cannot simultaneously realize high refresh rate display and power consumption reduction when displaying dynamic pictures.
In view of the above problems, no effective technical solution exists at present.
Disclosure of Invention
The application aims to provide a partition display method, a partition display system, an electronic device and a storage medium, and a display screen can simultaneously realize high-refresh-rate display and reduce power consumption.
In a first aspect, the present application provides a partition display method, configured to reduce power consumption of a display screen, and applied to a partition display system, where the partition display system includes the display screen and a visual camera, and the visual camera is configured to collect and generate image information before the display screen, and the partition display method includes the following steps:
acquiring first human eye size information of any human eye according to the image information;
acquiring first distance information from the human eyes to the display screen according to the first human eye size information;
acquiring first offset information of the human eyes corresponding to the first human eye size information and second offset information of pupils in the human eyes according to the image information;
acquiring a watching area of a corresponding human eye on the display screen according to the first distance information, the first offset information and the second offset information;
and controlling the display screen to display the high-refresh-rate picture information in the gazing area.
According to the partitioned display method, the watching area of human eyes on the display screen can be obtained according to the image information, the display screen is controlled to display the high-refresh-rate picture information in the watching area, the display screen only displays the high-refresh-rate picture information in the watching area, the area of the display screen displaying the high-refresh-rate picture information is reduced, and therefore the display screen can achieve high-refresh-rate display and power consumption reduction at the same time.
Optionally, the step of obtaining the first distance information from the human eye to the display screen according to the first human eye size information includes the following steps: and acquiring first distance information from the human eyes to the display screen according to the first human eye size information and a preset first proportional relation.
According to the partitioned display method, the first distance information from the human eyes to the display screen can be obtained only through the first human eye size information and the preset first proportional relation, and therefore data processing amount for obtaining the first distance information from the human eyes to the display screen is effectively reduced.
Optionally, the step of acquiring a gaze area of a corresponding human eye on the display screen according to the first distance information, the first offset information, and the second offset information includes the steps of:
acquiring a fixation center point of a corresponding human eye on the display screen according to the first distance information, the first offset information, the second offset information and a preset second proportional relation;
and acquiring a watching area of the human eyes on the display screen according to the watching center point, preset graphic information and proportion information.
Optionally, the partition display system further includes a distance sensor, the distance sensor is configured to collect and generate second distance information from the human eye to the display screen, and the step of obtaining the gazing center point of the corresponding human eye on the display screen according to the first distance information, the first offset information, the second offset information, and a preset second proportional relationship includes the following steps:
acquiring a correction coefficient according to the first distance information and the second distance information;
acquiring second proportion information according to the first distance information and preset third distance information;
acquiring third offset information according to the second offset information, a preset second proportional relation and the second proportional information;
and acquiring a watching center point of the corresponding human eye on the display screen according to the first offset information and the third offset information.
According to the partitioned display method, the correction coefficient is obtained according to the first distance information and the second distance information, the correction coefficient has a correction effect on the first offset information, and therefore the accuracy of obtaining the watching center point of the human eyes on the display screen is further improved.
Optionally, the step of obtaining a gazing center point of a corresponding human eye on the display screen according to the first distance information, the first offset information, the second offset information, and a preset second proportional relationship includes the following steps:
acquiring second proportion information according to the first distance information, preset third distance information and preset fourth distance information;
acquiring third offset information according to the second offset information, a preset second proportional relation and the second proportional information;
and acquiring a watching center point of the corresponding human eye on the display screen according to the first offset information and the third offset information.
Optionally, the step of controlling the display screen to display the high refresh rate picture information in the gazing area includes the following steps:
controlling the display screen to display first picture information in the gazing area;
and controlling the display screen to display second picture information outside the watching area, wherein the refresh rate of the first picture information is higher than that of the second picture information.
Optionally, the step of obtaining the first eye size information according to the image information further includes, before the step of obtaining the first eye size information according to the image information, a step of:
and acquiring the proportion information of the pupil in the human eye according to the image information, and watching the human eye to watch the display screen if the proportion information is larger than or equal to a preset second threshold value.
In a second aspect, the present application further provides a partitioned display system, configured to reduce power consumption of a display screen, including the display screen and a visual camera, where the visual camera is configured to collect and generate image information before the display screen, and the partitioned display system further includes:
the controller is electrically connected with the visual camera and the display screen, and is used for acquiring first human eye size information of any human eye according to the image information, acquiring first distance information from the human eye to the display screen according to the first human eye size information, acquiring first offset information of the human eye corresponding to the first human eye size information and second offset information of a pupil in the human eye according to the image information, acquiring a watching region of the corresponding human eye on the display screen according to the first distance information, the first offset information and the second offset information, and controlling the display screen to display high-refresh-rate picture information in the watching region.
The application provides a subregion display system, can obtain the region of gazing of people's eye on the display screen and control the display screen and show high refresh rate picture information in gazing-vision region according to image information, because the display screen only shows high refresh rate picture information in gazing-vision region, the regional reduction that the display screen shows high refresh rate picture information, consequently the display screen can realize high refresh rate simultaneously and show and reduce the consumption.
In a third aspect, the present application further provides an electronic device, comprising a processor and a memory, where the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the steps in the method provided in the first aspect are executed.
In a fourth aspect, the present application also provides a storage medium having a computer program stored thereon, where the computer program runs the steps of the method as provided in the first aspect when executed by a processor.
Therefore, according to the partitioned display method, the system, the electronic device and the storage medium, the watching area of the human eye on the display screen can be obtained according to the image information, and the display screen is controlled to display the high-refresh-rate picture information in the watching area.
Additional features and advantages of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the present application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
Fig. 1 is a schematic control structure diagram of a partitioned display system according to an embodiment of the present disclosure.
Fig. 2 is a schematic structural diagram of a partitioned display system according to an embodiment of the present application.
Fig. 3 is a flowchart of a partition display method according to an embodiment of the present application.
Fig. 4 is a schematic diagram of a conversion relationship between second offset information and third offset information provided in an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Reference numerals: 1. a display screen; 2. a vision camera; 3. a distance sensor; 4. a controller; 401. a processor; 402. a memory; 403. a communication bus; 11. a region of gaze.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, could be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not construed as indicating or implying relative importance.
The high-refresh-rate display screen has the advantages of smooth picture, smooth picture rolling and the like, but the high-refresh-rate display screen also has the defects of easy heating and high power consumption in operation, the prior art generally solves the defects of the high-refresh-rate display screen by a method for reducing the image refresh rate of a static picture, but when the display screen in the prior art displays a dynamic picture, the whole high-refresh-rate display screen is high-refresh-rate display, and at the moment, the power consumption of the display screen is high, namely, the power consumption of the high-refresh-rate display screen is high when the high-refresh-rate picture is displayed. In the prior art, various parameters of two human eyes are generally obtained through image information, and the distance between the human eyes and a display screen and the fixation areas of the human eyes on the display screen are calculated according to the parameters, wherein the parameters comprise space coordinate values of the two human eyes relative to the display screen, pupil center points of the two human eyes and the like.
Research shows that when the central visual angle is less than or equal to 15 degrees, the recognition power of human eyes is strongest; when the central visual angle is more than 15 degrees and less than or equal to 20 degrees, human eyes can recognize object images or complex characters and pictures in a very short time; when the central visual angle is more than 20 degrees and less than or equal to 30 degrees, human eyes can recognize letters and simple symbol patterns, and the human eyes need to concentrate on energy to recognize object images; when the central viewing angle is greater than 30 ° and equal to or less than 60 °, human eyes can distinguish colors only. Therefore, for human vision, the image information within the central viewing angle of 30 ° affects the human perception, and since the human vision cannot distinguish whether the image information outside the central viewing angle of 30 ° is the high refresh rate image information, the high refresh rate image information outside the central viewing angle of 30 ° of the high refresh rate display screen does not affect the human perception, that is, the high refresh rate image information outside the central viewing angle of 30 ° belongs to useless information.
In a first aspect, as shown in fig. 1-2, the present application provides a partitioned display system, configured to reduce power consumption of a display screen 1, including the display screen 1 and a visual camera 2, where the visual camera 2 is configured to collect and generate image information before the display screen 1, and the partitioned display system further includes:
the controller 4 is electrically connected with the vision camera 2 and the display screen 1, and is configured to acquire first human eye size information of any human eye according to the image information, acquire first distance information from the human eye to the display screen 1 according to the first human eye size information, acquire first offset information of the human eye corresponding to the first human eye size information and second offset information of a pupil in the human eye according to the image information, acquire a gazing area 11 of the corresponding human eye on the display screen 1 according to the first distance information, the first offset information and the second offset information, and control the display screen 1 to display high-refresh-rate picture information in the gazing area 11.
The visual camera 2 comprises an RGB camera, a line-scan camera, an area-scan camera and the like, and the visual camera 2 is used for collecting and generating image information in front of the display screen 1. The obtaining of the first eye size information, the first offset information, and the second offset information from the image information belongs to the prior art, and will not be discussed in detail here. The first human eye size information is the size of human eyes in the image information, for example, the number of pixels and the resolution of the human eyes in the image information, the first human eye size information is preferably the number of pixels of the eye angle distance in the image information, and the size of the human eyes in the image information changes when the distance from the human eyes to the display screen 1 changes, so that the first distance information from the human eyes to the display screen 1 can be acquired according to the first human eye size information of any human eyes. The first offset information is offset of the first human eye size information corresponding to human eyes in the image information, the first offset information can represent offset of the human eyes relative to the display screen 1, that is, the first offset information represents basic displacement of human eye vision, the first offset information can be offset of positions of the human eyes in the image information at the current moment and positions of the human eyes in the image information at the previous moment, the first offset information can also be offset of the human eyes in the image information at the current moment relative to a preset first origin, and the offset can be offset pixel number, offset resolution, offset distance and the like. The second offset information is an offset of a pupil in the image information in the first human eye size information corresponding to the human eye, the second offset information represents a direction of human eye vision, the second offset information may be an offset between a position of the pupil in the image information at the current time in the corresponding human eye and a position of the pupil in the image information at the previous time in the corresponding human eye, the second offset information may also be an offset of the pupil in the image information at the current time with respect to a preset second origin, and the offset may be offset pixel number, offset resolution, offset distance, or the like. The controller 4 is electrically connected with the visual camera 2 and the display screen 1, the controller 4 can acquire image information generated by the visual camera 2, the controller 4 can also control the display screen 1 to display high-refresh-rate picture information in the watching region 11 and control the display screen 1 to display low-refresh-rate picture information outside the watching region 11, the refresh rate of the high-refresh-rate picture information is higher than that of the low-refresh-rate picture information, for example, the refresh rate of the high-refresh-rate picture information is 60Hz, the refresh rate of the low-refresh-rate picture information is 30Hz, for example, the display screen 1 and a picture corresponding to the application compatible refresh rate is greater than 30Hz, the refresh rate of the high-refresh-rate picture information can be 60Hz/90Hz/120Hz/144Hz/240Hz, and the refresh rate of the low-refresh-rate picture information is less than or equal to 30 Hz. For example, a plurality of displays form a display screen 1, the controller 4 acquires a watching region 11 according to the image information, and is a display in the display screen 1, and the controller 4 controls the display to display 60Hz picture information and controls other displays to display 30Hz picture information; for example, in the case of a unified display panel in which the refresh rate can be independently adjusted in different regions, the controller 4 controls the unified display panel to adjust the refresh rate in the region of interest 11 to 60Hz, and controls the unified display panel to adjust the refresh rate outside the region of interest 11 to 30 Hz. It should be understood that the gaze region 11 is a region corresponding to a central angle of view of 30 ° or less.
The workflow of this embodiment is: 1. acquiring image information; 2. acquiring first human eye size information according to the image information; 3. acquiring first distance information from human eyes to the display screen 1 according to the first human eye size information; 4. acquiring first offset information of human eyes and second offset information of pupils relative to the human eyes according to the image information; 5. acquiring a gazing area 11 of human eyes on the display screen 1 according to the first distance information, the first offset information and the second offset information; 6. the display screen 1 is controlled to display high refresh rate picture information within the gazing area 11. In step 3, since the first eye size information is associated with the first distance information from the eyes to the display screen 1, the first distance information can be obtained according to the first eye size information. In step S5, since the first offset information represents the basic displacement of the human eye vision and the second offset information represents the orientation of the human eye vision, the gazing area of the human eye on the display screen can be obtained according to the first distance information, the first offset information and the second offset information. The partitioned display system of this embodiment also enables fast tracking of the gazing area 11 because of the small number of types of data acquired.
The application provides a subregion display system can obtain the region 11 of gazing of people's eye on display screen 1 according to image information to control display screen 1 and show high refresh rate picture information in gazing region 11, because display screen 1 only shows high refresh rate picture information in gazing region 11, the regional reduction that display screen 1 shows high refresh rate picture information, thereby reduced display screen 1's consumption effectively, consequently display screen 1 can realize high refresh rate simultaneously and reduce the power consumption. And the partition display system provided by the application can acquire the fixation area of human eyes on the display screen 1 only according to the image information of any human eye, and the application can effectively reduce the data processing amount for acquiring the fixation area of human eyes on the display screen 1 according to the image information.
Therefore, the partitioned display system provided by the application can acquire the watching area 11 of human eyes on the display screen 1 according to the image information and control the display screen 1 to display the high-refresh-rate picture information in the watching area 11, and as the display screen 1 only displays the high-refresh-rate picture information in the watching area 11, the area of the display screen 1 displaying the high-refresh-rate picture information is reduced, so that the display screen 1 can simultaneously realize high-refresh-rate display and reduce power consumption.
In a second aspect, as shown in fig. 3 to fig. 4, the present application provides a partitioned display method, for reducing power consumption of a display screen 1, and the partitioned display method is applied in a partitioned display system, where the partitioned display system includes the display screen 1 and a visual camera 2, the visual camera 2 is used to collect and generate image information before the display screen 1, and the partitioned display method includes the following steps:
s1, acquiring first human eye size information of any human eye according to the image information;
s2, acquiring first distance information from the human eyes to the display screen 1 according to the first human eye size information;
s3, acquiring first offset information of the human eye corresponding to the first human eye size information and second offset information of the pupil in the human eye according to the image information;
s4, acquiring the watching area 11 of the corresponding human eye on the display screen 1 according to the first distance information, the first offset information and the second offset information;
s5, the display screen 1 is controlled to display the high refresh rate screen information in the attention area 11.
The working principle of the partition display method provided in the embodiment of the present application is the same as that of the partition display system provided in the first aspect, and a detailed discussion is omitted here. According to the partitioned display method, the watching area 11 of human eyes on the display screen 1 can be obtained according to image information, the display screen 1 is controlled to display the high-refresh-rate picture information in the watching area 11, the display screen 1 only displays the high-refresh-rate picture information in the watching area 11, and the area of the display screen 1 for displaying the high-refresh-rate picture information is reduced, so that the display screen 1 can simultaneously achieve high-refresh-rate display and reduce power consumption. In addition, the partition display method can acquire the watching areas of the human eyes on the display screen 1 only according to the image information of any human eye, and the data processing amount of the watching areas of the human eyes on the display screen 1 acquired according to the image information can be effectively reduced.
In some embodiments, step S2 includes the steps of:
and S21, acquiring first distance information from the human eyes to the display screen 1 according to the first human eye size information and a preset first proportional relation.
The first proportional relationship may be a preset value, and the first proportional relationship may also be a ratio of two preset values. For example, the first proportional relationship is a ratio of preset second eye size information to preset third distance information from the eyes to the display screen 1, and the preset second eye size information and the preset third distance information may be obtained in the following manner: and controlling the distance sensor 3 to collect and generate third distance information from the human eyes to the display screen 1 at the moment according to the acquired second human eye size information, wherein the second human eye size information is preferably the number of pixels of the eye distance in the image information. The distance sensor 3 may be an infrared distance measuring sensor, an ultrasonic distance measuring sensor, a TOF sensor, or the like, and the distance sensor 3 is preferably a TOF sensor. According to the embodiment, the first distance information from the human eyes to the display screen 1 can be obtained only through the first human eye size information and the preset first proportional relation, and the distance from the human eyes to the display screen 1 can be calculated only by obtaining various parameters of the two human eyes in the existing partition display method, so that compared with the prior art, the data processing amount for obtaining the first distance information from the human eyes to the display screen 1 can be effectively reduced. The calculation formula of the first distance information is shown as follows:
Figure 907803DEST_PATH_IMAGE001
(1)
wherein the content of the first and second substances,
Figure 746315DEST_PATH_IMAGE002
as the information on the first distance, it is,
Figure 260473DEST_PATH_IMAGE003
number of pixels in image information for eye distanceI.e., first eye size information), a represents the number of pixels in the image information of the preset eye distance (i.e., second eye size information), d represents third distance information of the preset eye to the display screen 1,
Figure 327786DEST_PATH_IMAGE004
is a preset first proportional relation.
In some embodiments, the step of obtaining the first offset information of the human eye according to the image information in the step S3 includes the steps of:
s31, acquiring a first offset pixel number of human eyes according to the image information;
and S32, acquiring first offset information according to the first offset pixel quantity and a preset third proportional relation.
The first offset pixel number in step S31 is an offset of human eyes in the human eye plane, the first offset pixel number may be an offset of a position of human eyes in the image information at the current time in the human eye plane from a position of human eyes in the image information at the previous time in the human eye plane, the first offset information may also be an offset of human eyes in the image information at the current time with respect to an origin of the human eye plane, and the origin of the human eye plane is preferably a human eye center point. The third proportional relationship of step S32 may be a preset value, and the third proportional relationship may also be a ratio of two preset values, for example, the third proportional relationship is a ratio of the preset offset distance of the human eye in the image information to the preset offset pixel number of the human eye in the image information, and the calculation formula of this step is as follows:
Figure 627311DEST_PATH_IMAGE005
(2)
wherein the first offset information includes
Figure 918615DEST_PATH_IMAGE006
And
Figure 857752DEST_PATH_IMAGE007
Figure 40341DEST_PATH_IMAGE006
for the offset distance of the human eye in the x-direction,
Figure 178061DEST_PATH_IMAGE007
for the offset distance of the human eye in the y-direction,
Figure 843529DEST_PATH_IMAGE008
for the number of offset pixels of the human eye in the x-direction of the image information,
Figure 80082DEST_PATH_IMAGE009
e represents the offset distance of the human eye in the preset image information, f represents the offset pixel number of the human eye in the preset image information,
Figure 489197DEST_PATH_IMAGE010
is a third proportional relationship.
In some embodiments, step S4 includes the steps of:
s41, acquiring a fixation center point of human eyes on the display screen 1 according to the first distance information, the first offset information, the second offset information and a preset second proportional relation;
and S42, acquiring the gazing area 11 of the human eyes on the display screen 1 according to the gazing center point, the preset graphic information and the first proportion information.
The second proportional relationship of step S41 may be a preset value, or a ratio of two preset values, for example, when the second proportional relationship is that the distance from the human eye to the display screen 1 is d (preset third distance information from the human eye to the display screen 1) and the position of the human eye is not changed (i.e., there is no first offset information), the preset ratio of the offset of the injection point in the display screen plane to the preset offset of the pupil in the human eye is set, and the offset may be the offset pixel number, the offset resolution, the offset distance, and the like. Preferably, the second proportional relationship is a ratio of an offset distance of the gaze point in the plane of the display screen to a predetermined number of offset pixels of the pupil in the human eye.
The first scale information of the step S42 may be a preset value including a ratio of the first distance information to a reference line and a ratio of any one side of the preset figure information to the reference line, the reference line may be any one side of the preset figure information, a straight line between any two points, etc., the step S42 may be to acquire the gazing area 11 based on the gazing center point, the first distance information, the preset figure information, and the preset first scale information, for example, the coordinate point of the gazing center point is (0, 1), the reference line is a straight line, the preset figure information is a rectangle, the first scale information includes a ratio of a short side of the rectangle to the reference line and a ratio of a long side of the rectangle to the reference line, the ratio of a short side of the rectangle to the reference line is 1.5:1, the ratio of the short side of the rectangle to the reference line is 2.5:1, the ratio of the first distance information to the reference line is 20:1, if the first distance information is 80cm, the length of the reference line is 4cm, the length of the short side is 6cm, the length of the long side is 10cm, and the fixation area 11 is a rectangle with a center point of (0, 1), a short side of 6cm, and a long side of 10 cm. Step S42 may be to obtain the scaling ratio according to the first distance information, and the obtaining process is: obtaining a scaling ratio according to the first distance information and a preset distance, and obtaining the gazing area 11 according to the preset graphic information and the scaling ratio, for example, the coordinate point gazing the central point is (0, 0), the preset graphic information is a rectangle with a long side and a short side being 4cm and 3cm respectively, the first distance information is 60cm, the preset distance is 40cm, and the scaling ratio is 60 cm: 40cm =1.5, and the gazing area obtained from the scaling and the graphic information is a rectangle having a center point of (0, 0) and long and short sides of 6cm and 4.5cm, respectively. It should be understood that the graphic information may be a rectangle, a circle, a triangle, etc., and the graphic information is preferably a rectangle.
Referring to fig. 4, in some embodiments, step S41 includes the steps of:
s411, acquiring second proportion information according to the first distance information, the preset third distance information and the preset fourth distance information;
s412, acquiring third offset information according to the second offset information, the second proportional relation and the second proportional information;
and S413, acquiring a fixation center point of human eyes on the display screen 1 according to the first offset information and the third offset information.
The fourth distance information of step S411 is the distance from the human eye to the display screen 1 when the gazing area just covers the entire display screen 1, and the second proportional information of step S411 can convert the second offset information acquired when the distance from the human eye to the display screen 1 is the first distance information into the first actual offset of the pupil in the human eye when the distance from the human eye to the display screen 1 is the third distance information (x in fig. 4) 2 ') the first actual offset amount may be an offset pixel number, an offset resolution, an offset distance, etc. The calculation formula of the second proportion information is as follows:
Figure 481424DEST_PATH_IMAGE011
(3)
wherein β is the second ratio information, D is the preset fourth distance information, D 1 D is preset third distance information.
Step S412 first obtains a first actual offset of the pupil in the human eye when the distance from the human eye to the display screen 1 is a preset third distance information according to the second offset information and the second proportional information, and then obtains a second actual offset (i.e., third offset information) of the pupil in the display screen plane according to the first actual offset and the second proportional relationship, where the third offset information is an offset of the injection point in the display screen plane due to the change of the position of the pupil. The calculation formula of step S412 is shown as follows:
Figure 894957DEST_PATH_IMAGE012
(4)
wherein the second offset information includes
Figure 808686DEST_PATH_IMAGE013
And
Figure 772225DEST_PATH_IMAGE014
the third offset information includes
Figure 353379DEST_PATH_IMAGE015
And
Figure 344338DEST_PATH_IMAGE016
and beta is the second ratio information,
Figure 807680DEST_PATH_IMAGE013
representing the offset distance of the pupil in the image information in the x-direction in the human eye,
Figure 300542DEST_PATH_IMAGE014
the shift distance of the pupil in the image information in the y direction of the human eye is represented, h represents the preset shift distance of the injection point in the plane of the display screen when the distance from the human eye to the display screen 1 is the preset third distance information from the human eye to the display screen 1 and the position of the human eye is not changed, g represents the preset shift distance of the pupil in the human eye when the distance from the human eye to the display screen 1 is the preset third distance information from the human eye to the display screen 1,
Figure 267361DEST_PATH_IMAGE017
represents a second predetermined proportional relationship with respect to the first,
Figure 773429DEST_PATH_IMAGE015
representing the offset distance of the pupil in the x-direction in the plane of the display screen,
Figure 645439DEST_PATH_IMAGE016
representing the offset distance of the pupil in the y-direction in the plane of the display screen.
Since the first offset information is an offset of the human eye relative to the display screen 1, and the third offset information is a second actual offset of the pupil in the plane of the display screen, step S413 can obtain the gazing center point according to the first offset information and the third offset information. The calculation formula of step S413 is shown as follows:
Figure 262365DEST_PATH_IMAGE018
(5)
wherein the gaze center point comprises x and y,
Figure 286953DEST_PATH_IMAGE019
representing the offset distance of the human eye in the x-direction in the plane of the display screen,
Figure 714654DEST_PATH_IMAGE020
representing the offset distance of the human eye in the y-direction in the plane of the display screen,
Figure 621430DEST_PATH_IMAGE015
representing the offset distance of the pupil in the x-direction in the plane of the display screen,
Figure 714151DEST_PATH_IMAGE016
representing the shift distance of the pupil in the y-direction in the plane of the display screen, x representing the shift distance of the gaze center point in the x-direction in the plane of the display screen, and y representing the shift distance of the gaze center point in the y-direction in the plane of the display screen.
In the above embodiment, since the first distance information is derived from the first eye size information, and a certain error may exist between the first eye size information obtained according to the image information and an actual eye size, a certain error may exist between the first distance information and an actual distance from the eye to the display screen 1, so that the obtained gazing center point is not accurate enough. Therefore, in some preferred embodiments, the partition display system further includes a distance sensor 3, the distance sensor 3 is used for collecting and generating second distance information from the human eye to the display screen 1, and the step S41 includes the following steps:
s411', acquiring a correction coefficient according to the first distance information and the second distance information;
s412', second proportion information is obtained according to the first distance information and preset third distance information;
s413', acquiring third offset information according to the second offset information, the second proportional relation and the second proportional information;
and S414, acquiring the fixation center point of the human eyes on the display screen 1 according to the first deviation information and the third deviation information.
Wherein, the calculation formula of step S411' is shown as follows:
Figure 170409DEST_PATH_IMAGE021
(6)
wherein the content of the first and second substances,
Figure 752700DEST_PATH_IMAGE022
which represents the correction coefficient(s) of the image,
Figure 350035DEST_PATH_IMAGE023
the first distance information is represented by a first distance information,
Figure 790987DEST_PATH_IMAGE024
indicating the second distance information.
The second proportional information in step S412' is a ratio of the first distance information and the third distance information, and the second proportional information can convert second offset information obtained when the distance from the human eye to the display screen 1 is the first distance information into an actual offset of the pupil in the human eye when the distance from the human eye to the display screen 1 is the third distance information, where the actual offset may be offset pixel number, offset resolution, offset distance, and the like. The calculation formula of step S412' is the same as equation (3).
In step S413', a first actual offset of the pupil in the human eye when the distance from the human eye to the display screen 1 is the preset third distance information is obtained according to the second offset information and the second proportional information, and then a second actual offset (i.e. the third offset information) of the pupil in the plane of the display screen is obtained according to the first actual offset and the second proportional relation. The calculation formula of step S413' is the same as that of equation (4).
Since the first offset information is an offset of the human eye with respect to the display screen 1, the third offset information is a second actual offset of the pupil in the plane of the display screen, and the correction coefficient can be used to correct the first offset information, step S414 can obtain the gazing center point according to the first offset information and the third offset information. The calculation formula of step S414 is shown as follows:
Figure 586905DEST_PATH_IMAGE025
(7)
wherein the gaze center point comprises x and y,
Figure 340097DEST_PATH_IMAGE022
which is indicative of a correction factor that is,
Figure 673995DEST_PATH_IMAGE019
representing the offset distance of the human eye in the x-direction in the plane of the display screen,
Figure 170836DEST_PATH_IMAGE020
representing the offset distance of the human eye in the y-direction in the plane of the display screen,
Figure 86839DEST_PATH_IMAGE015
representing the offset distance of the pupil in the x-direction in the plane of the display screen,
Figure 699348DEST_PATH_IMAGE016
representing the shift distance of the pupil in the y-direction in the plane of the display screen, x representing the shift distance of the gaze center point in the x-direction in the plane of the display screen, and y representing the shift distance of the gaze center point in the y-direction in the plane of the display screen.
The second distance information acquired and generated by the distance sensor 3 in the embodiment can accurately reflect the actual distance from human eyes to the display screen 1, so that the correction coefficient acquired according to the first distance information and the second distance information can correct the first offset information to correct errors generated when the first human eye size information is acquired according to the image information, and the accuracy of acquiring the gazing center point of human eyes on the display screen 1 is further improved.
In some embodiments, step S5 includes the steps of:
and S51, controlling the display screen 1 to display the first picture information in the watching area 11, and controlling the display screen 1 to display the second picture information outside the watching area 11, wherein the refresh rate of the first picture information is higher than that of the second picture information.
In some embodiments, the gazing area 11 is further provided with a transition area, the refresh rate of the display screen 1 in the transition area is gradually reduced along the direction from the center of the display screen 1 to the edge of the display screen 1, for example, the region in the gazing area 11 displays the picture information with the refresh rate of 60Hz, the region outside the transition area 11 displays the picture information with the refresh rate of 30Hz, and the refresh rate in the transition area is gradually reduced from 60Hz to 30Hz along the direction from the center of the display screen 1 to the edge of the display screen 1. In other embodiments, a transition region is further disposed outside the gazing region 11, the high-refresh-rate picture information is displayed in the gazing region 11, the medium-refresh-rate picture information is displayed in the transition region, the low-refresh-rate picture information is displayed in a region outside the gazing region 11 except the transition region, the refresh rate of the high-refresh-rate picture information is greater than the refresh rate of the medium-refresh-rate picture information, the refresh rate of the medium-refresh-rate picture information is greater than the refresh rate of the low-refresh-rate picture information, for example, picture information with a refresh rate of 90Hz is displayed in the gazing region 11, picture information with a refresh rate of 60Hz is displayed in the transition region, and picture information with a refresh rate of 30Hz is displayed in a region outside the gazing region 11 except the transition region.
In some embodiments, step S1 is preceded by the step of:
and S6, acquiring the proportion information of the pupil in the human eye according to the image information, and watching the human eye to watch the display screen 1 if the proportion information is larger than or equal to a preset second threshold value.
If the ratio information is smaller than the preset second threshold, the human eyes do not watch the display screen 1, and step S1 is not executed; if the ratio information is greater than or equal to the preset second threshold, the viewer looks at the display screen 1, and then step S1 is executed.
From the above, according to the partitioned display method provided by the application, the gazing area 11 of human eyes on the display screen 1 can be obtained according to the image information, and the display screen 1 is controlled to display the high-refresh-rate picture information in the gazing area 11, and since the display screen 1 only displays the high-refresh-rate picture information in the gazing area 11, the area of the display screen 1 displaying the high-refresh-rate picture information is reduced, so that the display screen 1 can simultaneously achieve high-refresh-rate display and reduce power consumption.
In a third aspect, referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the present application provides an electronic device including: the processor 401 and the memory 402, the processor 401 and the memory 402 are interconnected and communicate with each other through a communication bus 403 and/or other forms of connection mechanism (not shown), the memory 402 stores a computer program executable by the processor 401, and when the computing device runs, the processor 401 executes the computer program to perform the method in any alternative implementation of the embodiment to realize the following functions: acquiring first human eye size information of any human eye according to the image information; acquiring first distance information from human eyes to the display screen 1 according to the first human eye size information; acquiring first offset information of the first human eye size information corresponding to the human eyes and second offset information of pupils in the human eyes according to the image information; acquiring a watching area 11 of the corresponding human eye on the display screen 1 according to the first distance information, the first offset information and the second offset information; the display screen 1 is controlled to display high refresh rate picture information within the gazing area 11.
In a fourth aspect, the present application provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program executes the method in any optional implementation manner of the embodiments to implement the following functions: acquiring first human eye size information of any human eye according to the image information; acquiring first distance information from human eyes to the display screen 1 according to the first human eye size information; acquiring first offset information of the first human eye size information corresponding to the human eye and second offset information of the pupil in the human eye according to the image information; acquiring a watching area 11 of the corresponding human eye on the display screen 1 according to the first distance information, the first offset information and the second offset information; the display screen 1 is controlled to display high refresh rate picture information within the gazing area 11. The storage medium may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as a Static Random Access Memory (SRAM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), an Erasable Programmable Read-Only Memory (EPROM), a Programmable Read-Only Memory (PROM), a Read-Only Memory (ROM), a magnetic Memory, a flash Memory, a magnetic disk, or an optical disk.
It can be known from the above that, according to the partition display method, system, electronic device and storage medium provided in the present application, the gaze area 11 of human eyes on the display screen 1 can be obtained according to the image information, and the display screen 1 is controlled to display the high refresh rate picture information in the gaze area 11, because the display screen 1 only displays the high refresh rate picture information in the gaze area 11, the area of the display screen 1 displaying the high refresh rate picture information is reduced, and therefore the display screen 1 can simultaneously achieve high refresh rate display and reduce power consumption.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, for example, the division of the above-described units is only a logical functional division, and other division manners may be available in actual implementation, and for example, a plurality of units or components may be combined or integrated into another robot, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
In addition, units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may ascend to one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
Furthermore, the functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (10)

1. A partitioned display method for reducing power consumption of a display screen (1) is applied in a partitioned display system, the partitioned display system comprises the display screen (1) and a visual camera (2), the visual camera (2) is used for collecting image information before the display screen (1) is generated, and the partitioned display method is characterized by comprising the following steps:
acquiring first human eye size information of any human eye according to the image information;
acquiring first distance information from the human eyes to the display screen (1) according to the first human eye size information;
acquiring first offset information of the human eyes corresponding to the first human eye size information and second offset information of pupils in the human eyes according to the image information;
acquiring a watching area (11) of a corresponding human eye on the display screen (1) according to the first distance information, the first offset information and the second offset information;
and controlling the display screen (1) to display high-refresh-rate picture information in the watching area (11).
2. The zone display method according to claim 1, wherein the step of obtaining first distance information of the human eye from the display screen (1) according to the first human eye size information comprises the steps of: and acquiring first distance information from the human eyes to the display screen (1) according to the first human eye size information and a preset first proportional relation.
3. The zone display method according to claim 1, wherein the step of obtaining a gaze area (11) of a corresponding human eye on the display screen (1) based on the first distance information, the first offset information and the second offset information comprises the steps of:
acquiring a watching center point of the corresponding human eye on the display screen (1) according to the first distance information, the first deviation information, the second deviation information and a preset second proportional relation;
and acquiring a watching area (11) of the human eyes on the display screen (1) according to the watching central point, preset graphic information and proportion information.
4. The method for displaying in subareas according to claim 3, wherein the subarea display system further comprises a distance sensor (3), the distance sensor (3) is configured to collect second distance information from the generated human eye to the display screen (1), and the step of obtaining the gazing center point of the corresponding human eye on the display screen (1) according to the first distance information, the first offset information, the second offset information and a preset second proportional relationship comprises the steps of:
acquiring a correction coefficient according to the first distance information and the second distance information;
acquiring second proportional information according to the first distance information and preset third distance information;
acquiring third offset information according to the second offset information, a preset second proportional relation and the second proportional information;
and acquiring a fixation central point of a corresponding human eye on the display screen (1) according to the first deviation information and the third deviation information.
5. The partition display method according to claim 3, wherein the step of obtaining the gazing center point of the corresponding human eye on the display screen (1) according to the first distance information, the first offset information, the second offset information and a preset second proportional relationship comprises the following steps:
acquiring second proportion information according to the first distance information, preset third distance information and preset fourth distance information;
acquiring third offset information according to the second offset information, a preset second proportional relation and the second proportional information;
and acquiring a fixation central point of a corresponding human eye on the display screen (1) according to the first offset information and the third offset information.
6. The method of claim 1, wherein the step of controlling the display screen (1) to display high refresh rate picture information within the gazing area (11) comprises the steps of:
controlling the display screen (1) to display first picture information in the gazing area (11);
and controlling the display screen (1) to display second picture information outside the watching area (11), wherein the refresh rate of the first picture information is higher than that of the second picture information.
7. The partition display method according to claim 1, wherein the step of obtaining first human eye size information from the image information further comprises the steps of:
and obtaining the proportion information of the pupil in the human eye according to the image information, and if the proportion information is larger than or equal to a preset second threshold value, watching the human eye to watch the display screen (1).
8. A partitioned display system for reducing power consumption of a display screen (1), comprising the display screen (1) and a visual camera (2), the visual camera (2) being adapted to collect image information generated before the display screen (1), characterized in that the partitioned display system further comprises:
the controller (4) is used for obtaining first human eye size information of any human eye according to the image information, obtaining first human eye size information of the human eye according to the first human eye size information, obtaining first distance information of the human eye to the display screen (1), obtaining first deviation information of the human eye corresponding to the first human eye size information and second deviation information of a pupil in the human eye according to the image information, obtaining corresponding human eye according to the first distance information, the first deviation information and the second deviation information, obtaining a watching area (11) on the display screen (1), and controlling the display screen (1) to display high-refresh-rate picture information in the watching area (11).
9. An electronic device comprising a processor and a memory, said memory storing computer readable instructions which, when executed by said processor, perform the steps of the method according to any one of claims 1 to 7.
10. A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, performs the steps of the method according to any one of claims 1-7.
CN202210711264.2A 2022-06-22 2022-06-22 Partition display method, system, electronic equipment and storage medium Pending CN114935976A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210711264.2A CN114935976A (en) 2022-06-22 2022-06-22 Partition display method, system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210711264.2A CN114935976A (en) 2022-06-22 2022-06-22 Partition display method, system, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114935976A true CN114935976A (en) 2022-08-23

Family

ID=82869112

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210711264.2A Pending CN114935976A (en) 2022-06-22 2022-06-22 Partition display method, system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114935976A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115547264A (en) * 2022-11-07 2022-12-30 北京显芯科技有限公司 Backlight dimming method and system based on human eye tracking
CN116795212A (en) * 2023-06-19 2023-09-22 深圳市晚成辉电子有限公司 Control method of plasma display screen

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104133548A (en) * 2013-05-03 2014-11-05 中国移动通信集团公司 Method and device for determining viewpoint area and controlling screen luminance
US20160180762A1 (en) * 2014-12-22 2016-06-23 Elwha Llc Systems, methods, and devices for controlling screen refresh rates
CN106652972A (en) * 2017-01-03 2017-05-10 京东方科技集团股份有限公司 Processing circuit of display screen, display method and display device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104133548A (en) * 2013-05-03 2014-11-05 中国移动通信集团公司 Method and device for determining viewpoint area and controlling screen luminance
US20160180762A1 (en) * 2014-12-22 2016-06-23 Elwha Llc Systems, methods, and devices for controlling screen refresh rates
CN106652972A (en) * 2017-01-03 2017-05-10 京东方科技集团股份有限公司 Processing circuit of display screen, display method and display device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115547264A (en) * 2022-11-07 2022-12-30 北京显芯科技有限公司 Backlight dimming method and system based on human eye tracking
CN116795212A (en) * 2023-06-19 2023-09-22 深圳市晚成辉电子有限公司 Control method of plasma display screen
CN116795212B (en) * 2023-06-19 2024-03-01 深圳市晚成辉电子有限公司 Control method of plasma display screen

Similar Documents

Publication Publication Date Title
CN114935976A (en) Partition display method, system, electronic equipment and storage medium
CN106652972B (en) Processing circuit of display screen, display method and display device
EP2075761B1 (en) Method and device for adjusting output frame
US20190121428A1 (en) Adaptive parallax adjustment method and virtual reality display device
CN103915041B (en) Flexible display screen curved surface self-checking device and method
CN111640390A (en) Display screen flicker adjusting circuit and method and display device
CN107247571B (en) Display device and display method thereof
CN109741289B (en) Image fusion method and VR equipment
CN101465116B (en) Display equipment and control method thereof
KR20140086463A (en) Image transformation apparatus and the method
CN106775518B (en) Method and system for changing image size of spliced screen according to distance of viewer
US20170206823A1 (en) Display driving device and methods of operation thereof
CN109725730B (en) Head-mounted display device and driving method thereof, display system and driving method thereof
CN115223514B (en) Liquid crystal display driving system and method capable of intelligently adjusting parameters
US20190027118A1 (en) Terminal device and display method
CN105825840A (en) Optical compensating method and device and display panel
CN106713894A (en) Tracking stereo display method and device
CN113903078A (en) Human eye gaze detection method, control method and related equipment
CN109271123B (en) Picture display method and picture display device
CN104915166B (en) Information processing method and electronic equipment
CN107291237A (en) Information processing method and wear-type electronic equipment
CN110211543B (en) Local backlight adjusting method and device and virtual reality system
CN111540335A (en) Color blindness correction device, method, intelligent glasses, controller and medium
US11715425B2 (en) Display method, display device, display system and storage medium
CN114911445A (en) Display control method of virtual reality device, and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination