CN106851147B - The method and device in OSD menu region is determined in the terminal for playing external video - Google Patents

The method and device in OSD menu region is determined in the terminal for playing external video Download PDF

Info

Publication number
CN106851147B
CN106851147B CN201710081816.5A CN201710081816A CN106851147B CN 106851147 B CN106851147 B CN 106851147B CN 201710081816 A CN201710081816 A CN 201710081816A CN 106851147 B CN106851147 B CN 106851147B
Authority
CN
China
Prior art keywords
pixel
frame image
current frame
collection
osd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710081816.5A
Other languages
Chinese (zh)
Other versions
CN106851147A (en
Inventor
刘国卿
田广
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huaya Microelectronics Shanghai Inc
Original Assignee
Huaya Microelectronics Shanghai Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huaya Microelectronics Shanghai Inc filed Critical Huaya Microelectronics Shanghai Inc
Priority to CN201710081816.5A priority Critical patent/CN106851147B/en
Publication of CN106851147A publication Critical patent/CN106851147A/en
Application granted granted Critical
Publication of CN106851147B publication Critical patent/CN106851147B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a kind of method and devices that OSD menu region is determined in the terminal for playing external video, belong to field of display technology.It include the pixel for meeting preset condition in the first pixel collection this method comprises: determining the first pixel collection from current frame image;From the first pixel collection, selection and the co-located pixel of OSD pixel obtain the second pixel collection, and OSD pixel is the pixel where with OSD menu region in multiple continuous images of current frame image;The OSD menu region in current frame image is determined based on the pixel in the second pixel collection.The present invention, which passes through, determines the first pixel collection and the second pixel collection, and OSD menu region is determined based on the second pixel collection, to can only be handled the region except OSD menu region when image procossing, and then OSD menu is avoided to be distorted, show that OSD menu normally.

Description

The method and device in OSD menu region is determined in the terminal for playing external video
Technical field
It is the present invention relates to field of display technology, in particular to a kind of that OSD menu is determined in the terminal for playing external video The method and device in region.
Background technique
With the fast development of display technology, terminal has more and more display functions, for example people can be by TV It is connected with computer or set-top box, and passes through the video of video or viewing set-top box transmission in television-viewing computer.It is seeing During seeing video, people can also pass through computer or OSD (On Screen Display, screen are shown) dish of set-top box It sets up and sets the display properties such as brightness or contrast, and replacement channel etc., can show video and OSD on TV simultaneously at this time Menu.
For ease of description, the terminal of the transmission video such as computer or set-top box is known as first terminal, TV etc. is used for The terminal for playing video is known as second terminal.When second terminal needs show OSD menu while showing video, first eventually OSD menu and video frame images can be overlapped by end, synthesize an image, OSD menu is located at the figure under normal circumstances The middle region of picture, other regions are video frame images, and then the image of synthesis is sent to second terminal by first terminal, the Two terminals receive and show the image of synthesis.
However, since the image that second terminal is shown is the image after OSD menu and video frame images synthesis, so working as When second terminal carries out image quality processing to the image of synthesis, may the part to OSD menu also handle together, to make It is distorted, can not normally show at OSD menu, therefore, a kind of method that can determine OSD menu region is needed, at image quality The display area of OSD menu can be avoided when reason, and then avoids the distortion of OSD menu.
Summary of the invention
In order to solve problems in the prior art, it is true in the terminal for playing external video that the embodiment of the invention provides a kind of Determine the method and device in OSD menu region.The technical solution is as follows:
On the one hand, a kind of method that OSD menu region is determined in the terminal for playing external video, the method are provided Include:
From current frame image, the first pixel collection is determined, include meeting default item in first pixel collection The pixel of part;
Wherein, the preset condition includes: that the edge size of pixel is more than or equal to the first default size and pixel Brightness and previous frame image in same position pixel brightness between difference be less than predetermined luminance, the edge size is Brightness step of the pixel in edge direction;
From first pixel collection, selection and the co-located pixel of OSD pixel obtain the second picture Vegetarian refreshments set, the OSD pixel are the picture where OSD menu region in multiple continuous images before the current frame image Vegetarian refreshments;
The OSD menu region in the current frame image is determined based on the pixel in second pixel collection.
Optionally, described from first pixel collection, selection and the co-located pixel of OSD pixel Point obtains the second pixel collection, comprising:
Determine the neighborhood territory pixel point number of each pixel in first pixel collection, the neighborhood territory pixel point number To be in the pixel number in pixel neighborhood of a point in first pixel collection, the size of the neighborhood is second default Size;
From first pixel collection, neighborhood territory pixel point number is selected to be greater than or equal to the pixel of predetermined number, Obtain third pixel collection;
From the third pixel collection, selection and the co-located pixel of OSD pixel obtain the second picture Vegetarian refreshments set.
Optionally, the preset condition further includes at least one of following condition:
Same position in the edge direction of the pixel previous frame image adjacent with the current frame image in current frame image Angle between the edge direction for the pixel set is less than default angle;
The brightness variance of pixel is greater than or equal to the first default variance in current frame image;
The brightness of the brightness variance of pixel and the pixel of same position in the previous frame image in current frame image Difference between variance is less than the second default variance.
Optionally, the pixel based in second pixel collection determines the OSD in the current frame image Menu area, comprising:
OSD pixel area encompassed in second pixel collection being determined as in the current frame image Menu area.
Optionally, the pixel based in second pixel collection determines the OSD in the current frame image Menu area, comprising:
From second pixel collection, determine that multiple boundary pixel points, the multiple boundary pixel point are respectively cross Coordinate minimum or maximum and ordinate minimum or maximum pixel;
The rectangular area that the multiple boundary pixel point is surrounded is determined as to the OSD menu area in the current frame image Domain.
Optionally, the pixel based in second pixel collection determines the OSD in the current frame image Menu area, comprising:
From second pixel collection, multiple pixels are selected, the phase of each pixel in the multiple pixel Adjacent pixel belongs to second pixel collection;
The multiple pixel area encompassed is determined as to the OSD menu region in the current frame image.
Optionally, the pixel based in second pixel collection determines the OSD in the current frame image After menu area, further includes:
It is described to being removed in the current frame image when receiving the image processing commands for the current frame image Region except OSD menu region carries out image procossing.
On the other hand, a kind of device that OSD menu region is determined in the terminal for playing external video, the dress are provided It sets and includes:
First determining module, for determining the first pixel collection, first pixel collection from current frame image In include meeting the pixel of preset condition;
Wherein, the preset condition includes: that the edge size of pixel is more than or equal to the first default size and pixel Brightness and previous frame image in same position pixel brightness between difference be less than predetermined luminance, side edge size The brightness step for being pixel in edge direction;
Selecting module, for selecting and the co-located pixel of OSD pixel from first pixel collection Point, obtains the second pixel collection, and the OSD pixel is OSD dish in multiple continuous images before the current frame image Pixel where single region;
Second determining module, for being determined in the current frame image based on the pixel in second pixel collection OSD menu region.
Optionally, the selecting module includes:
First determination unit, for determining the neighborhood territory pixel point number of each pixel in first pixel collection, The neighborhood territory pixel point number is the pixel number in first pixel collection in pixel neighborhood of a point, the neighbour The size in domain is the second default size;
First selecting unit, for selecting neighborhood territory pixel point number to be greater than or equal to from first pixel collection The pixel of predetermined number obtains third pixel collection;
Second selecting unit, for from the third pixel collection, selection and OSD pixel to be co-located Pixel obtains the second pixel collection.
Optionally, the preset condition further includes at least one of following condition:
Same position in the edge direction of the pixel previous frame image adjacent with the current frame image in current frame image Angle between the edge direction for the pixel set is less than default angle;
The brightness variance of pixel is greater than or equal to the first default variance in current frame image;
The brightness of the brightness variance of pixel and the pixel of same position in the previous frame image in current frame image Difference between variance is less than the second default variance.
Optionally, second determining module includes:
Second determination unit, it is described for the pixel area encompassed in second pixel collection to be determined as OSD menu region in current frame image.
Optionally, second determining module includes:
Third determination unit, for determining multiple boundary pixel points, the multiple side from second pixel collection Boundary's pixel is respectively minimum abscissa or maximum and ordinate minimum or maximum pixel;
4th determination unit, the rectangular area for being surrounded the multiple boundary pixel point are determined as the present frame OSD menu region in image.
Optionally, second determining module includes:
Third selecting unit, for selecting multiple pixels, the multiple pixel from second pixel collection In the neighbor pixel of each pixel belong to second pixel collection;
5th determination unit, for the multiple pixel area encompassed to be determined as in the current frame image OSD menu region.
Optionally, described device further include:
Processing module, for when receiving the image processing commands for the current frame image, to the present frame Region in image in addition to the OSD menu region carries out image procossing.
Technical solution provided in an embodiment of the present invention has the benefit that in embodiments of the present invention, first basis The pixel for meeting preset condition in current frame image determines the first pixel collection, thus select in the edge OSD can The energy biggish pixel of property, then from the first pixel collection, selection and the co-located pixel of OSD pixel, The second pixel collection is obtained, to further be screened to the pixel in the first pixel collection, and then is improved really The accuracy in the OSD menu region in settled prior image frame can needle when needing to carry out image procossing to current frame image Image procossing is carried out to the region in addition to OSD menu region, without handling OSD menu region, to avoid OSD dish Single distortion, so that OSD menu still can normally be shown after carrying out image quality processing to current frame image.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Figure 1A is a kind of OSD menu region method determining in the terminal for playing external video provided in an embodiment of the present invention Flow chart;
Figure 1B is the schematic diagram of neighborhood of pixel points provided in an embodiment of the present invention;
Fig. 1 C (a) is the schematic diagram of each pixel in the first pixel collection provided in an embodiment of the present invention;
Fig. 1 C (b) is that terminal provided in an embodiment of the present invention corrodes each pixel in the first pixel collection The schematic diagram of the pixel obtained after operation;
Fig. 1 D (a) is that terminal provided in an embodiment of the present invention corrodes each pixel in the first pixel collection The schematic diagram of the pixel obtained after operation;
Fig. 1 D (b) is terminal provided in an embodiment of the present invention to by each pixel in the current frame image of erosion operation Point carries out the schematic diagram of the pixel obtained after dilation operation;
Fig. 2A is a kind of OSD menu regional device determining in the terminal for playing external video provided in an embodiment of the present invention Block diagram;
Fig. 2 B is a kind of block diagram of selecting module provided in an embodiment of the present invention;
Fig. 2 C is a kind of block diagram of second determining module provided in an embodiment of the present invention;
Fig. 2 D is the block diagram of another second determining module provided in an embodiment of the present invention;
Fig. 2 E is the block diagram of the third the second determining module provided in an embodiment of the present invention;
Fig. 2 F is that another OSD menu region determining in the terminal for playing external video provided in an embodiment of the present invention fills The block diagram set.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
The embodiment of the invention provides it is a kind of play external video terminal in determine OSD menu region method, In, the terminal for playing external video can be the terminals such as smart television or computer, referring to Figure 1A, this method comprises:
Step 101: from current frame image, determining the first pixel collection, include meeting in first pixel collection The pixel of preset condition.
Wherein, for each pixel in current frame image, terminal first determines whether the pixel meets default item Part, then from current frame image, selection meets the pixel of preset condition, and pixel composed by the pixel by selection Set is determined as the first pixel collection.Wherein, which includes but is not limited to following condition:
(1) the edge size of pixel is more than or equal to the first default size in current frame image, which is pixel Brightness step of the point in edge direction;
(2) difference in current frame image in the brightness of pixel and previous frame image between the brightness of same position pixel Value is less than predetermined luminance.
Wherein, when in the preset condition including above-mentioned condition (1) and (2), terminal can pass through following step (1) and step Suddenly (2) determine whether each pixel in current frame image meets preset condition:
Step (1): for each pixel in current frame image, terminal can determine the pixel in current frame image Edge direction on edge size, then terminal is by the edge size and the in the edge direction of pixel in current frame image One default size is compared, if the edge size is greater than or equal to the first default size, it is determined that in current frame image The pixel meets condition (1), if the edge size is less than the first default size, it is determined that the pixel in current frame image Point is unsatisfactory for condition (1).
It should be noted that the edge direction can be size maximum preset direction in edge in multiple preset directions, It is for each preset direction in multiple preset directions, when brightness step of some pixel on the preset direction is maximum When, which is determined as to the edge direction of the pixel, and the edge on the preset direction is sized to this Edge size in the edge direction of pixel.Certainly, in practical application, when multiple preset direction includes horizontal direction and is hung down Histogram to when, the edge direction of pixel can also be the ratio of vertical direction top edge size and horizontal direction top edge size Arc-tangent value indicated by direction, that is to say that the angle between the edge direction and horizontal direction is the arc-tangent value, the picture The edge size of vegetarian refreshments can be the arithmetic square of vertical direction top edge size and the quadratic sum of horizontal direction top edge size Root, or can for vertical direction top edge size absolute value and horizontal direction top edge size absolute value and.Wherein Edge size is for indicating brightness step of the pixel on the preset direction, and edge size is bigger, indicates the pixel Brightness step in edge direction is bigger, and edge size is smaller, indicates that brightness step of the pixel in edge direction is got over It is small.
For example, multiple preset direction can be in 45 degree of direction for horizontal direction x, vertical direction y and horizontal direction x Xy and be in 135 degree of direction yx with horizontal direction x, and for any pixel point in current frame image, the pixel is in the side x Upward edge size can be Ex, and edge size in y-direction can be Ey, and the edge size on the direction xy can be Exy, the edge size on the direction yx can be Eyx, and when the value maximum of Ex in Ex, Ey, Exy and Eyx, terminal can be by water Square it is determined as the edge direction of the pixel to x, and the edge size Ex on x in the horizontal direction is determined as the pixel Edge size.
For another example, multiple preset direction can be horizontal direction x and vertical direction y, and in current frame image Any pixel point, the edge size of the pixel in the x direction can be Ex, and edge size in y-direction can be Ey, The edge direction of the pixel can beThe edge size of the pixel can beOr | Ex|+|Ey|。
Step (2): each pixel for meeting above-mentioned condition (1), terminal can determine the brightness of the pixel, It is the pixel value of the determining pixel, then each pixel from the previous frame image adjacent with current frame image of storage Brightness in, can determine the brightness of the pixel co-located with the pixel in current frame image, terminal can be true In the brightness of the fixed pixel and the previous frame image adjacent with current frame image between the brightness of the pixel of same position Difference, and the difference is compared with predetermined luminance, if the difference is less than predetermined luminance, it is determined that the pixel meets item Part (2), if the difference is greater than or equal to predetermined luminance, it is determined that the pixel is unsatisfactory for condition (2).
Since the brightness step between edge pixel point and non-edge pixels point can be bigger, and non-edge pixels point with it is non- Brightness step between edge pixel point can be smaller, and therefore, when the preset condition includes above-mentioned condition (1), terminal can be with From current frame image, selects the edge size in edge direction to be greater than or equal to the pixel of the first default size, that is to say The pixel in any graphic edge in current frame image is selected, and the pixel for selecting, the pixel both may be used It can be in the edge of OSD in current frame image, it is also possible to the edge of the figure in current frame image in addition to OSD.
Further, since current frame image is relative to the previous frame image adjacent with current frame image, video image Part may change, and the part of OSD will not then change, and that is to say for the two field pictures of front and back, the portion OSD The brightness divided will not change, therefore, when the preset condition further includes above-mentioned condition on the basis of including above-mentioned condition (1) (2) when, terminal can select brightness and current frame image phase from each pixel for meeting condition (1) in current frame image Difference in adjacent previous frame image between the brightness of the pixel of same position is less than the pixel of predetermined luminance, that is to say choosing The pixel that brightness does not change in the two field pictures of front and back or brightness change is minimum is selected, thus from the picture of multiple graphic edges In vegetarian refreshments, the pixel in the edge OSD is selected.
It should be noted that the preset condition not only may include above-mentioned two condition, in practical application, in order to improve really Determine the accuracy in OSD menu region, which can also include at least one of following condition (3), (4), (5):
(3) same position in the edge direction of the pixel previous frame image adjacent with current frame image in current frame image Pixel edge direction between angle be less than default angle.
(4) the brightness variance of pixel is greater than or equal to the first default variance in current frame image.
(5) in current frame image in the brightness variance of pixel and previous frame image the pixel of same position brightness side Difference between difference is less than the second default variance.
Since when preset condition difference, terminal judges whether each pixel in current frame image meets preset condition Method it is also different, therefore, terminal judges whether each pixel in current frame image meets the mode of preset condition and wrapping It includes on the basis of whether the above-mentioned each pixel judged in current frame image meet condition (1) and the mode of (2), can also wrap Include at least one of following three kinds of modes:
First way: when the preset condition further includes above-mentioned condition (3), for meeting above-mentioned item in current frame image Each pixel of part (1) and (2), terminal can determine the edge direction of the pixel in current frame image, then from storage The previous frame image adjacent with current frame image in each pixel edge direction in, can determine in current frame image The edge direction of the co-located pixel of the pixel, terminal can determine the edge side of pixel in current frame image To and with angle in the adjacent previous frame image of current frame image between the edge direction of the pixel of same position, and will be true Fixed angle is compared with default angle, if the angle is less than default angle, it is determined that the pixel in current frame image Point meets condition (3), if the angle is greater than or equal to default angle, it is determined that the pixel in current frame image is unsatisfactory for Condition (3).
For the pixel of same position in the two field pictures of front and back, if the pixel is true in the two field pictures of front and back It is set to the pixel in the edge OSD, then edge direction of the pixel in the two field pictures of front and back should identical or difference Very little, therefore, terminal can further selection meets the pixel of above-mentioned condition (3) from current frame image, to improve true Determine the accuracy of OSD edge pixel point.
The second way: when the preset condition further includes above-mentioned condition (4), for meeting above-mentioned item in current frame image Each pixel of part (1) and (2), terminal can determine the brightness of the pixel in current frame image, and be in the pixel The brightness of pixel in neighborhood of a point, and according to the brightness of the pixel and the pixel in the pixel neighborhood of a point Brightness, determine the average value of pixel brightness in the neighborhood, then according to determining average brightness, determine picture in the neighborhood The brightness variance of vegetarian refreshments, and determining brightness variance is determined as to the brightness variance of the pixel in current frame image, terminal will The brightness variance of the pixel is compared with the first default variance in current frame image, if the brightness variance is greater than or equal to First default variance, it is determined that the pixel in current frame image meets condition (4), if the brightness variance is pre- less than first If variance, it is determined that the pixel in current frame image is unsatisfactory for condition (4).
Since the brightness variance between edge pixel point and non-edge pixels point can be bigger, that is to say edge pixel point with Luminance difference between non-edge pixels point can be bigger, therefore for each pixel in current frame image, when the pixel Brightness variance be greater than or equal to the first default variance when, can determine the pixel be edge pixel point a possibility that it is larger, Therefore, terminal can further select the pixel for meeting above-mentioned condition (4) from current frame image, to improve determining OSD The accuracy of edge pixel point.
It should be noted that terminal according to determining average brightness, determines the brightness variance of pixel in the neighborhood Method can refer to the relevant technologies, this is not set forth in detail in the embodiment of the present invention.
The third mode: when the preset condition further includes above-mentioned condition (5), for meeting above-mentioned item in current frame image Each pixel of part (1) and (2), terminal can determine the brightness variance of the pixel in current frame image, then from storage The previous frame image adjacent with current frame image in each pixel brightness variance in, can determine in current frame image The brightness variance of the co-located pixel of the pixel, terminal can determine the brightness side of pixel in current frame image Difference in difference and the previous frame image adjacent with current frame image between the brightness variance of the pixel of same position, and should Difference is compared with the second default variance, if the difference is less than the second default variance, it is determined that being somebody's turn to do in current frame image Pixel meets condition (5), if the difference is greater than or equal to the second default variance, it is determined that the pixel in current frame image Point is unsatisfactory for condition (5).
For the pixel of same position in the two field pictures of front and back, if the pixel is true in the two field pictures of front and back It is set to the pixel in the edge OSD, then brightness variance of the pixel in the two field pictures of front and back should identical or difference Very little, therefore, terminal can further selection meets the pixel of above-mentioned condition (5) from current frame image, to improve true Determine the accuracy of OSD edge pixel point.
It should be noted that when the preset condition includes multiple and different condition, terminal can from current frame image, Selection while the pixel for meeting multiple condition, so as to improve the accuracy of determining OSD edge pixel point.
In addition, terminal after determining the first pixel collection, can also be to belong to the first pixel in current frame image The pixel of set adds first identifier, and to be not belonging to the pixel of the first pixel collection addition the in current frame image Two marks, and first identifier and second identifier be not identical, for example first identifier can be 1, second identifier can be 0.
Step 102: determining the neighborhood territory pixel point number of each pixel in the first pixel collection, the neighborhood territory pixel point Number is the number of the pixel in the first pixel collection in each pixel neighborhood of a point, and the size of the neighborhood is second pre- If size.
For each pixel in the first pixel collection, which may be the true pixel for being in the edge OSD Point, while may also be the pixel for being not at the edge OSD but meeting preset condition.For the first pixel, due to this A possibility that pixel is really in the edge OSD, therefore pixel adjacent thereto also meets preset condition is larger, that is to say place It is larger in the pixel in the neighborhood of pixel points is also at the edge OSD a possibility that, so belonging in the pixel neighborhood of a point The pixel of first pixel collection may be more.And for second of pixel, which may be accidental satisfaction Preset condition, therefore the pixel is possible for isolated existing point, that is to say that the pixel meets preset condition, but is in Preset condition may be not satisfied in pixel in the neighborhood of pixel points or only only a few pixel meets preset condition, this When can consider that a possibility that pixel is in the edge OSD is smaller.Therefore, terminal can determine every in the first pixel collection The neighborhood territory pixel point number of a pixel that is to say and determine that satisfaction is default in each pixel neighborhood of a point in the first pixel collection The pixel number of condition that is to say with from the first pixel collection, selecting the more pixel of neighborhood territory pixel point number It selects in the biggish pixel of the edge OSD possibility.
It should be noted that the second default size can be for this for each pixel in the first pixel collection Centered on pixel, and the size in region shared by the M × M pixel adjacent with the pixel, wherein M is the positive surprise greater than 2 Number.But in order to save the system resource of terminal, M should not be arranged excessive, for example set 3 or 5 more for M and be suitable for.Such as Referring to Figure 1B, when M is 3, the Size of Neighborhood of pixel A can for centered on pixel A, and 3 adjacent with pixel A × The size of shadow region shared by 3 pixels.
Step 103: from the first pixel collection, neighborhood territory pixel point number being selected to be greater than or equal to the pixel of predetermined number Point obtains third pixel collection.
For each pixel in the first pixel collection, when the neighborhood territory pixel point number of the pixel is greater than or equal in advance If when number, it is believed that the pixel for meeting preset condition in the neighborhood of pixel points is relatively more, and that is to say can consider A possibility that pixel is the pixel at the edge OSD is larger, therefore terminal can select neighborhood from the first pixel collection Pixel number is greater than or equal to the pixel of predetermined number, and pixel collection composed by the pixel by selection is determined as Third pixel collection.
It should be noted that terminal can be by clicking through each pixel in the first pixel collection in practical application Row opening operation first carries out erosion operation, then carries out dilation operation, realize above-mentioned steps 102 to step 103, to obtain third Pixel collection, the implementation include the following steps (1), step (2) and step (3):
(1) erosion operation: from each pixel in the first pixel collection, the pixel in neighborhood is selected to all belong to The pixel of first pixel collection.
For example, each pixel in the first pixel collection can be the pixel as shown in Fig. 1 C (a), to the first picture Each pixel in vegetarian refreshments set carries out erosion operation, and the pixel selected can be the pixel as shown in Fig. 1 C (b).
(2) dilation operation: from each pixel of current frame image, there are at least one to belong to first in selection neighborhood The pixel of pixel collection.
In order to avoid accidentally removing the pixel in the corner OSD when determining OSD edge pixel point, predetermined number is usual It can be set to 1, that is to say, in each pixel from current frame image, select in neighborhood that there are at least one to belong to the When the pixel of one pixel collection, it is believed that be the pixel for selecting pixel number to be greater than or equal to predetermined number.
Certainly, in practical application, predetermined number can also be greater than 1, and the present invention is not especially limit this.
For example, carrying out the pixel that erosion operation is selected can be the pixel as shown in Fig. 1 D (a), expansion fortune is carried out The pixel selected can be the pixel as shown in Fig. 1 D (b).
(3) pixel collection composed by the pixel by dilation operation selection is determined as third pixel collection.
For each pixel in current frame image, which may be following three classes pixels: the picture in neighborhood Vegetarian refreshments belongs to the pixel of the first pixel collection, the pixel in neighborhood some belong to the picture of the first pixel collection Pixel in vegetarian refreshments and neighborhood is not admitted to the pixel of the first pixel collection.When terminal carries out erosion operation, choosing The pixel selected out is first kind pixel, and when terminal carries out dilation operation, the pixel selected is the second class pixel, It is picture of the pixel number more than or equal to predetermined number 1 that first kind pixel and the second class pixel, which take the pixel of intersection, Vegetarian refreshments, so that the set including first kind pixel and the second class pixel can be determined as third pixel collection by terminal.
For example, terminal can carry out dilation operation, choosing to by each pixel in the current frame image of erosion operation Shown in the pixel selected out such as Fig. 1 D (b), and picture composed by the pixel of dilation operation selection will be passed through shown in Fig. 1 D (b) Vegetarian refreshments set is determined as third pixel collection.
It, can also be to belong to the in current frame image it should be noted that terminal is after determining third pixel collection The pixel of three pixel collections adds first identifier, and to be not belonging to the pixel of third pixel collection in current frame image Point addition second identifier.
Step 104: from third pixel collection, selection and the co-located pixel of OSD pixel obtain the Two pixel collections, the OSD pixel are the pixel where OSD menu region in multiple continuous images before current frame image Point.
For being in the pixel at the edge OSD in current frame image, in multiple continuous images before current frame image, It should be at the edge OSD of respective correspondence image with the co-located pixel of the pixel, therefore, terminal can be from In three pixel collections, selection and the co-located pixel of OSD pixel, and picture composed by the pixel by selection Vegetarian refreshments set is determined as the second pixel collection.
It should be noted that the quantity of multiple continuous images before current frame image can be terminal preset number in advance Value, such as the quantity can be 10,15,20 etc..In addition, since terminal needs to determine the OSD in current frame image as early as possible Menu area, therefore, the quantity should not be arranged excessive, so as not to extend determine current frame image in OSD menu region when Between, while the waste of terminal system resource is also avoided, but the quantity is also unsuitable too small, can reduce determination if the quantity is too small The accuracy in the OSD menu region in current frame image.
In addition, terminal after determining the second pixel collection, can also be to belong to the second pixel in current frame image The pixel of set adds first identifier, and to be not belonging to the pixel of the second pixel collection addition the in current frame image Two marks.
Step 105: the OSD menu region in current frame image is determined based on the pixel in the second pixel collection.
It in embodiments of the present invention, can be possible by following three kinds based on the pixel in the second pixel collection Implementation determines the OSD menu region in current frame image, comprising:
The first possible implementation, terminal determine multiple edge pixel points, Duo Gebian from the second pixel collection Edge pixel is respectively minimum abscissa or maximum and ordinate minimum or maximum pixel.
Since most OSD menu region is regular rectangular area, terminal can be from the second pixel collection In, determine that multiple edge pixel points, multiple edge pixel points are respectively that abscissa is minimum or maximum and ordinate is minimum or maximum Pixel, i.e., abscissa is minimum and the smallest pixel of ordinate, abscissa are minimum and the maximum pixel of ordinate, horizontal seat Mark maximum and the smallest pixel of ordinate and abscissa maximum and the maximum pixel of ordinate, that is to say from the second pixel In point set, the pixel in the lower left corner OSD, the pixel in the upper left corner, the pixel in the lower right corner and the pixel in the upper right corner are determined Point, then the rectangular area that multiple edge pixel point is surrounded can be determined as the OSD menu in current frame image by terminal Region.Since terminal only need to determine the OSD menu region in current frame image according to multiple edge pixel point, without basis All pixels in second pixel collection determine the OSD menu region in current frame image, to save terminal System resource.
Pixel area encompassed in second pixel collection is determined as by second of possible implementation, terminal OSD menu region in current frame image.
OSD irregular for display area, when terminal determines present frame by the first above-mentioned possible implementation When OSD menu region in image, the irregular corner areas of OSD may be determined as to its in addition to OSD menu region His region, and the important information of OSD is also likely to be present in these irregular corner areas, therefore, in order to avoid that will likely wrap The corner areas for including OSD important information excludes except OSD menu region, and terminal can will own in the second pixel collection Pixel area encompassed is determined as the OSD menu region in current frame image.
The third possible implementation, terminal select multiple pixels, multiple pixels from the second pixel collection In the neighbor pixel of each pixel belong to the second pixel collection;Multiple pixel areas encompassed are determined as working as OSD menu region in prior image frame.
Since terminal is when executing above-mentioned steps 101 to step 104, the second picture may be led to because of individual data entanglement The pixel of preset condition is remained unchanged there are only a few isolated pixel point or is unsatisfactory in vegetarian refreshments set, so, when terminal passes through When above-mentioned the first and second of possible implementation determine the OSD menu region in current frame image, it may make really Still comprising only a few isolated pixel point or it is unsatisfactory for the pixel of preset condition in fixed OSD menu region, therefore, in order to The accuracy in determining OSD menu region is further increased, terminal can select multiple pixels from the second pixel collection, And multiple pixel areas encompassed are determined as to the OSD menu region in current frame image.
It should be noted that terminal can be realized above-mentioned by double scan method or se ed filling algorithm in practical application The third possible implementation, to determine the OSD menu region in current frame image.
In addition, since terminal can be to belong to the first pixel collection, the second pixel collection, third pixel collection Pixel adds first identifier, therefore terminal can also select to be respectively marked with first identifier when marking three times from current frame image Pixel, and the pixel area encompassed of selection is determined as to the OSD menu region in current frame image.
Step 106: when receiving the image processing commands for current frame image, to removing OSD dish in current frame image Region except single region carries out image procossing.
Wherein, when receiving the image processing commands for current frame image, terminal can refer to according to the image procossing Corresponding image processing operations are enabled, image procossing is carried out to the region in current frame image in addition to OSD menu region.
It should be noted that the image processing commands for current frame image can be led to by the user for currently holding the terminal Specified operation triggering is crossed, which can grasp for the sliding of clicking operation, desired guiding trajectory to image processing operations option Work, voice operating etc..
In embodiments of the present invention, the first pixel is determined according to the pixel for meeting preset condition in current frame image first Point set, thus the biggish pixel of a possibility that selecting in the edge OSD, then according to each in the first pixel collection The pixel number of pixel selects pixel number to be greater than or equal to the pixel of predetermined number from the first pixel collection Point obtains third pixel collection, so as to which from the first pixel collection, removal meets preset condition and isolates existing Pixel, then from third pixel collection, selection and the co-located pixel of OSD pixel obtain the second picture Vegetarian refreshments set to further screen to the pixel in third pixel collection, and then improves determining present frame figure The accuracy in the OSD menu region as in can be only to current when receiving the image processing commands for current frame image Region in frame image in addition to OSD menu region carries out image procossing, without handling OSD menu region, to keep away Exempt from the distortion of OSD menu, so that OSD menu still can normally be shown after carrying out image quality processing to current frame image.
A referring to fig. 2 determines OSD menu region the embodiment of the invention provides a kind of in the terminal for playing external video Device 200, the device include: the first determining module 201, selecting module 202, the second determining module 203.
First determining module 201, for determining the first pixel collection, the first pixel collection from current frame image In include meeting the pixel of preset condition;
Wherein, preset condition includes: that the edge size of pixel is more than or equal to the bright of the first default size and pixel Difference in degree and previous frame image between the brightness of same position pixel is less than predetermined luminance, and edge size is pixel edge Brightness step in edge direction;
Selecting module 202, for selecting and the co-located pixel of OSD pixel from the first pixel collection Point, obtains the second pixel collection, and OSD pixel is OSD menu region institute in multiple continuous images before current frame image Pixel;
Second determining module 203, for determining the OSD in current frame image based on the pixel in the second pixel collection Menu area.
Optionally, B, selecting module 202 include: referring to fig. 2
First determination unit 2021, for determining the neighborhood territory pixel point number of each pixel in the first pixel collection, Neighborhood territory pixel point number is the pixel number in the first pixel collection in the pixel neighborhood of a point, and the size of neighborhood is the Two default sizes;
First selecting unit 2022, for selecting neighborhood territory pixel point number to be greater than or equal to from the first pixel collection The pixel of predetermined number obtains third pixel collection;
Second selecting unit 2023, for from third pixel collection, selection and OSD pixel to be co-located Pixel obtains the second pixel collection.
Optionally, preset condition further includes at least one of following condition:
Same position in the edge direction of the pixel previous frame image adjacent with current frame image in current frame image Angle between the edge direction of pixel is less than default angle;
The brightness variance of pixel is greater than or equal to the first default variance in current frame image;
The brightness variance of the brightness variance of pixel and the pixel of same position in previous frame image in current frame image Between difference less than the second default variance.
Optionally, C, the second determining module 203 include: referring to fig. 2
Second determination unit 2031, for the pixel area encompassed in the second pixel collection to be determined as currently OSD menu region in frame image.
Optionally, D, the second determining module 203 include: referring to fig. 2
Third determination unit 2032, for determining multiple boundary pixel points, multiple boundary pictures from the second pixel collection Vegetarian refreshments is respectively minimum abscissa or maximum and ordinate minimum or maximum pixel;
4th determination unit 2033, the rectangular area for being surrounded multiple boundary pixel points are determined as current frame image In OSD menu region.
Optionally, E, the second determining module 203 include: referring to fig. 2
Third selecting unit 2034 selects multiple pixels for from the second pixel collection, every in multiple pixels The neighbor pixel of a pixel belongs to the second pixel collection;
5th determination unit 2035, for multiple pixel areas encompassed to be determined as the OSD in current frame image Menu area.
Optionally, F referring to fig. 2, the device further include:
Processing module 204, for when receiving the image processing commands for current frame image, in current frame image Region in addition to OSD menu region carries out image procossing.
In conclusion in embodiments of the present invention, it is true according to the pixel for meeting preset condition in current frame image first Fixed first pixel collection, thus the biggish pixel of a possibility that selecting in the edge OSD, then from the first pixel point set In conjunction, selection and the co-located pixel of OSD pixel obtain the second pixel collection, thus further to first Pixel in pixel collection is screened, and then improves the accuracy in the OSD menu region in determining current frame image, When needing to carry out image procossing to current frame image, can be carried out at image just for the region in addition to OSD menu region Reason, without handling OSD menu region, so that the distortion of OSD menu is avoided, so that carrying out at image quality to current frame image After reason, OSD menu still can normally be shown.
It should be understood that provided by the above embodiment determine OSD menu region in the terminal for playing external video Device is at the display area for determining OSD, only the example of the division of the above functional modules, can in practical application To be as needed completed by different functional modules above-mentioned function distribution, i.e., the internal structure of equipment is divided into different Functional module, to complete all or part of the functions described above.In addition, provided by the above embodiment playing external video Terminal in determine the device in OSD menu region and determine that the method in OSD menu region is real in the terminal for playing external video It applies example and belongs to same design, specific implementation process is detailed in embodiment of the method, and which is not described herein again.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (12)

1. a kind of method for determining screen in the terminal for playing external video and showing OSD menu region, which is characterized in that described Method includes:
From current frame image, the first pixel collection is determined, include meeting preset condition in first pixel collection Pixel;
Wherein, the preset condition includes: that the edge size of pixel is more than or equal to the bright of the first default size and pixel Difference in degree and previous frame image between the brightness of same position pixel is less than predetermined luminance, and the edge size is pixel Brightness step of the point in edge direction;
From first pixel collection, selection and the co-located pixel of OSD pixel obtain the second pixel Set, the OSD pixel are the pixel where OSD menu region in multiple continuous images before the current frame image Point;
The OSD menu region in the current frame image is determined based on the pixel in second pixel collection;
When receiving the image processing commands for the current frame image, to removing the OSD dish in the current frame image Region except single region carries out image procossing.
2. the method as described in claim 1, which is characterized in that described from first pixel collection, selection and OSD picture The co-located pixel of vegetarian refreshments, obtains the second pixel collection, comprising:
Determine the neighborhood territory pixel point number of each pixel in first pixel collection, the neighborhood territory pixel point number is institute The pixel number in the first pixel collection in pixel neighborhood of a point is stated, the size of the neighborhood is second default big It is small;
From first pixel collection, selects neighborhood territory pixel point number to be greater than or equal to the pixel of predetermined number, obtain Third pixel collection;
From the third pixel collection, selection and the co-located pixel of OSD pixel obtain the second pixel Set.
3. method according to claim 1 or 2, which is characterized in that the preset condition further include in following condition at least One:
Same position in the edge direction of the pixel previous frame image adjacent with the current frame image in current frame image Angle between the edge direction of pixel is less than default angle;
The brightness variance of pixel is greater than or equal to the first default variance in current frame image;
The brightness variance of the brightness variance of pixel and the pixel of same position in the previous frame image in current frame image Between difference less than the second default variance.
4. the method as described in claim 1, which is characterized in that described true based on the pixel in second pixel collection OSD menu region in the fixed current frame image, comprising:
OSD menu pixel area encompassed in second pixel collection being determined as in the current frame image Region.
5. the method as described in claim 1, which is characterized in that described true based on the pixel in second pixel collection OSD menu region in the fixed current frame image, comprising:
From second pixel collection, determine that multiple boundary pixel points, the multiple boundary pixel point are respectively abscissa Minimum or maximum and ordinate minimum or maximum pixel;
The rectangular area that the multiple boundary pixel point is surrounded is determined as to the OSD menu region in the current frame image.
6. the method as described in claim 1, which is characterized in that described true based on the pixel in second pixel collection OSD menu region in the fixed current frame image, comprising:
From second pixel collection, multiple pixels are selected, the adjacent picture of each pixel in the multiple pixel Vegetarian refreshments belongs to second pixel collection;
The multiple pixel area encompassed is determined as to the OSD menu region in the current frame image.
7. a kind of device for determining OSD menu region in the terminal for playing external video, which is characterized in that described device packet It includes:
First determining module, for determining the first pixel collection, being wrapped in first pixel collection from current frame image Include the pixel for meeting preset condition;
Wherein, the preset condition includes: that the edge size of pixel is more than or equal to the bright of the first default size and pixel Difference in degree and previous frame image between the brightness of same position pixel is less than predetermined luminance, and the edge size is pixel Brightness step of the point in edge direction;
Selecting module is used for from first pixel collection, selection and the co-located pixel of OSD pixel, The second pixel collection is obtained, the OSD pixel is OSD menu area in multiple continuous images before the current frame image Pixel where domain;
Second determining module, for being determined in the current frame image based on the pixel in second pixel collection OSD menu region;
Processing module, for when receiving the image processing commands for the current frame image, to the current frame image In region in addition to the OSD menu region carry out image procossing.
8. device as claimed in claim 7, which is characterized in that the selecting module includes:
First determination unit, it is described for determining the neighborhood territory pixel point number of each pixel in first pixel collection Neighborhood territory pixel point number is the pixel number in first pixel collection in pixel neighborhood of a point, the neighborhood Size is the second default size;
First selecting unit, it is default for from first pixel collection, selecting neighborhood territory pixel point number to be greater than or equal to The pixel of number obtains third pixel collection;
Second selecting unit, for selecting and the co-located pixel of OSD pixel from the third pixel collection Point obtains the second pixel collection.
9. device as claimed in claim 7 or 8, which is characterized in that the preset condition further include in following condition at least One:
Same position in the edge direction of the pixel previous frame image adjacent with the current frame image in current frame image Angle between the edge direction of pixel is less than default angle;
The brightness variance of pixel is greater than or equal to the first default variance in current frame image;
The brightness variance of the brightness variance of pixel and the pixel of same position in the previous frame image in current frame image Between difference less than the second default variance.
10. device as claimed in claim 7, which is characterized in that second determining module includes:
Second determination unit, it is described current for the pixel area encompassed in second pixel collection to be determined as OSD menu region in frame image.
11. device as claimed in claim 7, which is characterized in that second determining module includes:
Third determination unit, for determining multiple boundary pixel points, the multiple boundary picture from second pixel collection Vegetarian refreshments is respectively minimum abscissa or maximum and ordinate minimum or maximum pixel;
4th determination unit, the rectangular area for being surrounded the multiple boundary pixel point are determined as the current frame image In OSD menu region.
12. device as claimed in claim 7, which is characterized in that second determining module includes:
Third selecting unit selects multiple pixels for from second pixel collection, every in the multiple pixel The neighbor pixel of a pixel belongs to second pixel collection;
5th determination unit, the OSD for being determined as the multiple pixel area encompassed in the current frame image Menu area.
CN201710081816.5A 2017-02-15 2017-02-15 The method and device in OSD menu region is determined in the terminal for playing external video Active CN106851147B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710081816.5A CN106851147B (en) 2017-02-15 2017-02-15 The method and device in OSD menu region is determined in the terminal for playing external video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710081816.5A CN106851147B (en) 2017-02-15 2017-02-15 The method and device in OSD menu region is determined in the terminal for playing external video

Publications (2)

Publication Number Publication Date
CN106851147A CN106851147A (en) 2017-06-13
CN106851147B true CN106851147B (en) 2019-09-20

Family

ID=59128766

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710081816.5A Active CN106851147B (en) 2017-02-15 2017-02-15 The method and device in OSD menu region is determined in the terminal for playing external video

Country Status (1)

Country Link
CN (1) CN106851147B (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020046317A (en) * 2000-12-12 2002-06-21 구자홍 Method for controlling OSD position of display device
EP1198128A3 (en) * 2000-06-30 2004-07-21 Pioneer Corporation Video production apparatus and video reproduction method
CN1798289A (en) * 2004-12-30 2006-07-05 厦门华侨电子企业有限公司 Method for displaying OSD menu of TV set
CN102005051A (en) * 2010-11-23 2011-04-06 华亚微电子(上海)有限公司 Edge detection method and related device
CN102932582A (en) * 2012-10-26 2013-02-13 华为技术有限公司 Method and device for realizing motion detection
CN103765293A (en) * 2011-08-24 2014-04-30 索尼公司 Display device and display control method
CN104506850A (en) * 2014-12-16 2015-04-08 北京中星微电子有限公司 Method and device for judging video occlusion
CN105528765A (en) * 2015-12-02 2016-04-27 小米科技有限责任公司 Method and device for processing image
CN105635789A (en) * 2015-12-29 2016-06-01 深圳Tcl数字技术有限公司 Video image OSD brightness reducing method and device
CN105763768A (en) * 2014-12-15 2016-07-13 深圳市中兴微电子技术有限公司 Image processing method, device and system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4557374B2 (en) * 2000-06-15 2010-10-06 キヤノン株式会社 Image display apparatus, control method therefor, and storage medium
US20080068458A1 (en) * 2004-10-04 2008-03-20 Cine-Tal Systems, Inc. Video Monitoring System
KR101500957B1 (en) * 2008-10-30 2015-03-12 삼성전자주식회사 Image processing apparatus and method thereof

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1198128A3 (en) * 2000-06-30 2004-07-21 Pioneer Corporation Video production apparatus and video reproduction method
KR20020046317A (en) * 2000-12-12 2002-06-21 구자홍 Method for controlling OSD position of display device
CN1798289A (en) * 2004-12-30 2006-07-05 厦门华侨电子企业有限公司 Method for displaying OSD menu of TV set
CN102005051A (en) * 2010-11-23 2011-04-06 华亚微电子(上海)有限公司 Edge detection method and related device
CN103765293A (en) * 2011-08-24 2014-04-30 索尼公司 Display device and display control method
CN102932582A (en) * 2012-10-26 2013-02-13 华为技术有限公司 Method and device for realizing motion detection
CN105763768A (en) * 2014-12-15 2016-07-13 深圳市中兴微电子技术有限公司 Image processing method, device and system
CN104506850A (en) * 2014-12-16 2015-04-08 北京中星微电子有限公司 Method and device for judging video occlusion
CN105528765A (en) * 2015-12-02 2016-04-27 小米科技有限责任公司 Method and device for processing image
CN105635789A (en) * 2015-12-29 2016-06-01 深圳Tcl数字技术有限公司 Video image OSD brightness reducing method and device

Also Published As

Publication number Publication date
CN106851147A (en) 2017-06-13

Similar Documents

Publication Publication Date Title
KR101472483B1 (en) Video screen display method and device
US7173620B2 (en) Image display method and image display device
US7508455B2 (en) Method, system, and device for automatic determination of nominal backing color and a range thereof
CN1164084C (en) Digital camera capable of image processing
US7424218B2 (en) Real-time preview for panoramic images
CN103797787B (en) Image processing method and image processing equipment
US11194536B2 (en) Image processing method and apparatus for displaying an image between two display screens
US20230370720A1 (en) Focusing method and apparatus, electronic device, and medium
CN102158648B (en) Image capturing device and image processing method
TW201428685A (en) Image processor and display method for fisheye image thereof
CN105828156A (en) Method and device of generating title background in video picture
CN105574813A (en) Image processing method and device
JP3332166B2 (en) Video search device
JP2008046608A (en) Video window detector
CN110248147A (en) A kind of image display method and apparatus
CN106851147B (en) The method and device in OSD menu region is determined in the terminal for playing external video
CN110602410B (en) Image processing method and device, aerial camera and storage medium
CN103997607A (en) Image obtaining method, corresponding device and electronic mobile terminal containing device
US20190304070A1 (en) Image rectification method and device, and storage medium
CN109104627B (en) Focus background generation method, storage medium, device and system of android television
CN105893578A (en) Method and device for selecting photos
CN111862271B (en) Display area filling method, device, equipment and storage medium
CN113393391B (en) Image enhancement method, image enhancement device, electronic apparatus, and storage medium
CN112165631B (en) Media resource processing method and device, storage medium and electronic equipment
Kiess et al. SeamCrop for image retargeting

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant