CN107864299B - Picture display method and related product - Google Patents

Picture display method and related product Download PDF

Info

Publication number
CN107864299B
CN107864299B CN201711421917.9A CN201711421917A CN107864299B CN 107864299 B CN107864299 B CN 107864299B CN 201711421917 A CN201711421917 A CN 201711421917A CN 107864299 B CN107864299 B CN 107864299B
Authority
CN
China
Prior art keywords
picture
sub
regular
gray value
display area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201711421917.9A
Other languages
Chinese (zh)
Other versions
CN107864299A (en
Inventor
周意保
张海平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201711421917.9A priority Critical patent/CN107864299B/en
Publication of CN107864299A publication Critical patent/CN107864299A/en
Application granted granted Critical
Publication of CN107864299B publication Critical patent/CN107864299B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Analysis (AREA)

Abstract

The application provides an electronic equipment and relevant product, electronic equipment includes: an electronic device, the electronic device comprising: the touch display screen comprises a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is arranged outside the shell, and the camera is connected with the application processor AP of the circuit board through at least one circuit. The technical scheme provided by the application has the advantage of high user experience.

Description

Picture display method and related product
Technical Field
The application relates to the technical field of terminal equipment, in particular to a picture display method and a related product.
Background
In the prior art, a mobile terminal (such as a mobile phone, a tablet personal computer, etc.) has become a preferred electronic device with the highest use frequency for a user, in order to improve the display effect of the electronic device, a full-screen electronic device is on the market, for the full-screen electronic device, the display effect and the user experience of the electronic device can be greatly improved by the display technology of the full-screen electronic device, but many accessories for the user need to be arranged on the front side, such as a front camera, a receiver, a proximity sensor, an infrared sensor, a fingerprint sensor, etc., in order to configure the accessories on the front side of the electronic device, the full-screen is cut to form a special-shaped screen, thus the arrangement of the sensors is solved, but the cutting modes of various manufacturers are possibly different, so that the special-shaped screen is not in a regular shape.
For picture display, especially for picture display in states of photographing, self-photographing and the like, the picture in the special-shaped display area cannot be processed, so that the photographed picture is inconsistent with the acquired picture, and user experience is influenced.
Content of application
The embodiment of the application provides a picture display method and a related product, which can realize adjustment of picture display and improve user experience.
In a first aspect, an embodiment of the present application provides an electronic device, where the electronic device includes: the touch display screen comprises a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is arranged outside the shell, and the camera and the touch display screen are connected with the application processor AP of the circuit board through at least one circuit; wherein,
the camera is used for acquiring a first picture;
the angle sensor is used for acquiring the rotation angle of the electronic equipment;
the AP is used for determining the placement direction of the electronic equipment according to the rotation angle, determining the display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
the AP is further used for setting the second sub-picture as a template in the trained neural network model, inputting the first sub-picture into the neural network model, calculating to obtain whether the first sub-picture is similar to the second sub-picture, and displaying the first picture in the rule area if the first sub-picture is similar to the second sub-picture;
and the AP is also used for taking the picture displayed in the regular area as a third picture taken when the photographing command is acquired.
In a second aspect, a photographing method is provided, the method is applied to an electronic device, the housing, a circuit board, a battery, a cover plate and a touch display screen are provided, the touch display screen includes a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is provided outside the housing, and the camera and the touch display screen are connected with the application processor AP of the circuit board through at least one circuit; the method comprises the following steps:
collecting a first picture and a rotation angle of the electronic equipment;
determining a placement direction of the electronic equipment according to the rotation angle, determining a display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
setting the second sub-picture as a template in a trained neural network model, inputting the first sub-picture into the neural network model to calculate whether the first sub-picture is similar to the second sub-picture, and displaying the first picture in the rule area if the first sub-picture is similar to the second sub-picture;
and when the photographing command is acquired, taking the picture displayed in the regular area as a third photographed picture.
In a third aspect, an electronic device is provided, which includes: the special-shaped display screen comprises a special-shaped display area and a regular display area;
the camera shooting unit is used for acquiring a first picture;
the angle sensor is used for acquiring the rotation angle of the electronic equipment;
the processing unit is used for determining the placement direction of the electronic equipment according to the rotation angle, determining the display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
the processing unit is further configured to set the second sub-picture as a template in a trained neural network model, input the first sub-picture into the neural network model, calculate whether the first sub-picture is similar to the second sub-picture, and display the first picture in the rule area if the first sub-picture is similar to the second sub-picture;
and the processing unit is also used for taking the picture displayed in the regular area as a shot third picture when the shooting command is acquired.
In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method provided in the second aspect.
In a fifth aspect, there is provided a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform the method provided by the second aspect.
The embodiment of the application has the following beneficial effects:
it can be seen that, according to the embodiment of the present application, a first picture is acquired, after a rotation angle is determined, a placement direction of an electronic device is determined according to the rotation angle, a display direction of the first picture is determined according to the placement direction, a first sub-picture and a second sub-picture are determined according to the display direction, then the second sub-picture is used as a template of a trained neural network model, the first sub-picture is used as input data of the trained neural network module to calculate whether the first sub-picture is similar to the second sub-picture, if so, the first picture is displayed in the regular region, if not, the second sub-picture is displayed in the regular region, and when a photographing command is obtained, a picture displayed in the regular region is used as a photographed third picture. Like this the picture that the user watched at the special-shaped display screen of electron device is identical with the picture of shooing promptly completely, can not appear showing occasionally "bang hai" phenomenon, but do not have "bang hai" when shooing to the picture of shooing also can be according to whether similar whether confirm whether add this special-shaped display area's first sub-picture at the picture of shooing, improved user experience degree.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Fig. 1a is a schematic structural diagram of an electronic device with a special-shaped display screen according to an embodiment of the present application.
Fig. 1b is a schematic structural diagram of another specially-shaped display screen electronic device provided in the embodiment of the present application.
Fig. 2 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present application.
Fig. 2a is a schematic view of a horizontally disposed display disclosed in an embodiment of the present application.
Fig. 2b is a schematic view of a vertically disposed display disclosed in an embodiment of the present application.
Fig. 2c is a schematic diagram illustrating a display area division of a special-shaped screen disclosed in an embodiment of the present application.
Fig. 3a is a schematic diagram of a first picture disclosed in the embodiment of the present application.
Fig. 3b is another schematic diagram of a first picture provided in the present application.
Fig. 3c is a schematic diagram of a first sub-picture disclosed in the embodiment of the present application.
Fig. 3d is a schematic diagram of a first picture in a regular display area according to an embodiment of the present application.
Fig. 3e is a schematic view of another first picture disclosed in the embodiment of the present application.
Fig. 4 is a schematic flowchart of a photographing method according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 6 is a schematic structural diagram of a mobile phone disclosed in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In the electronic device provided in the first aspect, the AP is further configured to display the second sub-picture in a regular display area when the first sub-picture is not similar to the second sub-picture.
In the electronic device provided in the first aspect, the AP is further configured to, when the first sub-picture is not similar to the second sub-picture, cut out a w-th sub-picture adjacent to the first sub-picture from the second sub-picture2Picture, the w th2The width of the picture is consistent with that of the first sub-picture, and the w-th picture is extracted2The gray values of all pixel points of the picture are counted, the number of the pixel points with the same gray value is counted, the same gray value is arranged in a positive sequence according to the number of the pixel points to obtain a gray value sequence R21Extracting the gray value sequence R21Extracting the gray values of all pixel points of the first sub-picture from the previous P gray values, counting the number of the pixel points with the same gray value, and arranging the same gray value according to the number of the pixel points in a positive sequence to obtain a gray value R11Sequence of extracting the gray value sequence R11Middle and front P gray values, e.g. the gray value sequence R21P gray values before the middle and the gray value sequence R11The middle and front P gray values have the same Y gray values, such as Y is largerAnd displaying the first picture in a regular display area if the quantity threshold is smaller than Y, and displaying the second sub-picture in the regular display area if Y is smaller than the quantity threshold.
In the electronic device provided in the first aspect, the AP is further configured to, when it is determined that Y is greater than the number threshold, set the first sub-picture and the second sub-picture as training samples of the neural network model, perform a training operation on the neural network model, and update a weight of the neural network model.
In the method provided in the second aspect, further comprising: displaying the second sub-picture in a regular display area when the first sub-picture is not similar to the second sub-picture.
In the method provided in the second aspect, further comprising: when the first sub-picture is not similar to the second sub-picture, cutting the w-th sub-picture adjacent to the first sub-picture from the second sub-picture2Picture, the w th2The width of the picture is consistent with that of the first sub-picture, and the w-th picture is extracted2The gray values of all pixel points of the picture are counted, the number of the pixel points with the same gray value is counted, the same gray value is arranged in a positive sequence according to the number of the pixel points to obtain a gray value sequence R21Extracting the gray value sequence R21Extracting the gray values of all pixel points of the first sub-picture from the previous P gray values, counting the number of the pixel points with the same gray value, and arranging the same gray value according to the number of the pixel points in a positive sequence to obtain a gray value R11Sequence of extracting the gray value sequence R11Middle and front P gray values, e.g. the gray value sequence R21P gray values before the middle and the gray value sequence R11And if Y is larger than the quantity threshold, the first picture is displayed in a regular display area, and if Y is smaller than the quantity threshold, the second sub-picture is displayed in the regular display area.
In the method provided in the second aspect, further comprising: and when the Y is determined to be larger than the quantity threshold value, setting the first sub-picture and the second sub-picture as training samples of the neural network model, and carrying out training operation on the neural network model to update the weight of the neural network model.
The electronic device in the present application may include a smart phone (e.g., an Android phone, an iOS phone, a windows phone, etc.), a tablet computer, a palm computer, a notebook computer, a Mobile internet device (MID, Mobile internet devices), or a wearable device, and the electronic devices are merely examples, but not exhaustive, and include but are not limited to the electronic devices, and for convenience of description, the electronic devices are referred to as User Equipment (UE) in the following embodiments. Of course, in practical applications, the user equipment is not limited to the above presentation form, and may also include: intelligent vehicle-mounted terminal, computer equipment and the like.
Referring to fig. 1, fig. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure, fig. 1 is a block diagram of an electronic device 100 according to an embodiment of the present disclosure, where the electronic device 100 includes: the touch screen display comprises a shell 110, a circuit board 120, a battery 130, a cover plate 140, a touch display screen 150, an angle sensor 170 and a camera 180, wherein the circuit board 120, the battery 130 and the cover plate 140 are arranged on the shell 110, the touch display screen 150 is arranged on the inner surface of the cover plate 140, the touch display screen 150 comprises a special-shaped display area 151 and a regular display area 152, and the circuit board 120 is further provided with a circuit 160 connected with the touch display screen 150 and an application processor AP 190. The touch display screen can also be called a special-shaped display screen or a special-shaped screen.
The touch Display screen may be a Thin Film Transistor-Liquid Crystal Display (TFT-LCD), a Light Emitting Diode (LED) Display screen, an Organic Light Emitting Diode (OLED) Display screen, or the like.
As shown in fig. 1a, an outline schematic diagram of an electronic device including an irregular screen is shown, and the electronic device 1000 may include the irregular screen 21, and may further include a camera 11 and an earpiece 12, and may further include other sensors, such as a distance sensor, a color temperature sensor, an ambient light sensor, an angle sensor, and the like.
Referring to fig. 1b, fig. 1b is a modified structure of the electronic device 1000 depicted in fig. 1a, which may further include a home key 13, and thus, the specially-shaped display screen 21 also appears in a "bang" shape.
As shown in fig. 2, for a schematic structural diagram of an electronic device provided in the present application, as shown in fig. 2, the electronic device 200 includes: the touch control display screen comprises a special-shaped display area and a regular display area, the circuit board is provided with the application processor AP and the angle sensor, the camera is arranged outside the shell, and the camera and the touch control display screen are connected with the application processor AP of the circuit board through at least one circuit. The AP210 is connected to the special-shaped display screen 220, the angle sensor 250, the camera 260 and the circuit 230 through a connection line 240, wherein the connection line 240 specifically may include: a bus, a flexible circuit board, etc., although in practical applications, the connection line 240 may have other expressions, and the embodiments of the present invention do not limit the expression of the connection line 240. The shape of the special-shaped display screen 220 can be as shown in fig. 1a or fig. 1b, and of course, in practical applications, the shape of the special-shaped display screen 220 can also be other shapes, and the specific shape of the special-shaped display screen 220 is not limited in the embodiments of the present application.
The camera 260 is configured to collect a first picture and send the first picture to the AP 210;
the camera 260 may specifically be a rear camera or a front camera, and the rear camera or the front camera may be a single camera or a camera array, and the camera array includes but is not limited to: 2 or more cameras.
The angle sensor 250 is configured to collect a rotation angle of the electronic device, and send the rotation angle to the AP210 through the connection line 240;
the angle sensor 250 may be a gyroscope, but in practical applications, the angle sensor may be other sensors having an angle detection function.
The AP210 is configured to determine a placement direction of the electronic device according to the rotation angle, determine a display direction of the first picture according to the placement direction, and divide the first picture into a first sub-picture and a second sub-picture according to the display direction, where the first sub-picture is a picture in which the first picture is located in an irregular display area, and the second sub-picture is a picture in which the first picture is located in a regular display area;
the above-mentioned placement direction may be, specifically, horizontal placement or vertical placement. When the first picture is placed in different directions, the first picture has different display directions, as shown in fig. 2a, the first picture is a horizontally placed display diagram, and as shown in fig. 2b, the first picture is a vertically placed diagram.
The AP210 is configured to set the second sub-picture as a template in the trained neural network model, input the first sub-picture into the trained neural network model, calculate whether the first sub-picture is similar to the second sub-picture, and display the first picture in the rule area if the first sub-picture is similar to the second sub-picture;
and the AP210 is used for taking the picture displayed in the regular area as a third picture taken when the photographing command is acquired.
The irregular display area may be an irregular display area of the irregular display screen, for example, a dividing line 777 shown in fig. 2c, and the regular display area may be a regular display area of the irregular display screen, for example, a rectangle shown in fig. 2 c. As shown in fig. 2c, the left side of the dividing line 777 may be a special-shaped display area, and the right side of the dividing line 777 may be a regular display area.
It should be noted that the special-shaped display area and the regular display area are both logically divided, and the first sub-picture and the second sub-picture are also logically divided.
According to the technical scheme, a first picture is collected, after a rotation angle is determined, the placement position of the electronic equipment is determined according to the rotation angle, the display direction of the first picture is determined according to the placement position, a first sub-picture and a second sub-picture are determined according to the display direction, then the second sub-picture is used as a template of a trained neural network model, the first sub-picture is used as input data of a trained neural network module to calculate whether the first sub-picture is similar to the second sub-picture, if yes, the first picture is displayed in a rule area, if not, the second sub-picture is displayed in the rule area, and when a photographing command is obtained, the picture displayed in the rule area is used as a third picture for photographing. Like this the picture that the user watched at the special-shaped display screen of electron device is identical with the picture of shooing promptly completely, can not appear showing occasionally "bang hai" phenomenon, but do not have "bang hai" when shooing to the picture of shooing also can be according to whether similar whether confirm whether add this special-shaped display area's first sub-picture at the picture of shooing, improved user experience degree.
Optionally, the AP210 is configured to display the second sub-picture in the regular display area when the first sub-picture is not similar to the second sub-picture.
Optionally, the AP210 is configured to, when the first sub-picture is not similar to the second sub-picture, cut a w-th sub-picture adjacent to the first sub-picture from the second sub-picture2Picture, w th2The width of the picture is consistent with that of the first sub-picture, and the w-th picture is extracted2The gray values of all pixel points of the picture are counted, the number of the pixel points with the same gray value is counted, the same gray value is arranged in a positive sequence according to the number of the pixel points to obtain a gray value sequence R21Extracting the gray value sequence R21Extracting the gray values of all pixel points of the first sub-picture from the previous P gray values, counting the number of the pixel points with the same gray value, and arranging the same gray value according to the number of the pixel points in a positive sequence to obtain a gray value R11Sequence of extracting the gray value sequence R11Middle and front P gray values, e.g. the gray value sequence R21P gray values before the middle and the gray value sequence R11And if Y is smaller than the quantity threshold value, the second sub-picture is displayed in the regular display area.
According to the method, when the result calculated by the neural network model possibly deviates from the actual result, the first sub-picture and part of the second sub-picture are compared in a decomposition comparison mode to determine which display strategy is adopted, and the situation that the result calculated by the neural network model is not matched with the actual result due to independent use is avoided.
Fig. 3a is a schematic display diagram of a first picture taken by the unprocessed camera of fig. 3b, and fig. 3e is a schematic display diagram of a first picture taken by the unprocessed camera of fig. 3 c; the specific implementation method is described below by using two practical examples shown in fig. 3b and fig. 3c, referring to fig. 3b, the first sub-picture is a picture of the special-shaped display area shown in fig. 3b, and the gray value of each similarity of the first sub-picture is extracted, since the colors of the first sub-picture are consistent, the gray values of all the pixels are the same, and it is assumed that the specific value may be 99; for a sequence of grey values R11Only one gray value 99; for the w-th2The picture, after it has been cut, has two gray values, one of which is the ground color, i.e. 99, and the other is the color of the mobile phone case (black), i.e. 255, so for the gray value sequence R21The gray value sequence R has two gray values, and the black area is larger, and more pixel points are arranged in front of the black area, so that the gray value sequence R21With 255, 99, the gray value sequence R is determined11With a sequence of grey values R21Having 1 of the same gray values 99, i.e. Y being 1, assuming here that the number threshold is 2, it is determined that the second sub-picture is displayed in the regular display area. The technical scheme is also consistent with the picture which the user wants to take.
Referring to fig. 3e, the first sub-picture is a picture of the special-shaped display area as in fig. 3c, and the gray value of each similarity of the first sub-picture is extracted, and the gray value has two colors, namely, the specific value may be 99, 108, because the gray value has two colors, namely, the ground color and the cup handle; for a sequence of grey values R11Only two gray values 99, 108; for the w-th21The picture, after it has been cut, has 2 grey values, one of which is the ground colour, i.e. 99, and the other is the cup, i.e. 108, so for the grey value sequence R21Has 2 gray values, so the gray value sequence R11Having 99, 108, the gray value sequence R is determined21With a sequence of grey values R11Having 2 identical gray values, i.e. YAssuming that the number threshold is 2 here, it is determined that the first picture is displayed in the regular display area, which is the same as the actual result.
Optionally, the AP210 is further configured to, when it is determined that Y is greater than the number threshold, set the first sub-picture and the second sub-picture as training samples of the neural network model to perform training operation on the neural network model, and update weight data of the neural network model.
According to the technical scheme, when the calculation result of the neural network model is determined to be incorrect, the sample is determined as the training sample to update the weight of the neural network model, so that the advantage of evolution of the trained neural network model is achieved, the personalized requirement of a user is met, and the experience degree of the user is further improved.
Referring to fig. 4, fig. 4 provides a photographing method, which is applied to an electronic device, where the electronic device includes: the touch screen comprises a shell, a circuit board, a battery and a cover plate, wherein the circuit board, the battery and the cover plate are arranged on the shell, the cover plate comprises a first area and a second area except the first area, a touch display screen is arranged on the inner surface of the first area, the touch display screen comprises a special-shaped display area and a regular display area, and the circuit board is provided with a circuit connected with the touch display screen and an angle sensor; as shown in fig. 4, the method includes:
in a second aspect, a photographing method is provided, the method is applied to an electronic device, the housing, a circuit board, a battery, a cover plate and a touch display screen are provided, the touch display screen includes a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is provided outside the housing, and the camera and the touch display screen are connected with the application processor AP of the circuit board through at least one circuit; the method comprises the following steps:
s401, collecting a first picture and a rotation angle of the electronic equipment;
step S402, determining a placement direction of the electronic equipment according to the rotation angle, determining a display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
step S403, setting the second sub-picture as a template in the trained neural network model, inputting the first sub-picture into the neural network model to calculate whether the first sub-picture is similar to the second sub-picture, and if so, displaying the first picture in the rule area;
and step S404, when the photographing command is acquired, taking the picture displayed in the regular area as a third photographed picture.
The method includes the steps of collecting a first picture, determining a rotation angle, determining a placement position of electronic equipment according to the rotation angle, determining a display direction of the first picture according to the placement position, determining a first sub-picture and a second sub-picture according to the display direction, using the second sub-picture as a template of a trained neural network model, calculating whether the first sub-picture is similar to the second sub-picture or not by using the first sub-picture as input data of the trained neural network module, displaying the first picture in a regular area if the first sub-picture is determined to be similar to the second sub-picture, displaying the second sub-picture in the regular area if the first sub-picture is not similar to the second sub-picture, and using the picture displayed in the regular area as a shot third picture when a shooting command is obtained. Like this the picture that the user watched at the special-shaped display screen of electron device is identical with the picture of shooing promptly completely, can not appear showing occasionally "bang hai" phenomenon, but do not have "bang hai" when shooing to the picture of shooing also can be according to whether similar whether confirm whether add this special-shaped display area's first sub-picture at the picture of shooing, improved user experience degree.
Referring to fig. 5, fig. 5 provides an electronic device including: the camera comprises a shell, a circuit board, a battery, a cover plate and a camera shooting unit, wherein the circuit board, the battery and the cover plate are arranged on the shell, the cover plate comprises a first area and a second area except the first area, the inner surface of the first area is provided with a special-shaped display screen 503, the special-shaped display screen comprises a special-shaped display area and a regular display area, and the circuit board is provided with a circuit connected with the special-shaped display screen and an angle sensor; the electronic device further includes: a processing unit, wherein,
a camera unit 504, configured to capture a first picture;
the angle sensor 501 is used for acquiring the rotation angle of the electronic equipment;
the processing unit 502 is configured to determine a placement direction of the electronic device according to the rotation angle, determine a display direction of the first picture according to the placement direction, and divide the first picture into a first sub-picture and a second sub-picture according to the display direction, where the first sub-picture is a picture in which the first picture is located in an irregular display area, and the second sub-picture is a picture in which the first picture is located in a regular display area;
the processing unit 502 is further configured to set the second sub-picture as a template in the trained neural network model, input the first sub-picture into the neural network model, calculate whether the first sub-picture is similar to the second sub-picture, and display the first picture in the rule area if the first sub-picture is similar to the second sub-picture;
the processing unit 502 is further configured to take the picture displayed in the rule area as a third picture to be taken when the photographing command is acquired.
The technical scheme provided by the embodiment of the application includes that a first picture is collected, after a rotation angle is determined, the placement direction of the electronic equipment is determined according to the rotation angle, the display direction of the first picture is determined according to the placement direction, a first sub-picture and a second sub-picture are determined according to the display direction, then the second sub-picture is used as a template of a trained neural network model, the first sub-picture is used as input data of a trained neural network module to calculate whether the first sub-picture is similar to the second sub-picture, if yes, the first picture is displayed in a rule area, if not, the second sub-picture is displayed in the rule area, and when a photographing command is obtained, the picture displayed in the rule area is used as a third picture for photographing. Like this the picture that the user watched at the special-shaped display screen of electron device is identical with the picture of shooing promptly completely, can not appear showing occasionally "bang hai" phenomenon, but do not have "bang hai" when shooing to the picture of shooing also can be according to whether similar whether confirm whether add this special-shaped display area's first sub-picture at the picture of shooing, improved user experience degree.
Fig. 6 is a block diagram illustrating a partial structure of a mobile phone related to a mobile terminal according to an embodiment of the present disclosure. Referring to fig. 6, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, sensor 950, audio circuit 960, Wireless Fidelity (WiFi) module 970, application processor AP980, and power supply 990. Those skilled in the art will appreciate that the handset configuration shown in fig. 6 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile phone in detail with reference to fig. 6:
the input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 930 may include a shaped display 933, a fingerprint recognition apparatus 931, a face recognition apparatus 936, an iris recognition apparatus 937, and other input devices 932. The face recognition device 936 and the iris recognition device 937 may be disposed in the special-shaped display area of the special-shaped display screen 933. The input unit 930 may also include other input devices 932. In particular, other input devices 932 may include, but are not limited to, one or more of physical keys, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like. Wherein,
a camera 955 for capturing a first picture;
and a sensor 950 for acquiring a rotation angle of the electronic device.
The AP980 is used for determining the placement direction of the electronic equipment according to the rotation angle, determining the display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
the AP980 is further configured to set the second sub-picture as a template in the trained neural network model, input the first sub-picture into the neural network model, calculate whether the first sub-picture is similar to the second sub-picture, and display the first picture in the rule region if the first sub-picture is similar to the second sub-picture;
and the AP980 is further configured to take the picture displayed in the regular area as a third picture to be taken when the photographing command is acquired.
The AP980 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions and processes of the mobile phone by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the mobile phone. Optionally, AP980 may include one or more processing units; alternatively, the AP980 may integrate an application processor that handles primarily the operating system, user interface, and applications, etc., and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into the AP 980.
Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
RF circuitry 910 may be used for the reception and transmission of information. In general, the RF circuit 910 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.
The handset may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust brightness of the special-shaped display screen according to brightness of ambient light, and the proximity sensor may turn off the special-shaped display screen and/or backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.
Audio circuitry 960, speaker 961, microphone 962 may provide an audio interface between a user and a cell phone. The audio circuit 960 may transmit the electrical signal converted from the received audio data to the speaker 961, and the audio signal is converted by the speaker 961 to be played; on the other hand, the microphone 962 converts the collected sound signal into an electrical signal, and the electrical signal is received by the audio circuit 960 and converted into audio data, and the audio data is processed by the audio playing AP980, and then sent to another mobile phone via the RF circuit 910, or played to the memory 920 for further processing.
WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 970, and provides wireless broadband Internet access for the user. Although fig. 6 shows the WiFi module 970, it is understood that it does not belong to the essential constitution of the handset, and can be omitted entirely as needed within the scope of not changing the essence of the application.
The handset also includes a power supply 990 (e.g., a battery) for supplying power to various components, and optionally, the power supply may be logically connected to the AP980 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system.
Although not shown, the mobile phone may further include a camera, a bluetooth module, a light supplement device, a light sensor, and the like, which are not described herein again.
It can be seen that, according to the embodiment of the application, the touch signal is collected through the special-shaped display screen, the second display page is determined through the touch signal and the first display page, the display information of one line of display area of the second display page is extracted, the importance of the display information is obtained by analyzing the special-shaped display area, and the display strategy of the display information is determined according to the importance, so that how the display information is displayed during sliding operation can be determined according to the importance of the display information of the special-shaped display screen, and therefore, the display information can be displayed by selecting a proper display strategy when necessary, the default of the display information of the special-shaped display area is avoided, and the experience degree of a user is improved.
Embodiments of the present application also provide a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the photographing methods as described in the above method embodiments.
Embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the photographing methods as described in the above method embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.
The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (8)

1. An electronic device, characterized in that the electronic device comprises: the touch display screen comprises a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is arranged outside the shell, and the camera and the touch display screen are connected with the application processor AP of the circuit board through at least one circuit; wherein,
the camera is used for acquiring a first picture;
the angle sensor is used for acquiring the rotation angle of the electronic equipment;
the AP is used for determining the placement direction of the electronic equipment according to the rotation angle, determining the display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
the AP is further configured to set a second sub-picture as a template in a trained neural network model, input the first sub-picture into the neural network model, calculate whether the first sub-picture is similar to the second sub-picture, if so, display the first picture in the regular region, if not, display the second sub-picture in the regular region, and simultaneously display the second sub-picture in the regular display region when the first sub-picture is not similar to the second sub-picture;
the AP is further used for taking the picture displayed in the regular area as a shot third picture when the shooting command is obtained, so that the picture displayed on the touch display screen is consistent with the shot picture, and the phenomenon that the picture is in an abnormal shape when displayed is avoided.
2. The electronic device of claim 1,
the AP is further used for cutting out the w < th > picture adjacent to the first sub-picture from the second sub-picture when the first sub-picture is not similar to the second sub-picture2Picture, the w th2The width of the picture is consistent with that of the first sub-picture, and the w-th picture is extracted2The gray values of all pixel points of the picture are counted, the number of the pixel points with the same gray value is counted, the same gray value is arranged in a positive sequence according to the number of the pixel points to obtain a gray value sequence R21Extracting the gray value sequence R21Extracting the gray values of all pixel points of the first sub-picture from the previous P gray values, counting the number of the pixel points with the same gray value, and performing positive sequence on the same gray value according to the number of the pixel pointsArranged to obtain a gray value R11Sequence of extracting the gray value sequence R11Middle and front P gray values, e.g. the gray value sequence R21P gray values before the middle and the gray value sequence R11And if Y is larger than the quantity threshold, the first picture is displayed in a regular display area, and if Y is smaller than the quantity threshold, the second sub-picture is displayed in the regular display area.
3. The electronic device of claim 2,
and the AP is further used for setting the first sub-picture and the second sub-picture as training samples of the neural network model when the Y is determined to be larger than the quantity threshold value, and carrying out training operation on the neural network model to update the weight of the neural network model.
4. A photographing method is applied to an electronic device, and the electronic device comprises: the touch display screen comprises a special-shaped display area and a regular display area, the circuit board is provided with an application processor AP and an angle sensor, a camera is arranged outside the shell, and the camera and the touch display screen are connected with the application processor AP of the circuit board through at least one circuit; the method comprises the following steps:
collecting a first picture and a rotation angle of the electronic equipment;
determining a placement direction of the electronic equipment according to the rotation angle, determining a display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
setting a second sub-picture as a template in a trained neural network model, inputting a first sub-picture into the neural network model to calculate whether the first sub-picture is similar to the second sub-picture, if so, displaying the first picture in the regular area, if not, displaying a second sub-picture in the regular area, and simultaneously displaying the second sub-picture in the regular display area when the first sub-picture is not similar to the second sub-picture;
when a photographing command is obtained, the picture displayed in the regular area is used as a third photographed picture, so that the picture displayed on the touch display screen is consistent with the photographed picture, and the phenomenon that the picture is in an abnormal shape during display is avoided.
5. The method of claim 4, further comprising:
when the first sub-picture is not similar to the second sub-picture, cutting the w-th sub-picture adjacent to the first sub-picture from the second sub-picture2Picture, the w th2The width of the picture is consistent with that of the first sub-picture, and the w-th picture is extracted2The gray values of all pixel points of the picture are counted, the number of the pixel points with the same gray value is counted, the same gray value is arranged in a positive sequence according to the number of the pixel points to obtain a gray value sequence R21Extracting the gray value sequence R21Extracting the gray values of all pixel points of the first sub-picture from the previous P gray values, counting the number of the pixel points with the same gray value, and arranging the same gray value according to the number of the pixel points in a positive sequence to obtain a gray value R11Sequence of extracting the gray value sequence R11Middle and front P gray values, e.g. the gray value sequence R21P gray values before the middle and the gray value sequence R11And if Y is larger than the quantity threshold, the first picture is displayed in a regular display area, and if Y is smaller than the quantity threshold, the second sub-picture is displayed in the regular display area.
6. The method of claim 5, further comprising:
and when the Y is determined to be larger than the quantity threshold value, setting the first sub-picture and the second sub-picture as training samples of the neural network model, and carrying out training operation on the neural network model to update the weight of the neural network model.
7. An electronic device, characterized in that the electronic device comprises: the special-shaped display screen comprises a special-shaped display area and a regular display area;
the camera shooting unit is used for acquiring a first picture;
the angle sensor is used for acquiring the rotation angle of the electronic equipment;
the processing unit is used for determining the placement direction of the electronic equipment according to the rotation angle, determining the display direction of the first picture according to the placement direction, and dividing the first picture into a first sub-picture and a second sub-picture according to the display direction, wherein the first sub-picture is a picture of the first picture in an abnormal display area, and the second sub-picture is a picture of the first picture in a regular display area;
the processing unit is further configured to set the second sub-picture as a template in a trained neural network model, input the first sub-picture into the neural network model, calculate whether the first sub-picture is similar to the second sub-picture, if so, display the first picture in the rule region, if not, display the second sub-picture in the rule region, and simultaneously display the second sub-picture in the rule display region when the first sub-picture is not similar to the second sub-picture;
the processing unit is further used for taking the picture displayed in the regular area as a shot third picture when the shooting command is obtained, so that the picture displayed by the special-shaped display screen is consistent with the shot picture, and the special-shaped shape is prevented from appearing when the picture is displayed.
8. A computer-readable storage medium, characterized in that it stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method according to any one of claims 4-6.
CN201711421917.9A 2017-12-25 2017-12-25 Picture display method and related product Expired - Fee Related CN107864299B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711421917.9A CN107864299B (en) 2017-12-25 2017-12-25 Picture display method and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711421917.9A CN107864299B (en) 2017-12-25 2017-12-25 Picture display method and related product

Publications (2)

Publication Number Publication Date
CN107864299A CN107864299A (en) 2018-03-30
CN107864299B true CN107864299B (en) 2020-08-21

Family

ID=61707478

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711421917.9A Expired - Fee Related CN107864299B (en) 2017-12-25 2017-12-25 Picture display method and related product

Country Status (1)

Country Link
CN (1) CN107864299B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108769362B (en) * 2018-04-12 2021-04-13 Oppo广东移动通信有限公司 Unread message prompting method of application program and related product
CN111182094B (en) * 2018-11-13 2021-11-23 中国移动通信集团广西有限公司 Video file processing method and device
CN111355839B (en) * 2018-12-21 2021-05-04 北京小米移动软件有限公司 Screen display method and device
CN109919845A (en) 2019-03-08 2019-06-21 武汉华星光电技术有限公司 With aperture display image treatment method in screen

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI449022B (en) * 2011-07-11 2014-08-11 Novatek Microelectronics Corp Common voltage driving method, common voltage control apparatus, and display driving circuit
CN106210510B (en) * 2016-06-28 2019-04-30 Oppo广东移动通信有限公司 A kind of photographic method based on Image Adjusting, device and terminal
CN106023820B (en) * 2016-07-29 2018-11-23 京东方科技集团股份有限公司 A kind of pixel arrangement structure, special-shaped display panel and display device
CN106570847B (en) * 2016-10-24 2019-11-22 广州酷狗计算机科技有限公司 The method and apparatus of image procossing
CN106774647A (en) * 2016-11-28 2017-05-31 北京小米移动软件有限公司 Mobile terminal
CN106909224B (en) * 2017-02-28 2018-10-19 维沃移动通信有限公司 A kind of method and mobile terminal at display image preview interface
CN107135302A (en) * 2017-03-20 2017-09-05 深圳市金立通信设备有限公司 A kind of image processing method and terminal device
CN107346650A (en) * 2017-09-14 2017-11-14 厦门天马微电子有限公司 Display panel, display device and scanning drive method

Also Published As

Publication number Publication date
CN107864299A (en) 2018-03-30

Similar Documents

Publication Publication Date Title
CN107197146B (en) Image processing method and device, mobile terminal and computer readable storage medium
CN107967129B (en) Display control method and related product
US11363196B2 (en) Image selection method and related product
CN107864299B (en) Picture display method and related product
CN107644219B (en) Face registration method and related product
CN107480489B (en) unlocking control method and related product
CN110209245B (en) Face recognition method and related product
CN110245601B (en) Eyeball tracking method and related product
CN107633235B (en) Unlocking control method and related product
CN108307106B (en) Image processing method and device and mobile terminal
CN108564915B (en) Brightness adjusting method and related product
CN108108137B (en) Display control method and related product
CN108122528A (en) Display control method and related product
CN108718389B (en) Shooting mode selection method and mobile terminal
CN108600887B (en) Touch control method based on wireless earphone and related product
CN108234765B (en) Electronic equipment and related product
CN108121583B (en) Screen capturing method and related product
CN108877733B (en) Color temperature adjusting method and related device
CN108037874B (en) Screenshotss method and Related product
CN107817963B (en) Image display method, mobile terminal and computer readable storage medium
US20190080152A1 (en) Method for collecting facial information and related products
CN107566654B (en) Unlocking control method and related product
CN108111677B (en) Touch display screen display method of electronic device and related product
CN108111889B (en) Electronic equipment and related product
CN108255632B (en) Fall data calculation method based on artificial intelligence and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200821

CF01 Termination of patent right due to non-payment of annual fee