CN113691729A - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN113691729A
CN113691729A CN202110997327.0A CN202110997327A CN113691729A CN 113691729 A CN113691729 A CN 113691729A CN 202110997327 A CN202110997327 A CN 202110997327A CN 113691729 A CN113691729 A CN 113691729A
Authority
CN
China
Prior art keywords
image
target
processed
attribute information
target video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110997327.0A
Other languages
Chinese (zh)
Other versions
CN113691729B (en
Inventor
殷海光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202110997327.0A priority Critical patent/CN113691729B/en
Publication of CN113691729A publication Critical patent/CN113691729A/en
Application granted granted Critical
Publication of CN113691729B publication Critical patent/CN113691729B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The application discloses an image processing method and device, and belongs to the technical field of information processing. The method comprises the following steps: receiving a target video sent by a first terminal, wherein the target video is synthesized by an image to be processed of the first terminal, and the image to be processed is associated with corresponding image attribute information; under the condition of playing the target video, editing an image to be processed in the target video; converting the edited target video into a target image, and analyzing image attribute information corresponding to the target image; and sequencing the target image and the local image based on the image attribute information.

Description

Image processing method and device
Technical Field
The application belongs to the technical field of information processing, and particularly relates to an image processing method and device.
Background
In order to compare the effect of images shot by different mobile phones, the images need to be transferred to a target mobile phone for image comparison. When the number of the compared images is large, the images need to be led in and out for many times, the operation process is complicated, the consumed time is long, and the user experience is poor.
Disclosure of Invention
The embodiment of the application aims to provide an image processing method and an image processing device, which can solve the problem that the operation process is complicated in the process of comparing the image shooting effects of different terminals.
In a first aspect, an embodiment of the present application provides an image processing method, including:
receiving a target video sent by a first terminal, wherein the target video is synthesized by an image to be processed of the first terminal, and the image to be processed is associated with corresponding image attribute information;
under the condition of playing the target video, editing an image to be processed in the target video;
converting the edited target video into a target image, and analyzing image attribute information corresponding to the target image;
and sequencing the target image and the local image based on the image attribute information.
In a second aspect, an embodiment of the present application provides an image processing method, including:
the image to be processed is integrated into a target video, and the target video is sent to a second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
In a third aspect, an embodiment of the present application provides an image processing apparatus, including:
the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a target video sent by a first terminal, the target video is synthesized by images to be processed of the first terminal, and the images to be processed are associated with corresponding image attribute information;
the editing module is used for editing the image to be processed in the target video under the condition of playing the target video;
the conversion module is used for converting the edited target video into a target image and analyzing image attribute information corresponding to the target image;
and the sequencing module is used for sequencing the target image and the local image based on the image attribute information.
In a fourth aspect, an embodiment of the present application provides an image processing apparatus, including:
the synthesis module is used for synthesizing the image set to be processed into a target video and sending the target video to the second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
In a fifth aspect, the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect or the second aspect.
In a sixth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first or second aspect.
In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect or the second aspect.
In the embodiment of the application, the target video is received by the first receiving terminal, so that the image can be quickly transmitted, and the image transmission process can be simplified; the image to be processed is edited in the process of playing the target video, so that the flexibility of image processing can be improved; and then, the edited target video is converted into a target image, the image attribute information corresponding to the target image is analyzed, and the target image and the local image are sequenced based on the image attribute information, so that a user can conveniently determine the image sequence according to the requirement, the user can conveniently perform image comparison, and the user experience is improved.
Drawings
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a target video display interface to which an image processing method according to an embodiment of the present disclosure is applied;
FIG. 3 is a schematic diagram illustrating ordering of similar images by applying the image processing method according to the embodiment of the present application;
fig. 4 is a second flowchart illustrating an image processing method according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 6 is a second schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device implementing an embodiment of the present application;
fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of the present disclosure.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The following describes in detail an image processing method and an image processing apparatus provided in the embodiments of the present application with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present disclosure. Referring to fig. 1, an embodiment of the present application provides an image processing method, which may include:
step 110, receiving a target video sent by a first terminal, wherein the target video is synthesized by images to be processed of the first terminal, and the images to be processed are associated with corresponding image attribute information;
step 120, editing the image to be processed in the target video under the condition of playing the target video;
step 130, converting the edited target video into a target image, and analyzing image attribute information corresponding to the target image;
and step 140, ordering the target image and the local image based on the image attribute information.
The execution subject of the image processing method provided by the application can be an electronic device, a component in the electronic device, an integrated circuit, or a chip. The electronic device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a terminal, such as a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), and the like, and the present application is not limited in particular.
The following describes the technical solution of the present application in detail by taking an example in which a terminal executes the image processing method provided by the present application.
Optionally, in step 110, the second terminal receives the target video sent by the first terminal. The second terminal may be the same terminal type as the first terminal. For example: the second terminal and the first terminal are both mobile phones. When the first mobile phone and the second mobile phone establish communication connection, the first mobile phone sends the manufactured target video to the second mobile phone through mutual transmission tools such as chat tools, Wi-Fi connection or Bluetooth and the like.
The target video is a video synthesized by images to be processed in the first terminal and comprises image attribute information corresponding to the images to be processed.
Optionally, in step 120, after receiving the target video, the second terminal may edit the to-be-processed image in the target video when playing the target video according to a user requirement. Each frame of image of the target video corresponds to one to-be-processed image, the display duration of each to-be-processed image in the target video can be preset, and the video duration of the target video can be determined by accumulating the display durations of all to-be-processed images. As shown in fig. 2, the image to be processed of the current display interface of the target video is a picture 1. When the target video is played, the required images can be selected to be stored, and the unnecessary images can be deleted. After the target video is edited, the remaining target images in the target video may be determined.
Optionally, in step 130, the second terminal converts the target video, acquires the target image and image attribute information corresponding to the target image, and then embeds the image attribute information into the target image. And finally, storing the target image and the corresponding image attribute information in the second terminal, and displaying the target image and the corresponding image attribute information.
Alternatively, in step 140, the second terminal may arrange the target images and the local images having the image attribute information with the same characteristics according to the image attribute information, or may integrally order all the target images and the local images based on the image attribute information.
According to the image processing method provided by the embodiment of the application, the target video is received by the first terminal, so that the image can be rapidly transmitted, and the image transmission process can be simplified; the image to be processed is edited in the process of playing the target video, so that the flexibility of image processing can be improved; and then, the edited target video is converted into a target image, the image attribute information corresponding to the target image is analyzed, and the target image and the local image are sequenced based on the image attribute information, so that a user can conveniently determine the image sequence according to the requirement, the user can conveniently perform image comparison, and the user experience is improved.
In one embodiment, the sorting the target image and the local image based on the image attribute information includes:
sequencing the target image and the local image based on a preset condition;
the preset condition comprises at least one of the following conditions:
the image similarity of the target image and the local image is greater than a first preset threshold value;
the shooting time difference value of the target image and the local image is smaller than a second preset threshold value;
wherein the image similarity and the photographing time difference value are determined based on the image attribute information.
Alternatively, according to the image attribute information, the image similarity between images and the difference in photographing time may be determined, so that the preset condition may be determined. The second terminal may sort the target image and the local image based on a preset condition.
Optionally, after saving the target image, the target image and the local image in the second terminal may be sorted based on the image similarity or the shooting time, or sorted based on the image similarity and the shooting time. The local image is an image stored in the second terminal, and may be an image shot by the second terminal in advance, or an image shot by another terminal.
Optionally, when the ranking is performed based on the image similarity, the image similarity between the target image and the local image may be determined first, and then the target image and the local image with the image similarity greater than the first preset threshold may be stored in adjacent positions. When the images are sorted based on the shooting time difference, the shooting time difference between the target image and the local image can be determined firstly, and then the target image and the local image with the shooting time difference smaller than the second preset threshold value are stored in adjacent positions, so that a user can conveniently check the effects of shooting the images at different terminals.
The first preset threshold and the second preset threshold are preset, and the application is not limited specifically. For example: if the first preset threshold is set to be 80%, the local image and the target image with the image similarity exceeding 80% are stored in adjacent positions; and setting the second preset threshold value as 1 minute, and storing the local image and the target image with the shooting time difference smaller than 1 minute at adjacent positions.
Optionally, when images are sorted based on the image similarity and the shooting time, the images may be sorted according to the shooting time difference, then the image similarity of each target image and the image adjacent to the shooting time of the local image are compared, and the similar images with the image similarity larger than the first preset threshold are sorted in advance. Or the images are sorted according to the similarity of the shot images, then the shooting time difference value of each target image and the image adjacent to the shooting time of the local image is compared, and the adjacent images with the shooting time difference value smaller than the second preset threshold value are sorted in advance. As shown in fig. 3, similar images whose shooting times are close and whose image similarity is greater than a threshold value are arranged in front, and the arrangement order between the similar images is not particularly limited in this application.
Optionally, the second terminal may compare the stored local image with the target image; or local images or target images.
According to the image processing method provided by the embodiment of the application, the target image and the local image are sequenced based on the preset condition, so that the similar image can be quickly searched, and a user can conveniently compare the shooting effect of the similar image.
In one embodiment, the sorting the target image and the local image based on a preset condition includes:
sorting the target image and the local image based on a preset priority of the preset condition;
and the preset priority of the image similarity is higher than the preset priority of the shooting time difference.
Optionally, the second terminal is easier to observe the effect of the shot image compared with similar images shot by different terminals. Therefore, when the images can be sorted by the image similarity and the shooting time difference, the sorting is preferentially carried out based on the image similarity. And setting corresponding priorities for the preset conditions of image sequencing in the second terminal, wherein the priority with the image similarity is higher than the priority of the shooting time difference.
Optionally, the images with the image similarity greater than the first preset threshold or the target images with the shooting time difference smaller than the second preset threshold and the local images are determined as similar images, and the image similarity or the shooting time is used as the association relationship between the similar images. When one of the similar images is selected, other similar images in the video can be quickly acquired according to the association relationship, and the storage positions of the other similar images in the second terminal can be determined.
According to the image processing method provided by the embodiment of the application, the target image and the local image are sequenced by preferentially taking the image similarity larger than the first preset threshold, so that the similar image can be quickly searched, and the shooting effect of the similar image is conveniently compared by a user.
In one embodiment, the editing the image to be processed in the target video while playing the target video includes:
under the condition of playing the target video, receiving a first input of a user to the image to be processed;
in response to the first input, removing the image to be processed.
Optionally, in the case of playing the target video, each to-be-processed picture in the target video may be edited according to a user requirement. The user can perform a sliding operation on the currently displayed image to be processed through the video interface, and can delete the image in the following two ways.
The first method is as follows: and after the second terminal receives the sliding operation of the user on the video interface, the second terminal marks the currently displayed image to be processed as a pre-deleted image in response to the sliding operation of the user, and then continues to play the subsequent video part. And when the target video is edited and the video is converted into the image, the second terminal deletes the marked pre-deleted image and stores the target image without the mark.
The second method comprises the following steps: and after the second terminal receives the sliding operation of the user on the video interface, the second terminal directly deletes the currently displayed image to be processed in response to the sliding operation of the user and then continues to play the subsequent video part. And when the target video is edited and the video is converted into the image, the second terminal directly restores the edited video into the target image.
Optionally, the sliding operation may be sliding up and down, sliding left and right, or sliding with a designated gesture, and the present application is not limited specifically.
According to the image processing method provided by the embodiment of the application, the image to be processed in the target video is edited under the condition that the target video is played, so that the flexibility of image processing can be improved; by deleting the target image according to the requirement, the efficiency of image comparison can be improved.
In one embodiment, the converting the edited target video into a target image and analyzing image attribute information corresponding to the target image includes:
analyzing the edited target video into a target image set;
traversing the target image set, converting images in the target image set into target images, and analyzing image attribute information corresponding to the target images;
embedding the image attribute information in the target image.
Optionally, the second terminal parses the edited target video into a corresponding target image set, and then traverses from the target image set. Each image in the target image set is an image object, each target image and the contained image attribute information can be analyzed, and the image attribute information is embedded into the target image and stored in the second terminal. Finally, the second terminal can present the target image and the image attribute information.
Alternatively, if the target video is edited in a manner that the pre-deleted image is marked during editing, the second terminal deletes the marked image object during traversing the target image set, and does not parse the marked image object into an image. If the target video is edited in a mode, namely the pre-deleted image is directly removed during editing, the next image in the image set moves forwards and directly covers the previous image object, so that the deleted object does not exist, and the image object is not required to be deleted again in the traversal process. And the second terminal can directly restore the target image in the video when traversing the target image set in the second mode.
According to the image processing method provided by the embodiment of the application, the images in the target image set can be rapidly extracted by traversing the target image set, each image and corresponding image attribute information are analyzed, and the image comparison efficiency is further improved.
In one embodiment, the image processing method further comprises:
and retrieving the target image and the local image according to the image attribute information to obtain an image corresponding to the image attribute information.
Optionally, after the target image and the corresponding image attribute information are acquired, the second terminal may store all currently stored images in a classified manner according to the image attribute information, and may retrieve all images under the current image attribute information based on the user requirement.
According to the image processing method provided by the embodiment of the application, the corresponding image is obtained through the retrieval of the image attribute information, the image with the corresponding attribute can be quickly found, the image contrast form can be diversified, and the user experience is improved.
In one embodiment, the image attribute information includes at least one of: shooting time, shooting position, image pixel, image memory, shooting model and shooting parameters.
Optionally, the second terminal stores the target image and the local image, and corresponding image attribute information, where the image attribute information includes a plurality of attribute information such as shooting time, shooting location, image pixel, image memory, camera type, shooting parameter, and so on, so that the image can be retrieved by at least one attribute.
For example: the image of the second terminal and the image of the first terminal can be retrieved according to the camera type, so that the effect of the image shot by the same terminal can be compared.
Alternatively, the image attribute information may be transmitted from the first terminal to the second terminal through the target video, and the image attribute information may be restored by parsing the target video, so that the second terminal can retrieve the image captured by the first terminal according to the image attribute information.
According to the image processing method provided by the embodiment of the application, the corresponding image is obtained through specific image attribute information retrieval, the image with the corresponding attribute can be quickly found, and the user experience is improved; and the images and the image attribute information of different terminals can be transmitted through the target video, so that the processes of image migration and image comparison are simplified.
In one embodiment, the image processing method further includes:
receiving a second input to a first image under the condition that the target image and the local image are arranged according to a first sequence, wherein the first image is any image in the target image or the local image;
if the first image is an image in the target images, displaying the target images related to the first image according to the sequence of the first image in the target video;
and if the first image is an image in the local images, displaying the image associated with the first image according to the sequence of the first image in the local images.
Alternatively, the association relationship between the images may be determined according to the image attribute information. The images having an association relationship include, for example: the method comprises the steps of shooting images from seven to seven and a half night, storing target images with the image memory more than 10M, shooting images with parameters of flash, shooting target images with the shooting time difference smaller than a second preset threshold, images with the image similarity larger than a first preset threshold, or images with the same shooting parameters and different shooting times.
Alternatively, the target image and the local image may be arranged in the first order based on the image attribute information. And receiving a second input of selecting the first image by the user, wherein the second input can be clicking or long-pressing on the first image and the like to select the first image, and the first image can be any image in the target image or the local image. The second terminal may acquire all images having an association relationship with the first image in response to the second input. And arranging the associated first images at different positions together for display on a target interface of the second terminal.
Optionally, the target image associated with the first image is determined according to the order of the first image in the target video and the input parameters of the second input.
Optionally, the first order is such that the target image is interspersed with the local image. For example, the local images are A, B and C, the target images are D, E and F, and A, D, B, E, C, F is obtained after sorting according to the image attribute information, when the first image is E, D is displayed according to the sequence of the first image in the target video when sliding left, and F is displayed according to the sequence of the first image in the target video when sliding right; if the first image is B, sliding left, displaying A according to the sequence of the first image in the local image, and sliding right, displaying C according to the sequence of the first image in the local image.
Alternatively, in the case where the first image is an image in the target image, the target image associated with the first image may be displayed according to the order of the first image in the target video. The first image and the associated target image may be all displayed on the terminal interface, or each image may be sequentially displayed by sliding the target image. In the case where the first image is an image in the local image, an image associated with the first image may be displayed according to the order of the first image in the local image. The first image and the associated local image can be all displayed on the terminal interface, or each image can be sequentially displayed by sliding the images.
For example: and determining the images with the image similarity of more than 80% or the target images or the local images with the shooting time difference of less than 5 minutes as similar images, and taking the image similarity or the shooting time as the association relationship among the similar images. When any one of the similar images is selected, other similar images in non-adjacent positions in the video can be quickly acquired according to the association relationship. Assuming that the selected first image is B and the other images having the association relationship are a and C, when the selected first image is B, sliding the image to the left can display the image a, and sliding the image to the right can display the image C.
According to the image processing method provided by the embodiment of the application, by establishing the association relationship between the images, under the condition that the target images and the local images are arranged in sequence, the target images with the association relationship can be quickly acquired, and the associated target images are arranged together, so that the image comparison efficiency is improved.
Fig. 4 is a second flowchart of an image processing method according to the embodiment of the present application. Referring to fig. 4, an embodiment of the present application provides an image processing method, which may include:
step 410, synthesizing the image set to be processed into a target video, and sending the target video to a second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
Optionally, in step 410, the image to be processed that needs to be transmitted is determined according to the user requirement. The first terminal packages each image to be processed into an image object separately, then stores all the image objects into a set of images to be processed, and then prepares the set of images to be processed into a target video. The image objects in the set of images to be processed also include image attribute information, such as: various detailed information such as shooting time, shooting position, image pixel, image memory, camera model, shooting parameters, and the like. And finally, the first terminal sends the target video to the second terminal.
According to the image processing method provided by the embodiment of the application, the image to be processed and the corresponding image attribute information are synthesized into the target video and transmitted, so that the image transmission process can be simplified, the rapid image migration is realized, and the image comparison efficiency is further improved.
It should be noted that, in the image processing method provided in the embodiment of the present application, the execution subject may be an image processing apparatus, or a control module in the image processing apparatus for executing the image processing method. The image processing apparatus provided in the embodiment of the present application is described with an example in which an image processing apparatus executes an image processing method.
Fig. 5 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. Referring to fig. 5, an embodiment of the present application provides an image processing apparatus, which may include:
a first receiving module 510, configured to receive a target video sent by a first terminal, where the target video is synthesized by an image to be processed of the first terminal, and the image to be processed is associated with corresponding image attribute information;
an editing module 520, configured to edit an image to be processed in the target video when the target video is played;
a converting module 530, configured to convert the edited target video into a target image, and analyze image attribute information corresponding to the target image;
a sorting module 540, configured to sort the target image and the local image based on the image attribute information.
The image processing device provided by the embodiment of the application can realize rapid image transmission and simplify the image transmission process by receiving the target video received by the first terminal; the image to be processed is edited in the process of playing the target video, so that the flexibility of image processing can be improved; and then, the edited target video is converted into a target image, the image attribute information corresponding to the target image is analyzed, and the target image and the local image are sequenced based on the image attribute information, so that a user can conveniently determine the image sequence according to the requirement, the user can conveniently perform image comparison, and the user experience is improved.
In one embodiment, the conversion module 530 is specifically configured to:
analyzing the edited target video into a target image set;
traversing the target image set, converting images in the target image set into target images, and analyzing image attribute information corresponding to the target images;
embedding the image attribute information in the target image.
In one embodiment, the sorting module 540 is specifically configured to:
sequencing the target image and the local image based on a preset condition;
the preset condition comprises at least one of the following conditions:
the image similarity of the target image and the local image is greater than a first preset threshold value;
the shooting time difference value of the target image and the local image is smaller than a second preset threshold value;
wherein the image similarity and the photographing time difference value are determined based on the image attribute information.
In an embodiment, the sorting module 540 is further specifically configured to:
sorting the target image and the local image based on a preset priority of the preset condition;
and the preset priority of the image similarity is higher than the preset priority of the shooting time difference.
In one embodiment, the editing module 520 is further specifically configured to:
under the condition of playing the target video, receiving a first input of a user to the image to be processed;
in response to the first input, removing the image to be processed.
In one embodiment, the image processing apparatus further includes:
a second receiving module (not shown in the figure), which receives a second input to a first image under the condition that the target image and the local image are arranged according to a first sequence, wherein the first image is any image in the target image or the local image;
a display module (not shown in the figure) for displaying a target image associated with the first image according to the sequence of the first image in the target video if the first image is one of the target images;
and if the first image is an image in the local images, displaying the image associated with the first image according to the sequence of the first image in the local images.
Fig. 6 is a second schematic structural diagram of an image processing apparatus according to an embodiment of the present application. Referring to fig. 6, an embodiment of the present application provides an image processing apparatus, which may include:
the synthesizing module 610 is configured to synthesize the image set to be processed into a target video, and send the target video to a second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
According to the image processing device provided by the embodiment of the application, the image to be processed and the corresponding image attribute information are synthesized into the target video and transmitted, so that the image transmission process can be simplified, the rapid image migration is realized, and the image comparison efficiency is further improved.
The image processing apparatus in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
The image processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 1 to fig. 4, and is not described herein again to avoid repetition.
Optionally, as shown in fig. 7, an electronic device 700 is further provided in an embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the image processing method embodiment, and can achieve the same technical effect, and no further description is provided here to avoid repetition.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.
Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
The processor 810 is configured to receive a target video sent by a first terminal, where the target video is synthesized by an image to be processed of the first terminal, and the image to be processed is associated with corresponding image attribute information;
under the condition of playing the target video, editing an image to be processed in the target video;
converting the edited target video into a target image, and analyzing image attribute information corresponding to the target image;
and sequencing the target image and the local image based on the image attribute information.
According to the electronic equipment provided by the embodiment of the application, the target video is received by the first terminal, so that the image can be quickly transmitted, and the image transmission process can be simplified; the image to be processed is edited in the process of playing the target video, so that the flexibility of image processing can be improved; and then, the edited target video is converted into a target image, the image attribute information corresponding to the target image is analyzed, and the target image and the local image are sequenced based on the image attribute information, so that a user can conveniently determine the image sequence according to the requirement, the user can conveniently perform image comparison, and the user experience is improved.
Optionally, the processor 810 is specifically configured to convert the edited target video into a target image, and analyze image attribute information corresponding to the target image, and includes:
analyzing the edited target video into a target image set;
traversing the target image set, converting images in the target image set into target images, and analyzing image attribute information corresponding to the target images;
embedding the image attribute information in the target image.
Optionally, the processor 810 is further specifically configured to sort the target image and the local image based on the image attribute information, and includes:
sequencing the target image and the local image based on a preset condition;
the preset condition comprises at least one of the following conditions:
the image similarity of the target image and the local image is greater than a first preset threshold value;
the shooting time difference value of the target image and the local image is smaller than a second preset threshold value;
wherein the image similarity and the photographing time difference value are determined based on the image attribute information.
Optionally, the processor 810 is further specifically configured to sort the target image and the local image based on the preset condition, and includes:
sorting the target image and the local image based on a preset priority of the preset condition;
and the preset priority of the image similarity is higher than the preset priority of the shooting time difference.
Optionally, the processor 810 is further specifically configured to receive a first input of the to-be-processed image by the user in the case of playing the target video;
in response to the first input, removing the image to be processed.
Optionally, the processor 810 is further specifically configured to retrieve the target image and the local image according to the image attribute information, and obtain an image corresponding to the image attribute information.
Optionally, the processor 810 is further specifically configured to receive a second input to a first image when the target image and the local image are arranged according to a first order, where the first image is any image of the target image or the local image;
if the first image is an image in the target images, displaying the target images related to the first image according to the sequence of the first image in the target video;
and if the first image is an image in the local images, displaying the image associated with the first image according to the sequence of the first image in the local images.
Or, the processor 810 is configured to synthesize a set of images to be processed into a target video, and send the target video to a second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
According to the electronic equipment provided by the embodiment of the application, the image to be processed and the corresponding image attribute information are synthesized into the target video and transmitted, so that the image transmission process can be simplified, the rapid image migration is realized, and the image comparison efficiency is further improved.
It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the embodiment of the image processing method, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (12)

1. An image processing method, comprising:
receiving a target video sent by a first terminal, wherein the target video is synthesized by an image to be processed of the first terminal, and the image to be processed is associated with corresponding image attribute information;
under the condition of playing the target video, editing an image to be processed in the target video;
converting the edited target video into a target image, and analyzing image attribute information corresponding to the target image;
and sequencing the target image and the local image based on the image attribute information.
2. The image processing method according to claim 1, wherein the converting the edited target video into a target image and analyzing image attribute information corresponding to the target image comprises:
analyzing the edited target video into a target image set;
traversing the target image set, converting images in the target image set into target images, and analyzing image attribute information corresponding to the target images;
embedding the image attribute information in the target image.
3. The image processing method according to claim 1, wherein the sorting the target image and the local image based on the image attribute information comprises:
sequencing the target image and the local image based on a preset condition;
the preset condition comprises at least one of the following conditions:
the image similarity of the target image and the local image is greater than a first preset threshold value;
the shooting time difference value of the target image and the local image is smaller than a second preset threshold value;
wherein the image similarity and the photographing time difference value are determined based on the image attribute information.
4. The image processing method according to claim 3, wherein the sorting the target image and the local image based on the preset condition comprises:
sorting the target image and the local image based on a preset priority of the preset condition;
and the preset priority of the image similarity is higher than the preset priority of the shooting time difference.
5. The image processing method according to claim 1, wherein editing the image to be processed in the target video while playing the target video comprises:
under the condition of playing the target video, receiving a first input of a user to the image to be processed;
in response to the first input, removing the image to be processed.
6. The image processing method according to claim 1, further comprising:
and retrieving the target image and the local image according to the image attribute information to obtain an image corresponding to the image attribute information.
7. The image processing method according to claim 1, further comprising:
receiving a second input to a first image under the condition that the target image and the local image are arranged according to a first sequence, wherein the first image is any image in the target image or the local image;
if the first image is an image in the target images, displaying the target images related to the first image according to the sequence of the first image in the target video;
and if the first image is an image in the local images, displaying the image associated with the first image according to the sequence of the first image in the local images.
8. An image processing method, comprising:
the image to be processed is integrated into a target video, and the target video is sent to a second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
9. An image processing apparatus characterized by comprising:
the system comprises a first receiving module, a second receiving module and a third receiving module, wherein the first receiving module is used for receiving a target video sent by a first terminal, the target video is synthesized by images to be processed of the first terminal, and the images to be processed are associated with corresponding image attribute information;
the editing module is used for editing the image to be processed in the target video under the condition of playing the target video;
the conversion module is used for converting the edited target video into a target image and analyzing image attribute information corresponding to the target image;
and the sequencing module is used for sequencing the target image and the local image based on the image attribute information.
10. An image processing apparatus characterized by comprising:
the synthesis module is used for synthesizing the image set to be processed into a target video and sending the target video to the second terminal;
the image set to be processed comprises the image to be processed and image attribute information corresponding to the image to be processed.
11. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the image processing method according to any one of claims 1 to 7 or implementing the steps of the image processing method according to claim 8.
12. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image processing method according to any one of claims 1 to 7, or implement the steps of the image processing method according to claim 8.
CN202110997327.0A 2021-08-27 2021-08-27 Image processing method and device Active CN113691729B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110997327.0A CN113691729B (en) 2021-08-27 2021-08-27 Image processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110997327.0A CN113691729B (en) 2021-08-27 2021-08-27 Image processing method and device

Publications (2)

Publication Number Publication Date
CN113691729A true CN113691729A (en) 2021-11-23
CN113691729B CN113691729B (en) 2023-08-22

Family

ID=78583500

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110997327.0A Active CN113691729B (en) 2021-08-27 2021-08-27 Image processing method and device

Country Status (1)

Country Link
CN (1) CN113691729B (en)

Citations (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1499888A (en) * 2002-11-12 2004-05-26 欧姆龙株式会社 Mobile terminal device, image printing appts. and image communication management server
CN101437098A (en) * 2007-11-13 2009-05-20 夏普株式会社 Information processing apparatus, and information processing method,
CN105407273A (en) * 2015-10-30 2016-03-16 小米科技有限责任公司 Image photographing method, device and terminal
CN105493496A (en) * 2014-12-14 2016-04-13 深圳市大疆创新科技有限公司 Video processing method, and device and image system
CN106558034A (en) * 2015-09-30 2017-04-05 北京奇虎科技有限公司 A kind of method and apparatus for clearing up view data in a mobile device
CN107480176A (en) * 2017-07-01 2017-12-15 珠海格力电器股份有限公司 A kind of management method of picture, device and terminal device
CN107679561A (en) * 2017-09-15 2018-02-09 广东欧珀移动通信有限公司 Image processing method and device, system, computer equipment
CN107918529A (en) * 2017-11-29 2018-04-17 广东欧珀移动通信有限公司 Image processing method and device, computer equipment, computer-readable recording medium
CN107948460A (en) * 2017-11-30 2018-04-20 广东欧珀移动通信有限公司 Image processing method and device, computer equipment, computer-readable recording medium
CN107944371A (en) * 2017-11-17 2018-04-20 辽宁公安司法管理干部学院 A kind of public security video monitoring image processing method based on data mining
CN108337543A (en) * 2017-12-27 2018-07-27 努比亚技术有限公司 A kind of video broadcasting method, terminal and computer readable storage medium
CN108965599A (en) * 2018-07-23 2018-12-07 Oppo广东移动通信有限公司 Recall method for processing video frequency and Related product
CN108985228A (en) * 2018-07-16 2018-12-11 百度在线网络技术（北京）有限公司 Information generating method and device applied to terminal device
CN109151338A (en) * 2018-07-10 2019-01-04 Oppo广东移动通信有限公司 Image processing method and related product
CN110267008A (en) * 2019-06-28 2019-09-20 Oppo广东移动通信有限公司 Image processing method, device, server and storage medium
CN110377791A (en) * 2018-04-11 2019-10-25 刘谨铭 Fast image sort method
CN110825288A (en) * 2019-10-31 2020-02-21 维沃移动通信有限公司 Image screening processing method and electronic equipment
CN111371999A (en) * 2020-03-17 2020-07-03 Oppo广东移动通信有限公司 Image management method, device, terminal and storage medium
CN111475675A (en) * 2020-04-07 2020-07-31 深圳市超高清科技有限公司 Video processing system
CN111601035A (en) * 2020-05-08 2020-08-28 维沃移动通信有限公司 Image processing method and electronic equipment
CN111953903A (en) * 2020-08-13 2020-11-17 北京达佳互联信息技术有限公司 Shooting method, shooting device, electronic equipment and storage medium
CN112203142A (en) * 2020-12-03 2021-01-08 浙江岩华文化科技有限公司 Video processing method and device, electronic device and storage medium
CN112199547A (en) * 2019-07-08 2021-01-08 Oppo广东移动通信有限公司 Image processing method and device, storage medium and electronic equipment
CN112287911A (en) * 2020-12-25 2021-01-29 长沙海信智能系统研究院有限公司 Data labeling method, device, equipment and storage medium
CN112418058A (en) * 2020-11-19 2021-02-26 上海哔哩哔哩科技有限公司 Video processing method and device
CN112822393A (en) * 2020-12-29 2021-05-18 维沃移动通信有限公司 Image processing method and device and electronic equipment
CN112905843A (en) * 2021-03-17 2021-06-04 北京文香信息技术有限公司 Information processing method and device based on video stream and storage medium
CN113093960A (en) * 2021-04-16 2021-07-09 南京维沃软件技术有限公司 Image editing method, editing device, electronic device and readable storage medium

Patent Citations (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1499888A (en) * 2002-11-12 2004-05-26 欧姆龙株式会社 Mobile terminal device, image printing appts. and image communication management server
CN101437098A (en) * 2007-11-13 2009-05-20 夏普株式会社 Information processing apparatus, and information processing method,
CN105493496A (en) * 2014-12-14 2016-04-13 深圳市大疆创新科技有限公司 Video processing method, and device and image system
CN106558034A (en) * 2015-09-30 2017-04-05 北京奇虎科技有限公司 A kind of method and apparatus for clearing up view data in a mobile device
CN105407273A (en) * 2015-10-30 2016-03-16 小米科技有限责任公司 Image photographing method, device and terminal
CN107480176A (en) * 2017-07-01 2017-12-15 珠海格力电器股份有限公司 A kind of management method of picture, device and terminal device
CN107679561A (en) * 2017-09-15 2018-02-09 广东欧珀移动通信有限公司 Image processing method and device, system, computer equipment
CN107944371A (en) * 2017-11-17 2018-04-20 辽宁公安司法管理干部学院 A kind of public security video monitoring image processing method based on data mining
CN107918529A (en) * 2017-11-29 2018-04-17 广东欧珀移动通信有限公司 Image processing method and device, computer equipment, computer-readable recording medium
CN107948460A (en) * 2017-11-30 2018-04-20 广东欧珀移动通信有限公司 Image processing method and device, computer equipment, computer-readable recording medium
CN108337543A (en) * 2017-12-27 2018-07-27 努比亚技术有限公司 A kind of video broadcasting method, terminal and computer readable storage medium
CN110377791A (en) * 2018-04-11 2019-10-25 刘谨铭 Fast image sort method
CN109151338A (en) * 2018-07-10 2019-01-04 Oppo广东移动通信有限公司 Image processing method and related product
CN108985228A (en) * 2018-07-16 2018-12-11 百度在线网络技术（北京）有限公司 Information generating method and device applied to terminal device
CN108965599A (en) * 2018-07-23 2018-12-07 Oppo广东移动通信有限公司 Recall method for processing video frequency and Related product
CN110267008A (en) * 2019-06-28 2019-09-20 Oppo广东移动通信有限公司 Image processing method, device, server and storage medium
CN112199547A (en) * 2019-07-08 2021-01-08 Oppo广东移动通信有限公司 Image processing method and device, storage medium and electronic equipment
CN110825288A (en) * 2019-10-31 2020-02-21 维沃移动通信有限公司 Image screening processing method and electronic equipment
CN111371999A (en) * 2020-03-17 2020-07-03 Oppo广东移动通信有限公司 Image management method, device, terminal and storage medium
CN111475675A (en) * 2020-04-07 2020-07-31 深圳市超高清科技有限公司 Video processing system
CN111601035A (en) * 2020-05-08 2020-08-28 维沃移动通信有限公司 Image processing method and electronic equipment
CN111953903A (en) * 2020-08-13 2020-11-17 北京达佳互联信息技术有限公司 Shooting method, shooting device, electronic equipment and storage medium
CN112418058A (en) * 2020-11-19 2021-02-26 上海哔哩哔哩科技有限公司 Video processing method and device
CN112203142A (en) * 2020-12-03 2021-01-08 浙江岩华文化科技有限公司 Video processing method and device, electronic device and storage medium
CN112287911A (en) * 2020-12-25 2021-01-29 长沙海信智能系统研究院有限公司 Data labeling method, device, equipment and storage medium
CN112822393A (en) * 2020-12-29 2021-05-18 维沃移动通信有限公司 Image processing method and device and electronic equipment
CN112905843A (en) * 2021-03-17 2021-06-04 北京文香信息技术有限公司 Information processing method and device based on video stream and storage medium
CN113093960A (en) * 2021-04-16 2021-07-09 南京维沃软件技术有限公司 Image editing method, editing device, electronic device and readable storage medium

Also Published As

Publication number Publication date
CN113691729B (en) 2023-08-22

Similar Documents

Publication Publication Date Title
CN111612873B (en) GIF picture generation method and device and electronic equipment
CN111901896A (en) Information sharing method, information sharing device, electronic equipment and storage medium
CN112486385A (en) File sharing method and device, electronic equipment and readable storage medium
CN113014801B (en) Video recording method, video recording device, electronic equipment and medium
CN112083854A (en) Application program running method and device
CN111601012B (en) Image processing method and device and electronic equipment
CN113794834A (en) Image processing method and device and electronic equipment
CN113010738B (en) Video processing method, device, electronic equipment and readable storage medium
CN112187626B (en) File processing method and device and electronic equipment
CN114040248A (en) Video processing method and device and electronic equipment
CN111641868A (en) Preview video generation method and device and electronic equipment
CN113691729A (en) Image processing method and device
CN113127425B (en) Picture processing method and device and electronic equipment
CN113163256B (en) Method and device for generating operation flow file based on video
CN113271378B (en) Image processing method and device and electronic equipment
CN113987241A (en) Image display method, image display device, electronic apparatus, and readable storage medium
CN113593614A (en) Image processing method and device
CN113779293A (en) Image downloading method, device, electronic equipment and medium
CN113473012A (en) Virtualization processing method and device and electronic equipment
CN113347355A (en) Image processing method and device and electronic equipment
CN112287706A (en) Code scanning interaction method and device
CN112084151A (en) File processing method and device and electronic equipment
CN111813741A (en) File sharing method and electronic equipment
CN111984173B (en) Expression package generation method and device
CN113037618B (en) Image sharing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant