CN116830558A - Artificial intelligence based cut copy paste - Google Patents
Artificial intelligence based cut copy paste Download PDFInfo
- Publication number
- CN116830558A CN116830558A CN202280010185.7A CN202280010185A CN116830558A CN 116830558 A CN116830558 A CN 116830558A CN 202280010185 A CN202280010185 A CN 202280010185A CN 116830558 A CN116830558 A CN 116830558A
- Authority
- CN
- China
- Prior art keywords
- network device
- image
- application
- server
- aicutpaste
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013473 artificial intelligence Methods 0.000 title description 3
- 238000000034 method Methods 0.000 claims abstract description 72
- 239000000284 extract Substances 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 5
- 238000012546 transfer Methods 0.000 abstract description 6
- 238000007796 conventional method Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000015654 memory Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000010076 replication Effects 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000032823 cell division Effects 0.000 description 1
- 238000010367 cloning Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000004557 technical material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A method (600) and system (500) for transmitting an object from a first network device to a second network device of a network are disclosed. Conventional techniques focus only on copying the object from one device to the same device, but do not allow a user to cut or copy data from one device and paste the data onto a different device. Thus, it is necessary to transfer data between two different devices, i.e. to cut or copy data from one device, such as an image or a part of an image or an object in an image, and paste the data onto any other device within the network. The method (600) comprises: transmitting (S601) an image comprising at least one object to a server; extracting (S602) the at least one object from the image received from the first network device; -transmitting (S603) the at least one object extracted from the image to a second network device.
Description
Technical Field
The subject matter described herein relates generally to improved tools for data acquisition, transmission, and replication, and more particularly to methods and systems for transmitting data between two devices.
Background
In man-machine interaction and user interface design, cut, copy and paste are related commands, providing inter-process communication techniques for transmitting data through a computer user interface. A "cut" command is used to delete selected data from its original location, while a "copy" command is used to create a copy; in both cases, the selected data is stored in temporary memory, and a "paste" command is used to visually insert the selected data at the insertion point. Wherever a paste command is issued, the data in this temporary memory is inserted later. The data is still available to any application supporting this functionality, thereby making data transfer between applications easier.
The user selects or "highlights" the text or file to be moved by some means, typically by dragging the text or file name using a pointing device, or pressing the Shift key while moving the text cursor using the arrow keys. Cloning, copying, inheritance, or reuse, among other terms, refers to the transfer of such information through a file. The command names cut, copy, paste, etc. are interface metaphors based on the physical processes used to create the page layout in manuscript editing.
Traditional computer-based editing involves very frequent cut and paste operations. Most software vendors offer several methods of performing such tasks, which may involve combination keys, drop-down menus, pop-up menu or toolbar buttons, etc. Conceptually, the data that is cut or copied will move to a temporary location commonly referred to as a clipboard. The clipboard typically remains invisible.
Thus, a disadvantage of conventional cut-copy paste operations used over time is that data (e.g., without limitation, images or text or multimedia content/files) cut or copied from one document/location of a device can only be pasted onto the same or different document/location of the same device. Thus, a cut copy paste operation is device specific or limited to only the device for which the data or file is being cut or copied. The user is not allowed to cut or copy data from one device and paste the data onto a different device.
Thus, there is a need for transferring/copying data between two devices, i.e., the ability to cut or copy data (such as, but not limited to, an image or a portion of an image or an object in an image) from one device and paste the image or the portion of the image or the object in the image onto any other device within the network in real time.
The above-described need to transfer/copy data in real-time between two devices is intended only to provide an overview of some of the disadvantages of conventional systems/mechanisms/techniques, and is not exhaustive. Other problems/disadvantages of conventional systems/mechanisms/techniques and corresponding advantages of the various non-limiting embodiments described herein will become more apparent with reference to the following description.
Disclosure of Invention
The summary is provided to introduce concepts related to a method and system for real-time transfer of objects from a first network device to a second network device that are further described below in the detailed description. This summary is not intended to identify key features of the claimed subject matter, nor is it intended to be used to determine or limit the scope of the claimed subject matter.
It is an object of the present application to provide data transmission/duplication between two devices.
It is a further object of the application to cut or copy data (e.g. an image or a part of an image or an object in an image) from one device and paste the data onto another device in real time.
In particular, the present application discloses a method and system for real-time transfer of objects from a first network device to a second network device, overcoming the drawbacks associated with the prior art.
According to a first aspect of the present application, there is provided a method for transmitting data between network devices of a network. The method comprises the following steps: the first network device sending an image comprising at least one object to an AICutPaste server; the AICutPaste server extracting the at least one object from the image received from the first network device; the AICutPaste server sending the at least one object extracted from the image to the first network device; the first network device sends the at least one object or the image extracted from the image to a second application of a second network device.
In a first possible implementation manner of the method according to the first aspect, before the first network device sends the image including at least one object to the AICutPaste server, the method further comprises the steps of: a first application of the first network device captures the image including the at least one object.
In a second possible implementation manner of the method according to the first aspect, the AICutPaste server extracts the at least one object from the image received from the first network device further comprises the steps of: the first application of the first network device sending a request to the AICutPaste server to extract the at least one object from the image; the AICutPase server identifying at least one object in the image; the AICutPase server segments and extracts the at least one object from the image.
In a third possible implementation manner of the method according to the first aspect, the method further includes the following steps: the AICutPase server sends the at least one object extracted from the image to the first application of the first network device.
In a fourth possible implementation manner of the method according to the first aspect, the first network device sending the at least one object extracted from the image to a second application of a second network device further comprises the steps of: the first network device sending the at least one object extracted from the image to a Web server; the Web server transmits the at least one object extracted from the image to the second application of the second network device.
In a fifth possible implementation manner of the method according to the first aspect, the first network device sends the image to a second application program of a second network device, and the method further includes the steps of: focusing the first application of the first network device on a screen of the second application of the second network device; the first application of the first network device generating a preview of the screen of the second application of the second network device; pasting, by the first application of the first network device, the at least one object extracted from the image into the preview of the screen of the second application of the second network device; the first network device sending an image of the preview of the screen of the second application of the second network device with the at least one object attached to a Web server; the Web server transmits the image of the preview of the screen of the second application of the second network device with the at least one object attached thereto to the second application of the second network device.
In a sixth possible implementation manner of the method according to the first aspect, the first network device is an image capturing device and the second network device is a user device; and the first application is an application for capturing an image, and the second application is an application for editing an image.
According to a second aspect of the present application, there is provided a system for transmitting data between network devices of a network. The system comprises a first network device, a second network device and a Web server. The first network device includes: a first application and an AICutPase server. The second network device includes: and a second application program. The first network device is configured to send an image including at least one object to the AICutPaste server; the AICutPaste server for extracting the at least one object from the image received from the first network device; the AICutPaste server for transmitting the at least one object extracted from the image to the first network device; the first network device is configured to send the at least one object or the image extracted from the image to the second application of the second network device.
In a first possible implementation manner of the system according to the second aspect, the first application of the first network device is configured to capture the image comprising the at least one object.
In a second possible implementation manner of the system according to the second aspect, the first application program of the first network device is configured to send a request to the AICutPaste server to extract the at least one object from the image; the AICutPase server is configured to identify at least one object in the image; the AICutPase server is configured to segment and extract the at least one object from the image.
In a third possible implementation manner of the system according to the second aspect, the AICutPaste server is configured to send the at least one object extracted from the image to the first application of the first network device.
In a fourth possible implementation manner of the system according to the second aspect, the first network device is configured to send the at least one object extracted from the image to a Web server; the Web server is configured to send the at least one object extracted from the image to the second application of the second network device.
In a fifth possible implementation manner of the system according to the second aspect, the first application of the first network device is configured to focus on a screen of the second application of the second network device; the first application of the first network device is to generate a preview of the screen of the second application of the second network device; the first application of the first network device is for pasting the at least one object extracted from the image into the preview of the screen of the second application of the second network device; the first network device is configured to send an image of the preview of the screen of the second application of the second network device with the at least one object attached to a Web server; the Web server is configured to send the image of the preview of the screen of the second application of the second network device with the at least one object attached to the second application of the second network device.
In a sixth possible implementation manner of the system according to the second aspect, the first network device is an image capturing device and the second network device is a user device; and the first application is an application for capturing an image, and the second application is an application for editing an image.
According to a third aspect of the present application, there is provided a computer readable storage medium for transmitting data between network devices of a network. The computer readable storage medium stores a computer program which, when run on a processor, performs the method according to the first aspect of the application.
Other aspects, advantages, and salient features of the application will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the application.
Drawings
The specific embodiments are described with reference to the accompanying drawings. In the drawings, one or more digits of a reference number identify the drawing in which the reference number first appears. The same numbers are used throughout the drawings to reference like features and components.
FIG. 1 illustrates a block diagram provided by one embodiment of the application for segmenting a captured image into separable focusable objects and sending the output to a photo editor.
Fig. 2 shows a block diagram of a screen provided by the present application for segmenting a captured image into separable focusable objects and transmitting the output to another device pointed to by device 1.
Fig. 3 shows a block diagram of the AI system provided by the present application, wherein the AICutPaste server is a proxy connected to the AI Web server and the photo editor.
Fig. 4 shows a sequence diagram of an AI-based copy-and-paste scheme provided by the present application, wherein a user captures an image of a focused bottle object, which is segmented and sent to a photo editor.
Fig. 5 shows a block diagram of a system for transmitting data between two devices provided by another embodiment of the present application.
Fig. 6 shows a flow chart of a method for transmitting data between two devices provided by another embodiment of the present application.
It should be understood that the drawings are for purposes of illustrating the concepts of the application and may not be to scale.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, shall fall within the scope of the present application based on the embodiments of the present application.
The application can be implemented in numerous ways, as a process, an apparatus, a system, a composition of matter, a computer readable medium such as a computer readable storage medium or a computer network wherein program instructions are sent over optical or electronic communication links. In this specification, these implementations, or any other form that the application may take, may be referred to as techniques. In general, the order of the steps of disclosed processes may be altered within the scope of the application.
The following provides a detailed description of one or more embodiments of the application and is presented in the figures that illustrate the principles of the application. While the application has been described in connection with these embodiments, the application is not limited to any embodiment. The scope of the application is limited only by the claims and the application encompasses numerous alternatives, modifications and equivalents. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. These details are provided for the purpose of example and the application may be practiced according to the claims without some or all of these specific details. Technical material that is known in the technical fields related to the application has not been described in detail so that the application is not unnecessarily obscured.
Numerous specific details are set forth in the following description in order to provide a thorough understanding of the application. However, it will be understood by those skilled in the art that the present application may be practiced without these specific details. In other instances, well-known methods, procedures, components, modules, units, and/or circuits have not been described in detail so as not to obscure the present application.
Although embodiments of the application are not limited in this regard, discussions utilizing terms such as, for example, processing, computing, determining, establishing, analyzing, checking, or the like, may refer to the action and/or processes of a computer, computing platform, computing system, or other electronic computing device, that manipulate and/or transform data represented as physical (e.g., electronic) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories, or other non-transitory storage medium that may store instructions to perform the actions and/or processes.
Although embodiments of the present application are not limited in this respect, the term "plurality" as used herein may include "two or more". The term "plurality" may be used throughout the specification to describe two or more components, devices, elements, units, parameters, and the like. The method embodiments described herein are not limited to a particular order unless explicitly stated. Furthermore, some of the described method embodiments or elements thereof may occur or be performed simultaneously at the same point in time.
In the present application, "scissorsCut "refers to a cut command to delete selected data from its original location and store the selected data in a temporary storage location commonly referred to as a clipboard. This can be done by the combination key Ctrl + x (for Macintosh users,+ x), menu, or otherwise.
In this disclosure, "copy" refers to a copy command for creating a copy of selected data and storing the selected data in a temporary storage location commonly referred to as a clipboard. This can be done by the combination key Ctrl + c (for Macintosh users,+c), menu, or otherwise.
In the present application, "paste" refers to a paste command for visually inserting selected data stored in a temporary memory at an insertion point. This can be done by the combination key Ctrl + v (for Macintosh users,+v), menu, or otherwise.
In this disclosure, a "clipboard" refers to a buffer for short-term storage and transmission of data within an application and between applications. It is typically temporary and unnamed, its contents residing in the RAM of the computer. It is an application programming interface through which a program can specify cut, copy, and paste operations.
A method and system for transmitting an object from a first network device to a second network device is disclosed. While aspects are described with respect to data replication between two user devices, the application may be implemented in any number of different computing systems, environments, and/or configurations. Embodiments are described in the context of the following exemplary systems, devices/nodes/apparatuses and methods.
Embodiments of the application are explained below with the aid of exemplary figures and one or more examples. However, these exemplary drawings and examples are for better understanding of the present application and should not be construed as limiting the scope of the present application.
A problem associated with conventional cut-copy paste operations is that data (e.g., without limitation, images or text or multimedia content/files) cut or copied from one document/location of a device can only be pasted onto the same or different document/location of the same device, and thus the cut-copy paste operation appears to be device specific or limited to only the device whose data or files are being cut or copied. Thus, conventional techniques focus only on copying objects from one device to the same device. The user is not allowed to cut or copy data from one device and paste the data onto a different device. This use case is very limited and does not solve the problem of cutting/copying an image from one place and transmitting the object to another device.
Thus, there is a need for transferring/copying data between two devices, i.e., the ability to cut or copy data (such as, but not limited to, an image or a portion of an image or an object in an image) from one device and paste the image or the portion of the image or the object in the image onto any other device within the network. For example, any image is taken using a smart device camera, a particular object in the image is selected, and the same object is sent to any other device. The other device is not only able to receive the object, but is also able to paste the image onto any photo editor. The present application solves this problem by utilizing artificial intelligence to ensure that specific objects are selectable and can be transferred from one device to another in real time.
Fig. 1 shows an example of capturing an image using a user device (device 1), such as but not limited to a camera of a smartphone. The captured image is sent to an AICutPaste server (which may be running on the cloud or locally) which uses AI algorithms to segment the captured image into multiple objects such as bottles, cameras, tables, etc. The plurality of split objects are sent back to the user equipment (device 1). The user may select one or more objects to paste onto the device 2, for which the user may touch the desired object or objects and send them to the AI Web service. A photo editor running in the receiving (other) device (device 2) listens to a particular port that is configurable. The AI Web service transmits an object from device 1 to device 2. If there are multiple devices listening for the port, then the object will be sent to all devices listening for the port. It should be noted that which port and how the port is configured is not part of the present application.
Fig. 2 shows an example of capturing an image using a user device (device 1), such as a camera of a smart phone. The captured image is sent to an AICutPaste server (which may be running on the cloud or locally) which uses AI algorithms to segment the captured image into multiple objects such as bottles, cameras, tables, etc. The plurality of split objects are sent back to the user equipment (device 1). The user focuses the smartphone camera onto the device 2 screen. The preview application in device 1 displays the interface of the photo editor and the user pastes the segmented object for in the preview to the appropriate location to generate a new image that is sent to device 2 through the AI Web service on the listening port.
It is prior art to predict objects and extract models of objects individually from input images. The model is partitioned using prediction and extraction methods. The method is a boundary perception salient detection model for prediction and segmentation, and works in two steps. In a first step, the AI model detects objects, and in a second step, the AI model segments the input image and extracts one or more objects using their boundaries. The extracted object is then used in a cropping operation (deleting from the input image and creating an output image without this object), or a copying operation, in which the extracted object is transmitted back to the screen as a new image alone. The model is implemented in the AICutPasteServer of the present application.
Fig. 3 shows a block diagram of the present application. The AICutPaste server consists of an AI-based segmentation scheme as described above for segmenting an input image into a plurality of objects and transmitting the segmented objects back to the user device. The AICutPase server may be deployed locally or on the cloud. The AI Web service acts as a proxy to route the user-selected image (from the cut operation) to the device running the photo editor listening to the particular port. An application running in the smart device will take an image using the camera, once the image is taken, the image will be sent to an AICutPaste server running in the same smart device background or cloud. The AICutPasteServer segments the input image into a plurality of objects and sends the segmented image back to the source device. The user selects an object to be pasted on the target device and sends the image and coordinates to be pasted through the AI Web service. In addition, the user may also direct the smart device to the display screen of the target device and capture a preview of the target device. The user can locate the desired segmented object on this basis and share the new image to the target device.
Fig. 4 shows a timing diagram of how data is transferred or copied in real time between two devices. The process flow involves the following steps:
step 401: an application running on the smart device sends the captured image to an AICutPaste server; step 402: the AICutPase server identifies objects in the input image and segments the objects into separate images; step 403: the AICutPase server sends the segmented object to the source device; step 404: the user can focus the camera of the device 1 on the screen of the device 2 (target device) and select a position paste of an image selected from the divided objects; step 405: the intelligent application program sends the selected image/images and the pasting position to the AI Web service; step 406: the AI Web service routes the data (image and paste location) to all applications in the target device listening to the AI Web service on a particular predefined port.
Fig. 5 shows a block diagram of a system (500) for transmitting data between two devices provided by a first embodiment of the application. The system (500) comprises: a first network device (501), a second network device (502), and a Web server (503). The first network device (501) comprises: a first application (5011) and an AICutPase server (5012). The second network device (502) comprises: a second application (5021). The first network device (501) is configured to send an image comprising at least one object to an AICutPaste server (5012); the AICutPase server (5012) is configured to extract at least one object from an image received from the first network device (501); the AICutPaste server (5012) is configured to send at least one object extracted from the image to a first network device (501); the first network device (501) is configured to send at least one object or image extracted from the image to a second application (5021) of the second network device (502).
Furthermore, a first application (5011) of the first network device (501) is for capturing an image comprising at least one object. A first application (5011) of a first network device (501) is for sending a request to extract at least one object from an image to an AICutPaste server (5012); an AICutPase server (5012) for identifying at least one object in an image; an AICutPasteServer (5012) is used for segmenting and extracting at least one object from an image. The AICutPasteServer (5012) is for sending at least one object extracted from the image to a first application (5011) of the first network device (501). The first network device (501) is configured to send at least one object extracted from the image to the Web server (503); the Web server (503) is configured to send at least one object extracted from the image to a second application (5021) of the second network device (502).
In addition, the first application (5011) of the first network device (501) is for focusing on the screen of the second application (5021) of the second network device 502; the first application (5011) of the first network device (501) is for generating a preview of a screen of the second application (5021) of the second network device (502); the first application (5011) of the first network device (501) is for pasting at least one object extracted from the image onto a preview of a screen of the second application (5021) of the second network device (502); the first network device (501) is configured to send an image, to which at least one object is pasted, of a preview of a screen of a second application (5021) of the second network device (502) to the Web server (503); the Web server (503) is configured to send an image, to which at least one object is pasted, of a preview of a screen of a second application (5021) of the second network device (502) to the second application (5021) of the second network device (502).
Fig. 6 shows a flow chart of a method (600) for transmitting data between two devices provided by a second embodiment of the application. The method (600) comprises the steps of: step 601: the first network device sending an image comprising at least one object to an AICutPaste server; step 602: the AICutPase server extracts at least one object from an image received from a first network device; step 603: the AICutPase server sending at least one object extracted from the image to the first network device; step 604: the first network device sends the at least one object or image extracted from the image to a second application of the second network device.
In the method, before the first network device transmits the image including the at least one object to the AICutPaste server, the method further includes the steps of: a first application of a first network device captures an image including at least one object.
In the method, the AICutPasteServer extracts at least one object from an image received from a first network device, the method further comprising the steps of: a first application of a first network device sending a request to an AICutPasteServer to extract at least one object from an image; the AICutPase server identifies at least one object in the image; the AICutPasteServer segments and extracts at least one object from the image.
In the method, after the AICutPaste server extracts at least one object from the image received from the first network device, the method further comprises the steps of: the AICutPasteServer transmits at least one object extracted from the image to a first application of the first network device.
In the method, the first network device transmitting the at least one object extracted from the image to the second application of the second network device further comprises the steps of: the first network device sends at least one object extracted from the image to the Web server; the Web server transmits the at least one object extracted from the image to a second application of a second network device.
In the method, the first network device transmits the image to a second application of a second network device, further comprising the steps of: focusing a first application program of a first network device on a screen of a second application program of a second network device; the first application of the first network device generates a preview of a screen of a second application of the second network device; pasting, by the first application of the first network device, at least one object extracted from the image into a preview of a screen of a second application of the second network device; the first network device sends an image, on which at least one object is pasted, of a preview of a screen of a second application of the second network device to the Web server; the Web server transmits an image to which at least one object is pasted on a preview of a screen of a second application of the second network device to the second application of the second network device.
The first network device is any image capturing device such as, but not limited to, a mobile terminal, tablet, camera, DLSR, etc.; the second network device is any user device such as, but not limited to, a mobile terminal, tablet, notebook, smart television, wearable device, etc. The first application may be any application that enables the user device to capture an image, while the second application may be any application that enables the user to edit an image, such as, but not limited to Adobe Photoshop, paintshop, adobe Illustrator, polar, etc.
An embodiment of the application also provides a computer readable storage medium storing a computer program which, when run on a processor, performs the method described in steps 601 to 604 of fig. 6.
Furthermore, another embodiment of the present application discloses a computer-readable medium. The computer readable medium comprises a computer program which, when executed by a computer, causes the computer to perform the method steps.
The application also discloses a computer readable medium comprising a computer program which, when executed by a computer, causes the computer to perform a method for transmitting data between two devices as described above.
The application is applicable to application programs in the fields of augmented reality, photo editing and the like. The application provides the technical effect that a user can cut or copy data from one user device, such as but not limited to an image or a part of an image or an object in an image, and paste the image or the part of the image or the object in the image onto another user device in real time.
Some non-limiting advantages and future implementations of the application are as follows: the method can be further enhanced and combined into shopping websites, and the captured objects can be directly sent to the shopping websites such as Amazon, flipkart for searching by utilizing the method; it can be extended to AR, capturing information and capturing details of the captured object from the device; its scope can be extended to the selection and ordering of food or menus; it can be extended to the food processing industry to verify food content by capturing images of the food.
Those skilled in the art will appreciate that any known or novel algorithm may be used in the practice of the present application. However, it should be noted that the present application provides a method and system for transferring objects from a first network device to a second network device to achieve the benefits and technical advances described above without using any known or new algorithms.
Those of ordinary skill in the art will appreciate that the various illustrative embodiments described in connection with the embodiments disclosed herein, both the units and the algorithm steps can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether a function is performed by hardware or software depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It will be clearly understood by those skilled in the art that, for convenience and brevity of description, specific working procedures of the above system, apparatus and unit may refer to corresponding procedures in the above method embodiments, and are not repeated herein.
In several embodiments provided by the present application, it should be understood that the disclosed apparatus, method, or system may be implemented in other ways. For example, the described apparatus embodiments are merely exemplary. For example, the cell division is merely a logical function division, and other divisions may be possible in actual implementations. For example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be implemented by some interfaces. The direct coupling or communication connection between devices or units may be accomplished electronically, mechanically, or in other forms.
When the functions are implemented in the form of software functional units and sold or used as a stand-alone product, the functions may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be implemented in the form of a software product, in essence, or as a part of the technical solution or as a contribution to the art. The computer software product is stored in a storage medium and comprises instructions for instructing a computer node (which may be a personal computer, a server or a network node) to perform all or part of the steps of the method as described in the embodiments of the present application. The storage medium includes: a USB disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Devices that are in communication with each other need not maintain continuous communication with each other unless explicitly specified otherwise. Further, devices that are in communication with each other may communicate directly or indirectly through one or more intermediaries.
When a single device or article is described herein, it will be readily apparent that more than one device/article (whether or not they cooperate) may be used in place of a single device/article. Similarly, for the case of more than one device or article described herein (whether or not they cooperate), it will be readily apparent that a single device/article may be used in place of the more than one device or article, or a different number of devices/articles may be used in place of the number of devices or programs shown. Alternatively, the functions and/or features of a device may be implemented by one or more other devices not explicitly described as having such functions/features. Thus, other embodiments of the application need not include the device itself.
Finally, the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, the scope of the application is not to be limited by the detailed description, but rather by any claims presented herein. Accordingly, the disclosure of the embodiments of the application is intended to be illustrative, but not limiting, of the scope of the application, which is set forth in the following claims.
With respect to the use of substantially any plural and/or singular terms herein, those having skill in the art can translate from the plural to the singular and/or from the singular to the plural depending upon the context and/or application. For clarity, various singular/plural permutations may be explicitly set forth herein.
Although implementations of methods and systems for transferring data between two devices have been described in particular language of structural features and/or methods, it is to be understood that the appended claims are not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of copying or transmitting data from a first network device to a second network device in real-time.
Claims (15)
1. A method for transmitting data between network devices of a network, the method comprising the steps of:
the first network device sending an image comprising at least one object to an AICutPaste server;
the AICutPaste server extracting the at least one object from the image received from the first network device;
the AICutPaste server sending the at least one object extracted from the image to the first network device;
the first network device sends the at least one object or the image extracted from the image to a second application of a second network device.
2. The method of claim 1, wherein before the first network device sends the image comprising at least one object to the AICutPaste server, the method further comprises the steps of:
a first application of the first network device captures the image including the at least one object.
3. The method of claim 1, wherein the AICutPaste server extracting the at least one object from the image received from the first network device further comprises:
the first application of the first network device sending a request to the AICutPaste server to extract the at least one object from the image;
the AICutPase server identifying at least one object in the image;
the AICutPase server segments and extracts the at least one object from the image.
4. A method according to claim 3, further comprising the step of:
the AICutPase server sends the at least one object extracted from the image to the first application of the first network device.
5. The method of claim 1, wherein the first network device transmitting the at least one object extracted from the image to a second application of a second network device further comprises the steps of:
the first network device sending the at least one object extracted from the image to a Web server;
the Web server transmits the at least one object extracted from the image to the second application of the second network device.
6. The method of claim 1, wherein the first network device transmits the image to a second application of a second network device, further comprising the steps of:
focusing the first application of the first network device on a screen of the second application of the second network device;
the first application of the first network device generating a preview of the screen of the second application of the second network device;
pasting, by the first application of the first network device, the at least one object extracted from the image into the preview of the screen of the second application of the second network device;
the first network device sending an image of the preview of the screen of the second application of the second network device with the at least one object attached to a Web server;
the Web server transmits the image of the preview of the screen of the second application of the second network device with the at least one object attached thereto to the second application of the second network device.
7. The method of claim 1, wherein the first network device is an image capturing device and the second network device is a user device; and the first application is an application for capturing an image, and the second application is an application for editing an image.
8. A system for transmitting data between network devices of a network, the system comprising:
a first network device, comprising:
the first application program is used by the first application program,
an AICutPase server;
a second network device, comprising:
a second application;
a Web server;
wherein the first network device is configured to send an image including at least one object to the AICutPaste server;
the AICutPaste server for extracting the at least one object from the image received from the first network device;
the AICutPaste server for transmitting the at least one object extracted from the image to the first network device;
the first network device is configured to send the at least one object or the image extracted from the image to the second application of the second network device.
9. The system of claim 8, wherein the system further comprises a controller configured to control the controller,
the first application of the first network device is for capturing the image comprising the at least one object.
10. The system of claim 8, wherein the system further comprises a controller configured to control the controller,
the first application of the first network device is configured to send a request to the AICutPaste server to extract the at least one object from the image;
the AICutPase server is configured to identify at least one object in the image;
the AICutPase server is configured to segment and extract the at least one object from the image.
11. The system of claim 10, wherein the system further comprises a controller configured to control the controller,
the AICutPase server is configured to send the at least one object extracted from the image to the first application of the first network device.
12. The system of claim 8, wherein the system further comprises a controller configured to control the controller,
the first network device is configured to send the at least one object extracted from the image to a Web server;
the Web server is configured to send the at least one object extracted from the image to the second application of the second network device.
13. The system of claim 8, wherein the system further comprises a controller configured to control the controller,
the first application of the first network device is for focusing on a screen of the second application of the second network device;
the first application of the first network device is to generate a preview of the screen of the second application of the second network device;
the first application of the first network device is for pasting the at least one object extracted from the image into the preview of the screen of the second application of the second network device;
the first network device is configured to send an image of the preview of the screen of the second application of the second network device with the at least one object attached to a Web server;
the Web server is configured to send the image of the preview of the screen of the second application of the second network device with the at least one object attached to the second application program of the second network device.
14. The system of claim 8, wherein the first network device is an image capture device and the second network device is a user device; and the first application is an application for capturing an image, and the second application is an application for editing an image.
15. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when run on a processor, performs the method according to any one of claims 1 to 7.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IN202131003445 | 2021-01-25 | ||
| IN202131003445 | 2021-01-25 | ||
| PCT/CN2022/071727 WO2022156587A1 (en) | 2021-01-25 | 2022-01-13 | Artificial intelligence based cut copy paste |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116830558A true CN116830558A (en) | 2023-09-29 |
Family
ID=82548282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202280010185.7A Pending CN116830558A (en) | 2021-01-25 | 2022-01-13 | Artificial intelligence based cut copy paste |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116830558A (en) |
| WO (1) | WO2022156587A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103312916A (en) * | 2012-03-15 | 2013-09-18 | 百度在线网络技术（北京）有限公司 | Method and device for transmitting picture on mobile terminal |
| CN105656753A (en) * | 2015-12-16 | 2016-06-08 | 魅族科技（中国）有限公司 | Sending method and device |
| CN106791111A (en) * | 2016-12-23 | 2017-05-31 | 努比亚技术有限公司 | A kind of images share method, device and terminal |
| CN110166347B (en) * | 2019-04-30 | 2021-09-07 | 创新先进技术有限公司 | Information sharing method, device and equipment |
| CN110838131B (en) * | 2019-11-04 | 2022-05-17 | 网易（杭州）网络有限公司 | Method and device for realizing automatic cutout, electronic equipment and medium |
-
2022
- 2022-01-13 WO PCT/CN2022/071727 patent/WO2022156587A1/en active Application Filing
- 2022-01-13 CN CN202280010185.7A patent/CN116830558A/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022156587A1 (en) | 2022-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111126301B (en) | Image processing method and device, computer equipment and storage medium | |
| US8639028B2 (en) | Automatic stacking based on time proximity and visual similarity | |
| EP3138046B1 (en) | Techniques for distributed optical character recognition and distributed machine language translation | |
| CN109309844B (en) | Video speech processing method, video client and server | |
| US20040119762A1 (en) | Systems and methods for freeform pasting | |
| KR20140098009A (en) | Method and system for creating a context based camera collage | |
| US10496696B2 (en) | Search method and apparatus | |
| CN107797717B (en) | Push method, display method, client device and data processing system | |
| CN111507352B (en) | Image processing method and device, computer equipment and storage medium | |
| EP2591427A2 (en) | System and method for digital image and video manipulation and transfer | |
| CN103793146A (en) | Method and device for processing images | |
| US11190653B2 (en) | Techniques for capturing an image within the context of a document | |
| CN110019058B (en) | Sharing method and device for file operation | |
| CN104703039A (en) | Video information acquiring method and device | |
| CN107798716B (en) | Image effect extraction | |
| KR101647371B1 (en) | STL file including text information and, STL file searching and management system therefor | |
| US10298907B2 (en) | Method and system for rendering documents with depth camera for telepresence | |
| CN116830558A (en) | Artificial intelligence based cut copy paste | |
| CN112585646A (en) | Method and system for performing editing operations on media | |
| CN115237293A (en) | Picture editing method, device, equipment and storage medium | |
| KR20150000030A (en) | Contents sharing service | |
| WO2018194853A1 (en) | Enhanced inking capabilities for content creation applications | |
| CN113835590A (en) | Display method, information sending method and electronic equipment | |
| CN108140173A (en) | The attachment parsed from communication is classified | |
| CN111583087A (en) | Image watermark removing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |