CN114896432A - Multi-device collaborative photo display method and mobile terminal - Google Patents
Multi-device collaborative photo display method and mobile terminal Download PDFInfo
- Publication number
- CN114896432A CN114896432A CN202210488132.8A CN202210488132A CN114896432A CN 114896432 A CN114896432 A CN 114896432A CN 202210488132 A CN202210488132 A CN 202210488132A CN 114896432 A CN114896432 A CN 114896432A
- Authority
- CN
- China
- Prior art keywords
- photo
- image
- target
- list
- image element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a multi-device cooperative photo display method and a mobile terminal, which can improve user experience by receiving a photo data acquisition request of a photo display device, acquiring a photo which is not synchronized locally to a photo storage device, sending the photo to the photo display device, receiving a target photo display notification sent by the photo display device, wherein the target photo display notification comprises information of the target photo and a first photo list and thumbnails of the photo storage device and other terminal devices which establish a synchronization relation with the photo storage device, displaying the thumbnails of the first photo list according to a preset sequencing mode, and positioning the thumbnails to the target photo.
Description
Technical Field
The invention relates to the technical field of electronic information, in particular to a multi-device collaborative photo display method and a mobile terminal.
Background
With the development of the smart phone technology, smart phones are increasingly applied and have more and more abundant functions, and become important articles carried by people gradually, wherein the photographing function of the smart phone is particularly favored by people, especially female users, so that the smart phone becomes one of the functions with the highest use frequency in the smart phone. Although the storage capacity of the smart phone sold in the market is getting larger, the demand of people for picture quality makes the storage capacity of the body of the smart phone far from the storage space requirement of the picture, and in view of the high price and the extremely limited upgradable capacity of upgrading the storage of the body of the smart phone, the network storage device is just one of effective methods for solving the problem. Whether the solution uses cloud storage or the solution uses a home data center, there is also an attractive advantage that other electronic devices in the home, such as a television, a PC, a notebook or a tablet computer, etc., can also access the cloud server or the home data center to view the photos. The scenario is nice, but since each of the electronic devices has different short boards, for example, the storage space of the smart phone is small, the cloud server is greatly influenced by the network environment, the processing capability of the home data center is poor, the operation of the television is inconvenient, and the like, the devices in the prior art work independently, and the user experience is poor.
Disclosure of Invention
Based on the above problems, the invention provides a multi-device collaborative photo display method and a mobile terminal, which can improve user experience.
In view of the above, a first aspect of the present invention provides a multi-device collaborative photo display method, including:
receiving a photo data acquisition request of a photo display device;
acquiring a photo list which is not synchronized to a photo storage device locally and a corresponding thumbnail and sending the photo list and the corresponding thumbnail to the photo display device;
receiving a target photo display notification sent by the photo display device, wherein the target photo display notification contains information of the target photo and a first photo list and thumbnails of the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device;
and displaying the thumbnails of the first photo list according to a preset sorting mode, and positioning to the target photo.
Further, in the above method for displaying photos with cooperation of multiple devices, after the step of displaying the thumbnails in the first photo list in a preset sorting manner and locating to the target photo, the method further includes:
receiving a first image element sent by the photo display equipment;
acquiring a second photo list containing a second image element, wherein the second image element is an image element similar to the first image element;
acquiring the second image element from the photos in the second photo list for displaying;
receiving a target image element selected by a user from a plurality of the second image elements;
sending the target image element to the photo display device to cause the photo display device to replace the first image element on the target photo with the target image element.
Further, in the above photo display method with multi-device cooperation, the step of obtaining a second photo list including a second image element specifically includes:
identifying a local picture to determine a third image list containing second image elements;
acquiring a fourth image list containing second image elements, which is sent by the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device;
and integrating the third image list and the fourth image list to form the second image list.
Further, in the above method for displaying photos with cooperation of multiple devices, after the step of displaying the thumbnails in the first photo list in a preset sorting manner and locating to the target photo, the method further includes:
receiving two target image elements selected by a user from a plurality of second image elements;
generating a transitional morphological image element of the two target image elements;
sending the transitional form image elements to the photo display device to cause the photo display device to replace the first image elements on the target photo with the transitional form image elements.
Further, in the above photo display method with multiple devices cooperating with each other, the step of generating a transitional form image element of the two target image elements specifically includes:
identifying at least three same image features from the two target image elements;
setting positioning anchor points on the at least three same image features;
standardizing the two target image elements on the basis of the positioning anchor points to generate two standardized image elements;
extracting differentiated features having the same configuration from the two normalized image elements;
and carrying out intermediate value taking on at least one image parameter of the differential feature to generate a transition form image element.
Further, in the above method for displaying a photo with multiple coordinated devices, the step of extracting the differentiated features with the same structure from the two standardized image elements specifically includes:
performing edge feature extraction on the two standardized image elements to generate two edge feature images;
performing corner detection on the two edge feature images to generate two corner distribution images;
and matching the two standardized image element images based on the two corner distribution images to obtain the differential features with the same structure in the two standardized image elements.
Further, in the above method for displaying a photo with multiple devices in cooperation, the step of matching the two standardized image element images based on the two corner distribution images to obtain the differentiated features with the same structure in the two standardized image elements specifically includes:
and acquiring image features as the differentiation features, wherein the image features are the same in the number of the corner points, the relative positions of the corner points are similar, the difference value of the relative distances between the corner points is not more than a first threshold value, and the difference value of the relative distances between at least one pair of corner points is more than a second threshold value.
Further, in the above method for displaying a photo with multiple devices in cooperation, the step of matching the two standardized image element images based on the two corner distribution images to obtain the differentiated features with the same structure in the two standardized image elements specifically includes:
and acquiring image characteristics, which are the same in the number of the angular points, similar in the relative positions of the angular points, not larger than a first threshold value in the difference value of the relative distances between the angular points and larger than a third threshold value in the gray difference value, from the two angular point distribution images as the differentiation characteristics.
Further, in the above method for displaying a photo with multiple devices in cooperation, before the step of taking an intermediate value of at least one image parameter of the differentiated features to generate the image element in the transitional form, the method further includes:
and sorting the second image elements by taking the image parameters of one or more of the differential features as sorting conditions.
A second aspect of the present invention provides a mobile terminal, including a processor and a memory, where the processor executes a program on the memory to implement the multi-device collaborative photo display method according to the first aspect.
The invention provides a multi-device cooperative photo display method and a mobile terminal, which can improve user experience by receiving a photo data acquisition request of a photo display device, acquiring a photo list and a corresponding thumbnail which are not synchronized locally to a photo storage device, sending the photo list and the corresponding thumbnail to the photo display device, receiving a target photo display notification sent by the photo display device, displaying the thumbnail of the first photo list according to a preset sequencing mode, and positioning the thumbnail to the target photo, wherein the target photo display notification comprises information of the target photo and a first photo list and thumbnails of the photo storage device and other synchronization devices which establish a synchronization relationship with the photo storage device.
Drawings
Fig. 1 is a schematic application scenario diagram of a multi-device collaborative photo display method according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a photo display method of multi-device collaboration according to an embodiment of the present invention;
FIG. 3 is a schematic flow chart of a photo display method with multi-device cooperation according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart of a photo display method of multi-device collaboration according to an embodiment of the invention;
FIG. 5 is a schematic flow chart of a photo display method of multi-device collaboration according to an embodiment of the invention;
FIG. 6 is a schematic flow chart of a photo display method of multi-device collaboration according to an embodiment of the invention;
FIG. 7 is a diagram illustrating standardized image processing of a multi-device collaborative photo display method according to an embodiment of the present invention;
FIG. 8 is a schematic flow chart of a multi-device collaborative photo display method according to an embodiment of the present invention;
fig. 9 is a schematic diagram of processing transitional form image elements in a multi-device collaborative photo display method according to an embodiment of the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced otherwise than as specifically described herein, and thus the scope of the present invention is not limited by the specific embodiments disclosed below.
In the description of the present invention, the terms "plurality" or "a plurality" refer to two or more, and unless otherwise specifically limited, the terms "upper", "lower", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are merely for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus should not be construed as limiting the present invention. The terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations. Furthermore, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first," "second," etc. may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless otherwise specified.
In the description herein, reference to the term "one embodiment," "some embodiments," "specific examples," or the like, means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
A multi-device collaborative photo display method and a mobile terminal according to some embodiments of the present invention are described below with reference to fig. 1 to 9.
Fig. 1 shows an example of an application scenario of a multi-device collaborative photo display method and a mobile terminal according to the present invention, in some embodiments of the present invention, a photo storage device is used as a data storage center for storing photo data taken by other devices, such as a smart phone, a tablet computer, a notebook computer, or a PC, and the like, for example, the photo storage device may be a home data center, and the smart phone and the like may install an application program for synchronizing a local photo to the home data center. In addition, after the equipment such as a television, a set-top box or a PC can be connected with the photo storage equipment, photos are read from the photo storage equipment for display, and the experience of watching the photos can be better by utilizing the larger display screens of the equipment. In addition, the photo storage device can also be a cloud storage server provided by a smart phone manufacturer or a third-party internet company, and a user can synchronize photos on the smart phone into the cloud storage server through a cloud storage application preset or installed on the smart phone.
As shown in fig. 2, a first aspect of the present invention provides a multi-device collaborative photo display method, including:
s100: a photo data acquisition request of a photo display device is received. In the technical scheme of the invention, the photo display device can be a large-screen display device connected with the photo storage device and having all or part of photo data reading permission, such as a television, a personal computer and the like, or can be a smart phone connected with the photo storage device and having all or part of photo data reading permission, and the like. In some embodiments of the present invention, the photo display device is an intelligent television or a personal computer, and the intelligent television or the personal computer is connected to the photo storage device under the operation of a user to obtain the photo data. When the photo storage device receives a photo data acquisition request of the television, firstly, communication connection is established between the photo storage device and a synchronous device such as a smart phone and the like which has established a synchronous relation with the photo storage device, and the photo storage device sends the photo data acquisition request to the synchronous device such as the smart phone and the like. Specifically, establishing a synchronization relationship with the photo storage device means that a photo synchronization application program associated with the photo storage device is preset or installed on a synchronization device such as a smart phone, and after the synchronization device establishes a communication connection with the photo storage device through the photo synchronization application program, photo data is synchronized with the photo storage device according to a preset synchronization rule or a synchronization rule selected by a user.
S200: and acquiring a photo list and a corresponding thumbnail which are not synchronized to the photo storage device locally, and sending the photo list and the corresponding thumbnail to the photo display device. The photo list comprises information such as photo names and photo generation time. Specifically, the method is limited to synchronization rules of synchronization equipment such as a smart phone and a photo storage device, and in order to avoid affecting the network use condition of the synchronization equipment such as the smart phone and avoid consuming too much battery power of the smart phone to affect the user experience, the method generally adopts modes such as idle synchronization, periodic synchronization or manual synchronization of a user, and a scheme of real-time synchronization is rarely adopted, so that some photos are often not synchronized into the photo storage device in the storage space of the synchronization equipment such as the smart phone in some unspecified times. In some embodiments of the present invention, when receiving a photo data acquisition request of the photo display device forwarded by the photo storage device, the synchronization device establishes a connection with the photo display device, and directly sends the photo list and a corresponding thumbnail to the photo display device. Preferably, after receiving a photo data acquisition request of the photo display device forwarded by the photo storage device, the synchronization device acquires an IP address of the photo display device, and sends a network test data packet to the IP address, and the smart phone determines whether the photo display device and the local computer are in the same network environment according to a time to live value in feedback information for the network test data packet returned by the photo display device, and establishes a point-to-point connection with the photo display device to directly transmit the photo data when determining that the photo display device and the local computer are in the same environment, in this embodiment, when the photo storage device is a cloud server, the smart phone directly transmits the photo data to the photo display device without forwarding through the photo storage device, thereby improving the transmission efficiency of the photo data, reducing a display latency of the photo display device.
In other embodiments of the present invention, when the synchronization device receives the photo data acquisition request of the photo display device forwarded by the photo storage device, establishing connection with the photo storage device, sending the photo list and the corresponding thumbnail which are not locally synchronized to the photo storage device to the photo display device together with the photo list and the corresponding thumbnail on the photo storage device by the photo storage device, wherein by adopting the embodiment, the photo storage device can find the unsynchronized photo on the synchronization device in time, and storing the photo list and the corresponding thumbnail which are not synchronized to the photo storage device, and selecting proper time to obtain the photo from the synchronization device. Preferably, after receiving the photo data acquisition request of the photo display device forwarded by the photo storage device, the synchronization device acquires the IP address of the photo storage device and sends a network test data packet to the IP address, and the smart phone determines whether the photo storage device and the local machine are in the same network environment according to the time to live value in the feedback information of the network test data packet returned by the photo storage device, and forwards the photo data to the photo display device through the photo storage device when determining that the photo storage device and the local machine are in the same environment. Further, in this embodiment, after the photo storage device receives the photo list and the corresponding thumbnails that are not synchronized locally to the photo storage device by the synchronization device, the photo storage device generates a completed photo list together with the photos stored in the photo storage device, sorts the photo list according to a preset sorting rule, and sends thumbnails of the photos that are ranked in front by a preset number to the photo display device for display.
S300: and receiving a target photo display notification sent by the photo display device, wherein the target photo display notification contains information of the target photo and a first photo list and thumbnails of the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device. In some embodiments of the present invention, according to an operation of a user on one of the synchronization devices, the synchronization device is configured as an auxiliary display device of the photo display device, and the auxiliary display device is connected in communication with the photo display device. When a user selects a photo to be displayed from the photo list, the photo display device displays the photo in a full screen mode, and meanwhile the photo display device or the photo storage device sends the photo list and the corresponding thumbnail to the auxiliary display device for auxiliary display. In the above embodiment, the smart phone is used as an auxiliary display device of the photo display device, when the photo display device displays photos in full screen, a list or thumbnails of the photos are displayed on the smart phone to provide a user with subsequent operations, for example, the user may implement switching, editing, printing, deleting, and other photo operations of the currently displayed photos of the photo display device through the smart phone. Because the operation on the photo display device becomes more difficult when the photo display device displays a photo in a full screen mode, especially for a touch display device or a computer device using peripheral devices such as a mouse, a keyboard and the like, the display of any operation control can influence the current full screen display effect, and the photo display device can be focused on the full screen display of the photo without providing any operation control by configuring the smart phone as an auxiliary display device and providing auxiliary control. Meanwhile, in the above embodiment, since the smart phone only needs to obtain a photo list, a part of thumbnail data, and send a small amount of data transmission such as a control instruction from the photo storage device and the photo display device, even if the smart phone is not in the same network environment as the photo storage device and the photo display device, for example, in a case where the smart phone uses a cellular mobile communication network, the above photo display and control scheme can be implemented with low delay.
S400: and displaying the thumbnails of the first photo list according to a preset sorting mode, and positioning to the target photo. After the photos in the first photo list are sequenced, the thumbnails of the target photos and the thumbnails of the photos in the preset number in front of and behind the target photos are displayed on the auxiliary display device, so that a user can quickly find the photos needing to be switched on the auxiliary display device, select the photos and display the photos on the photo display device. Further, a thumbnail of the target photo is displayed on the smartphone as a selected state. In some embodiments of the present invention, the sorting of the first photo list is performed by the photo storage device, the sorting is completed on the photo storage device, and after determining the thumbnails to be displayed on the auxiliary display device, the thumbnails of the target photos and the thumbnails of a preset number of photos before and after the target photos are sent to the auxiliary display device. In the embodiment, the photo list information and the thumbnail information only need to be transmitted among the devices in the whole auxiliary display process, so that the transmission data volume is small, the response speed in the interaction process is high, and the operation is smooth.
As shown in fig. 3, in the above photo display method with multiple coordinated devices, after the step of displaying the thumbnails in the first photo list in a preset sorting manner and locating to the target photo, the method further includes:
s510: and receiving a first image element sent by the photo display equipment. The first image element may be an image of a human face or an image of a particular object, such as a tree, the sun, a food item, an animal, furniture, or a building. In some embodiments of the present invention, the first image element is an image element extracted and stored in advance after the photo storage device recognizes the photo, and the photo display device requests one or more pieces of image element information extracted in advance from the target photo from the photo storage device when receiving a user's selection to display the target photo. In this embodiment, if the target photo is a photo that is not synchronized to the photo storage device in one of the synchronization devices, the photo display device sends a processing request to the synchronization device, and the corresponding synchronization device processes the photo to identify and extract image elements in the photo and sends the image elements to the photo display device. In some embodiments of the present invention, the photo display device receives a first image element selected by a user from a plurality of image elements of the target photo and transmits the first image element to the auxiliary display device.
In still other embodiments of the present invention, after the target photo is displayed on the photo display device, the auxiliary display device requests the photo storage device for one or more pieces of image element information extracted in advance from the target photo, displays one or more pieces of image elements of the target photo, and determines the first image element from the one or more pieces of image elements according to a user operation on the auxiliary display device.
S520: a second photo list is obtained that includes a second image element that is an image element that is similar to the first image element. The auxiliary display device obtains a second photo list containing image elements that are similar to the first image elements from the photo storage device. For example, when the first image element is a face image of a specific person, the auxiliary display device acquires a second photo list containing the face image of the same person from the photo storage device.
S530: and acquiring the second image element from the photos in the second photo list for display. The same image element may be different in shape, size, color, brightness, etc. in different photographs due to the influence of the photographing environment, the photographing angle, the posture of the subject, and other relevant factors. For example, when the first image element is a facial image, the pose and the expression of the same person on different photos are different, and the angle, the size, the color, the brightness, and the like of the facial image are also different.
S540: receiving a user selected one of the second image elements. The secondary display device lists all or a portion of the second image elements in the second column of photographs for selection by a user.
S550: sending the target image element to the photo display device to cause the photo display device to replace the first image element on the target photo with the target image element. Specifically, the auxiliary display device modifies the target image element according to information such as size, hue, and brightness of the first image element, and then sends the target image element to the photo display device for replacement. In the embodiment, the storage resources of the photo storage device are fully utilized for photo storage, and the processing capability at idle time is utilized for recognizing the stored photos to extract the image elements in the photos. Meanwhile, when the photo display device displays the photos, the processing capability of synchronous devices such as smart phones and the like can be fully utilized to process the photos in real time.
As shown in fig. 4, in the photo display method with multi-device cooperation, the step of acquiring a second photo list including a second image element specifically includes:
s521: identifying a local picture to determine a third image list containing second image elements;
s522: acquiring a fourth image list containing second image elements, which is sent by the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device;
s523: and integrating the third image list and the fourth image list to form the second image list.
By adopting the embodiment, the synchronization device identifies photos which are not synchronized locally to the photo storage device in real time to obtain the third image list containing the second image element, because of the existence of the synchronization mechanism of the synchronization device and the photo storage device, the number of photos which are not synchronized to the photo storage device in the synchronization device is not large under the general condition, and the synchronization device can complete the identification of the photos which are not synchronized to the photo storage device in a short time. The photo storage device generally uses a low-power processor, which has a weak processing capability, but may perform image processing by using an idle time period, such as night, after the synchronization device synchronizes the photo into its storage space, so as to extract image elements in the photo. In this embodiment, by cooperative processing of multiple devices, image processing efficiency can be improved by utilizing processing resources of the multiple devices.
As shown in fig. 5, in the above photo display method with multi-device cooperation, after the step of displaying the thumbnails in the first photo list in a preset sorting manner and locating to the target photo, the method further includes:
s610: receiving two target image elements selected by a user from a plurality of second image elements;
s620: generating a transitional morphological image element of the two target image elements;
s630: sending the transitional form image element to the photo display device to enable the photo display device to replace the first image element on the target photo with the transitional form image element.
In the above embodiment, when none of the plurality of second image elements extracted from the captured picture meets the user's requirement, the user may select two second image elements closer to their requirement states from the auxiliary display device to process, so as to obtain image elements meeting the user's requirement in terms of shape, color, or posture, and so on, to replace the first image element in the target picture.
As shown in fig. 6, in the above-mentioned photo display method with multiple devices cooperating with each other, the step of generating a transitional form image element of the two target image elements specifically includes:
s621: at least three identical image features are identified from the two target image elements. The auxiliary display device identifies and compares the two target image elements, and extracts the same image features from the two target image elements. For example, three image features a, b, and c are extracted from the first target image element, and three image features a ', b', and c 'are extracted from the first target image element, where a and a' are the same image feature, b and b 'are the same image feature, and c' are the same image feature. For example, when the target image element is a face image, the same image feature may be an image feature of eyes, mouth, nose, and the like in the two target image elements.
S622: and setting positioning anchor points on the at least three same image features. Specifically, the coordinates of the center points of the same image features are set as positioning anchor points.
S623: and carrying out standardization processing on the two target image elements based on the positioning anchor point to generate two standardized image elements. For example, as shown in fig. 7, fig. 7(a) shows a plurality of positioning anchors a, B, c, d, e of a first target image element, which are represented by solid circles, and fig. 7(B) shows a plurality of positioning anchors a ', B ', c ', d ', e ' of a second target image element, which are represented by open circles, and the second target image element is rotated and stretched according to the correspondence between the positioning anchors of the two target image elements, so that the second target image element has the same size and angle as the first image element. Specifically, two straight lines passing through a plurality of anchor points are determined, such as ae, bd and a 'e', b'd' in fig. 7; as shown in fig. 7(C), performing the rotation and stretching operations on the second target image element makes each anchor point on the second target image element have the same boundary line with the first target image element in the horizontal up and down direction and the vertical left and right direction.
S624: -extracting differentiated features having the same configuration from the two normalized image elements. After the unification in size and angle, the images of the two target image elements still have differences in shape, color, and the like.
S625: and carrying out intermediate value taking on at least one image parameter of the differential feature to generate a transition form image element.
As shown in fig. 8, in the above-mentioned multi-device collaborative photo display method, the step of extracting the differentiated features having the same structure from the two standardized image elements specifically includes:
s641: performing edge feature extraction on the two standardized image elements to generate two edge feature images;
s642: performing corner detection on the two edge feature images to generate two corner distribution images;
s643: and matching the two standardized image element images based on the two corner distribution images to obtain the difference characteristics with the same structure in the two standardized image elements.
Further, in the above method for displaying a photo with multiple devices in cooperation, the step of matching the two standardized image element images based on the two corner distribution images to obtain the differentiated features with the same structure in the two standardized image elements specifically includes:
and acquiring image features as the differentiation features, wherein the image features are the same in the number of the corner points, the relative positions of the corner points are similar, the difference value of the relative distances between the corner points is not more than a first threshold value, and the difference value of the relative distances between at least one pair of corner points is more than a second threshold value.
Further, in the above method for displaying a photo with multiple devices in cooperation, the step of matching the two standardized image element images based on the two corner distribution images to obtain the differentiated features with the same structure in the two standardized image elements specifically includes:
and acquiring image characteristics, which are the same in the number of the angular points, similar in the relative positions of the angular points, not larger than a first threshold value in the difference value of the relative distances between the angular points and larger than a third threshold value in the gray difference value, from the two angular point distribution images as the differentiation characteristics.
For example, as shown in fig. 9, fig. 9(a) is an elliptical image feature with 4 corner points on a first normalized image element, and fig. 9(B) is a corresponding image feature on a second normalized image element, both having the same configuration, and as can be seen from the edge feature and the corner point distribution, the relative distances of the corner points in the height direction of the two normalized image elements are different, and the relative distance of the corner points in the height direction is taken as a median to obtain an image element of a transitional form shown by a dashed line in the figure.
Further, in the above method for displaying a photo with multiple devices in cooperation, before the step of taking an intermediate value of at least one image parameter of the differentiated features to generate the image element in the transitional form, the method further includes:
and sorting the second image elements by taking the image parameters of one or more of the differential features as sorting conditions. By adopting the technical scheme of the embodiment, the user can more conveniently select the two target image elements needing to obtain the transitional form image elements.
A second aspect of the present invention provides a mobile terminal, including a processor and a memory, where the processor executes a program on the memory to implement the multi-device collaborative photo display method according to the first aspect.
The invention provides a multi-device cooperative photo display method and a mobile terminal, which can improve user experience by receiving a photo data acquisition request of a photo display device, acquiring a photo list and a corresponding thumbnail which are not synchronized locally to a photo storage device, sending the photo list and the corresponding thumbnail to the photo display device, receiving a target photo display notification sent by the photo display device, displaying the thumbnail of the first photo list according to a preset sequencing mode, and positioning the thumbnail to the target photo, wherein the target photo display notification comprises information of the target photo and a first photo list and thumbnails of the photo storage device and other synchronization devices which establish a synchronization relationship with the photo storage device.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
While embodiments in accordance with the invention have been described above, these embodiments are not intended to be exhaustive or to limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. The invention is limited only by the claims and their full scope and equivalents.
Claims (10)
1. A multi-device collaborative photo display method is characterized by comprising the following steps:
receiving a photo data acquisition request of a photo display device;
acquiring a photo list which is not synchronized to a photo storage device locally and a corresponding thumbnail and sending the photo list and the corresponding thumbnail to the photo display device;
receiving a target photo display notification sent by the photo display device, wherein the target photo display notification contains information of the target photo and a first photo list and thumbnails of the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device;
and displaying the thumbnails of the first photo list according to a preset sorting mode, and positioning to the target photo.
2. The multi-device collaborative photo display method according to claim 1, further comprising, after the step of displaying the thumbnails of the first photo list in a preset sorting manner and locating to the target photo:
receiving a first image element sent by the photo display equipment;
acquiring a second photo list containing a second image element, wherein the second image element is an image element similar to the first image element;
acquiring the second image element from the photos in the second photo list for display;
receiving a target image element selected by a user from a plurality of second image elements;
sending the target image element to the photo display device to cause the photo display device to replace the first image element on the target photo with the target image element.
3. The multi-device collaborative photo display method according to claim 2, wherein the step of obtaining a second photo list including a second image element specifically includes:
identifying a local picture to determine a third image list containing second image elements;
acquiring a fourth image list containing second image elements, which is sent by the photo storage device and other synchronization devices establishing a synchronization relationship with the photo storage device;
and integrating the third image list and the fourth image list to form the second image list.
4. The multi-device collaborative photo display method according to claim 2, further comprising, after the step of displaying the thumbnails of the first photo list in a preset sorting manner and locating to the target photo:
receiving two target image elements selected by a user from a plurality of second image elements;
generating a transitional morphological image element of the two target image elements;
sending the transitional form image elements to the photo display device to cause the photo display device to replace the first image elements on the target photo with the transitional form image elements.
5. The multi-device collaborative photo display method according to claim 4, wherein the step of generating a transitional morphological image element of the two target image elements specifically includes:
identifying at least three same image features from the two target image elements;
setting positioning anchor points on the at least three same image features;
standardizing the two target image elements on the basis of the positioning anchor points to generate two standardized image elements;
extracting differentiated features having the same configuration from the two normalized image elements;
and carrying out intermediate value taking on at least one image parameter of the differential feature to generate a transition form image element.
6. The multi-device collaborative photo display method according to claim 5, wherein the step of extracting the differentiated features having the same configuration from the two normalized image elements specifically includes:
performing edge feature extraction on the two standardized image elements to generate two edge feature images;
performing corner detection on the two edge feature images to generate two corner distribution images;
and matching the two standardized image element images based on the two corner distribution images to obtain the difference characteristics with the same structure in the two standardized image elements.
7. The multi-device collaborative photo display method according to claim 6, wherein the two normalized image element images are matched based on the two corner distribution images, and the step of obtaining the differentiated features having the same configuration in the two normalized image elements specifically includes:
and acquiring image features as the differentiation features, wherein the image features are the same in the number of the corner points, the relative positions of the corner points are similar, the difference value of the relative distances between the corner points is not more than a first threshold value, and the difference value of the relative distances between at least one pair of corner points is more than a second threshold value.
8. The multi-device collaborative photo display method according to claim 6, wherein the two normalized image element images are matched based on the two corner distribution images, and the step of obtaining the differentiated features having the same configuration in the two normalized image elements specifically includes:
and acquiring image characteristics, which are the same in the number of the angular points, similar in the relative positions of the angular points, not larger than a first threshold value in the difference value of the relative distances between the angular points and larger than a third threshold value in the gray difference value, from the two angular point distribution images as the differentiation characteristics.
9. The multi-device collaborative photo display method according to any one of claims 5 to 8, wherein before the step of intermediating a value of at least one image parameter of the differentiated features to generate a transitional morphological image element, further comprising:
and sorting the second image elements by taking the image parameters of one or more of the differential features as sorting conditions.
10. A mobile terminal comprising a processor and a memory, wherein the processor executes a program on the memory to implement the multi-device collaborative photo display method according to claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210488132.8A CN114896432B (en) | 2022-05-06 | 2022-05-06 | Multi-device collaborative photo display method and synchronization device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210488132.8A CN114896432B (en) | 2022-05-06 | 2022-05-06 | Multi-device collaborative photo display method and synchronization device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114896432A true CN114896432A (en) | 2022-08-12 |
| CN114896432B CN114896432B (en) | 2023-03-24 |
Family
ID=82718725
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210488132.8A Active CN114896432B (en) | 2022-05-06 | 2022-05-06 | Multi-device collaborative photo display method and synchronization device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114896432B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092749A (en) * | 2014-07-01 | 2014-10-08 | 小米科技有限责任公司 | Method and device for synchronizing photos |
| CN105704383A (en) * | 2016-03-24 | 2016-06-22 | 徐亚红 | Interesting image shooting method |
| CN106453572A (en) * | 2016-10-19 | 2017-02-22 | 广东欧珀移动通信有限公司 | Method and system for synchronizing images based on cloud server |
| US20170139554A1 (en) * | 2015-11-18 | 2017-05-18 | Kabushiki Kaisha Toshiba | Electronic apparatus and display control method |
| CN110868620A (en) * | 2018-08-28 | 2020-03-06 | 陈旭 | Remote interaction system and method based on television |
| CN114418618A (en) * | 2021-12-27 | 2022-04-29 | 北京三快在线科技有限公司 | Promotion image generation method and device, electronic equipment and readable storage medium |
-
2022
- 2022-05-06 CN CN202210488132.8A patent/CN114896432B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092749A (en) * | 2014-07-01 | 2014-10-08 | 小米科技有限责任公司 | Method and device for synchronizing photos |
| US20170139554A1 (en) * | 2015-11-18 | 2017-05-18 | Kabushiki Kaisha Toshiba | Electronic apparatus and display control method |
| CN105704383A (en) * | 2016-03-24 | 2016-06-22 | 徐亚红 | Interesting image shooting method |
| CN106453572A (en) * | 2016-10-19 | 2017-02-22 | 广东欧珀移动通信有限公司 | Method and system for synchronizing images based on cloud server |
| CN110868620A (en) * | 2018-08-28 | 2020-03-06 | 陈旭 | Remote interaction system and method based on television |
| CN114418618A (en) * | 2021-12-27 | 2022-04-29 | 北京三快在线科技有限公司 | Promotion image generation method and device, electronic equipment and readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 马艳等: "基于ACR的多屏同步互动应用技术浅析", 《电视技术》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114896432B (en) | 2023-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110602396B (en) | Intelligent group photo method and device, electronic equipment and storage medium | |
| US11895567B2 (en) | Lending of local processing capability between connected terminals | |
| US20200310631A1 (en) | Method and Apparatus for Dynamically Displaying Icon Based on Background Image | |
| CN111623755B (en) | Enabling automatic measurements | |
| CN111541907B (en) | Article display method, apparatus, device and storage medium | |
| CN105301971B (en) | A kind of method and its system controlling smart machine based on image recognition | |
| US9857963B2 (en) | Method and apparatus for generating or using interaction activity information | |
| WO2022100262A1 (en) | Display device, human body posture detection method, and application | |
| CN113191117A (en) | Editing method, device and equipment of electronic document and storage medium | |
| KR20150007403A (en) | Apparatus and method for operating information searching data of persons and person recognizes method using the same | |
| CN116472715A (en) | Display device and camera tracking method | |
| CN113342435A (en) | Expression processing method and device, computer equipment and storage medium | |
| CN113446717B (en) | Smart page display method and device and electronic equipment | |
| CN114896432B (en) | Multi-device collaborative photo display method and synchronization device | |
| CN108055461B (en) | Self-photographing angle recommendation method and device, terminal equipment and storage medium | |
| CN107147786B (en) | Image acquisition control method and device for intelligent terminal | |
| CN109343786A (en) | Control method, device, intelligent elevated table and the storage medium of intelligent elevated table | |
| KR102234660B1 (en) | System and method for tagging additional information on 3d tour | |
| CN112449098A (en) | Shooting method, device, terminal and storage medium | |
| CN114647983A (en) | Display device and distance detection method based on portrait | |
| CN113286082B (en) | Target object tracking method, target object tracking device, electronic equipment and storage medium | |
| CN116092113A (en) | Gesture recognition method, gesture recognition device, electronic equipment and computer readable storage medium | |
| CN114299407A (en) | Virtual reality equipment and VR scene image identification method | |
| CN117197222A (en) | Shadow display method, device and equipment for television display sub-window and storage medium | |
| JP6234223B2 (en) | Information processing apparatus, information processing apparatus control method, and computer program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |