CN105808542B - Information processing method and information processing apparatus - Google Patents
Information processing method and information processing apparatus Download PDFInfo
- Publication number
- CN105808542B CN105808542B CN201410838214.6A CN201410838214A CN105808542B CN 105808542 B CN105808542 B CN 105808542B CN 201410838214 A CN201410838214 A CN 201410838214A CN 105808542 B CN105808542 B CN 105808542B
- Authority
- CN
- China
- Prior art keywords
- information
- image
- acquiring
- identification information
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The embodiment of the invention provides an information processing method and an information processing device for electronic equipment, wherein the information processing method comprises the following steps: acquiring an image by using an image acquisition device; acquiring state information of an image acquisition device in an image acquisition process for a currently acquired image file; analyzing the image file to obtain corresponding content information; generating first identification information based on the content information and the state information; the image file is identified using the first identification information. The embodiment of the invention has the advantages of large amount of generated label information, complete and accurate description, simplicity and high efficiency, and convenience for searching the image file by the user through the label information.
Description
Technical Field
The present invention relates to an information processing method and an information processing apparatus applied to an electronic device.
Background
At present, most mobile phones have a photographing function, and when a lot of photos are taken, a user wants to find a desired photo through an index tag of the photo. Some existing software can tag image files based on information about the image files. For example, the existing software may compare the picture uploaded to the server by the user with the existing picture on the server, and add a similar label to the similar picture according to the comparison result. The software needs to train the labeling program by an artificial intelligence method in advance, so that a background server needs a large amount of image file data as training data, and also needs workers to continuously add labels during training, so that the workload is large, and the comparison algorithm is complex.
The other labeling software is used for carrying out image classification identification after the image is generated and labeling the image file through the information obtained by identification, but the algorithm of image identification is complex, the identification accuracy is not high, and the accurate labeling of each photo is difficult; in addition, the amount of information of the tag obtained by recognition is small, and the content of the photograph cannot be described in a comprehensive manner.
In summary, the existing photo labels have the disadvantages of less information amount, inaccurate description, complex algorithm, low efficiency, inconvenience for users to use, and incapability of helping users to quickly find desired photos.
Disclosure of Invention
An object of an embodiment of the present invention is to provide an information processing method and an information processing apparatus applied to an electronic device, so as to solve the above problems.
The embodiment of the invention provides an information processing method, which is applied to electronic equipment, wherein the electronic equipment comprises an image acquisition device, and the method comprises the following steps: acquiring an image by using an image acquisition device; acquiring state information of an image acquisition device in an image acquisition process for a currently acquired image file; analyzing the image file to obtain corresponding content information; generating first identification information based on the content information and the state information; the image file is identified using the first identification information.
The embodiment of the invention provides an information processing device, which is used for electronic equipment, wherein the electronic equipment comprises an image acquisition device, and the information processing device comprises: the image acquisition unit is used for acquiring images by using the image acquisition device; the state information acquisition unit is used for acquiring the state information of the image acquisition device in the image acquisition process for the currently acquired image file; the content information analysis unit is used for analyzing the image file to obtain corresponding content information; an identification information generating unit for generating first identification information based on the content information and the state information; and the identification unit is used for identifying the image file by utilizing the first identification information.
By the scheme provided by the embodiment of the invention, the label can be generated according to the state information of the image file during collection and the content information of the image file, the generated label information is large in quantity, the description is comprehensive, accurate, simple and efficient, and the user can conveniently search the image file through the label information.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly introduced below. The drawings in the following description are merely exemplary embodiments of the invention.
FIG. 1 is a flow diagram of an information processing method according to one embodiment of the invention;
FIG. 2 is a first image file example according to one embodiment of the invention;
fig. 3A, 3B show a second image file example according to a third embodiment of the present invention;
fig. 4 is a flowchart of an information processing method according to a second embodiment of the present invention;
FIG. 5 is a diagram illustrating a third example of an image file according to an embodiment of the present invention;
fig. 6 is an exemplary configuration block diagram of an information processing apparatus according to a third embodiment of the present invention.
Fig. 7 is an exemplary configuration block diagram of an information processing apparatus according to a fourth embodiment of the present invention.
Detailed Description
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that in the present specification and the drawings, steps and elements having substantially the same structure are denoted by the same reference numerals, and repeated explanation of the steps and elements will be omitted.
In the following embodiments of the present invention, an electronic device refers to a device capable of communicating with other devices. Specific forms of electronic devices include, but are not limited to, mobile phones, personal computers, digital cameras, personal digital assistants, portable computers, game consoles, and the like. The electronic device includes an image acquisition apparatus, such as a camera, a video camera, and the like.
FIG. 1 depicts a flow diagram of an information processing method 100 according to one embodiment of the invention. Fig. 2-3,5 are several examples of image files captured according to the information processing method 100. An information processing method 100 according to an embodiment of the present invention will be described below with reference to fig. 1 to 4. The method may be applied to the electronic device described above,
as shown in fig. 1, in step S101, image acquisition is performed by an image acquisition apparatus. The captured images may be in the form of pictures, videos, and the like. In step S102, for the currently acquired image file, state information of the image acquisition apparatus in acquiring an image is acquired. The state information in the process of acquiring the image comprises: the state information of the image acquisition device before image acquisition, the state information of the image acquisition device during image acquisition, the state information of the image acquisition device after image acquisition, and the state change information before and after acquisition, which is obtained according to the state information of the image acquisition device before and during image acquisition.
The state information of the image capturing device before or at the time of image capturing includes, but is not limited to, parameter information of the image capturing device itself before or at the time of image capturing, such as: position, angle, temperature, etc. And operation information of the user on the image capturing device, for example, information on the movement of the user for focusing, rotating, moving, etc. using the image capturing device, and the coordinate position, duration, movement displacement, etc. of the movement. The state change information of the image acquisition device before and after acquisition includes, but is not limited to, a front and back displacement change track, and an acquisition duration, for example, when an active puppy is photographed, the image acquisition device may need to continuously adjust the position, take a long time to obtain a photo with a proper angle, and obtain a displacement line of the image acquisition device according to a plurality of position parameters of the image acquisition device.
Status information of the image acquisition device after image acquisition. Including but not limited to, the status parameters of the image capturing device, the user's actions performed on the captured image file with the image capturing device within a predetermined time after image capture. For example, after the image is captured, the user stores the image in a specific folder within a predetermined time, and the user decorates and processes the image within the predetermined time; or send the image as an attachment to another remote device, etc.
The state information of the image acquisition device in the process of acquiring the image is classified according to the acquisition way, and the method further comprises the following steps: the image acquisition device is used for acquiring parameter information of the image acquisition device, image acquisition device related information detected by the detection device and information acquired from other equipment in the process of acquiring the image. The parameter information of the image acquisition device itself in the process of acquiring the image includes, for example, the size of the acquired image, the resolution of the image, and the like. The information related to the image capturing device detected by the detecting device includes, for example, motion state information of the electronic device in which the image capturing device is located and/or surrounding environment information. For example, sensors in the electronic device detect a motion state of the electronic device when taking a picture, an ambient temperature, and so on. The information acquired from the other device refers to information acquired from the other device connected to the electronic device through a wired or wireless network, for example, received GPS positioning information or the like.
In step S103, the image file is parsed to obtain corresponding content information. The image content is identified by an image identification method, and a main reference object or main content in the image file can be obtained.
In step S104, first identification information is generated based on the content information and the state information. Including but not limited to screening out useful information from the status information of the image acquisition device as one aspect of generating image identification information; useful information is screened out from the content information obtained by analysis, and the useful information is used as one aspect of generating identification information.
Fig. 2 exemplarily shows a first image file of the information processing method 100 according to one embodiment of the present invention, and a process of the information processing method 100 is described below with reference to fig. 2. Referring to fig. 2, firstly, an image acquisition device is used for acquiring an image to obtain an image file, and then, for the currently acquired image file, state information of the image acquisition device in an image acquisition process is acquired to obtain GPS positioning information of an image pickup device, so that it is determined that the image pickup position is "a certain market in a certain city". Then, the image file is analyzed, and by the image recognition method, a goal, a soccer ball, a lawn, and the like in the image can be recognized from fig. 2 as one aspect of generating the identification information. And finally, generating identification information by combining the content information and the state information, and obtaining the identification information of football related activities in a certain market in a certain city.
Further, according to still another example of the present invention, the information processing method 100 in fig. 1 may further include obtaining related extension information based on the state information and/or the image content information, and in step 104, generating the identification information based on the image content information, the state information of the image pickup apparatus, and the extension information. For example, after the image is captured, the state information may be used to search in a knowledge base of the electronic device to obtain extended information related to the state information according to the state information of the image capturing device during the image capturing process. For another example, after the content information in the image is analyzed, related words of content description are obtained, and the content description words are used as keywords to search in a knowledge base of the electronic equipment, so that the information related to the content description words is obtained as the extension information. The knowledge base in the electronic equipment comprises application program data in the electronic equipment, such as short messages, telephone records, notebooks, personal photo albums and the like; data in other devices connected to the electronic device, e.g. internet shopping malls, news, etc.
For example, in the example shown in fig. 2, the image file is analyzed to obtain content description words such as a soccer ball, a goal, and a lawn, the image pickup device status information is acquired to determine that the image pickup position is "a certain mall in a certain city", the content description words such as the soccer ball and the goal lawn are input to the knowledge base, and "a world cup" is obtained from news on the internet as the extension information. In this way, based on the image content information, the state information of the image pickup apparatus, and the extension information, the identification information of the picture is "a certain commercial in a certain city in the world cup does a soccer-related activity".
Fig. 3A and 3B illustrate a second image file example according to the above-described embodiment of the present invention. The processing procedure of the information processing method 100 will be described below with reference to fig. 3A and 3B. First, image acquisition is performed by an image acquisition device, resulting in fig. 3B. Then, state information of the image acquisition device in the process of acquiring the image is acquired, GPS positioning information of the electronic equipment is detected through a detection device on the electronic equipment where the image pickup device is located, and the image shooting position is determined. Then, when acquiring the related extended information based on the state information, according to the GPS positioning information, a map in the electronic device is searched to obtain that the position is "green track", the GPS positioning information is input to the knowledge base, and the image file of the same shooting location is found from the existing data stored in the electronic device, as shown in fig. 3A. Then, comparing fig. 3B with fig. 3A, image recognition is performed, and it can be recognized that the lane of fig. 3B has one more "black car tire" or "white car body" than the lane of fig. 3A. In this way, the identification information of fig. 3B can be generated as "green lane blocked by car today" based on the content information and the status information and the extension information.
In addition, if the user uses the electronic device to take a picture while riding the bicycle to obtain fig. 3A, the detection device in the electronic device where the image capturing device is located detects a signal sent by a sensor on a wearable device such as a user's watch, so as to obtain information such as a motion state, a motion speed, whether there is shake or not, a shake frequency and the like, and after searching through the internet of a knowledge base according to the information, the motion state is determined to be a "riding" state. The content of the image is analyzed to obtain the green track, and the identification information of riding on the green track can be obtained by combining the content.
In step S105, the image file is identified using the identification information. After the image file is identified by the identification information, the image file with the identification information is stored, and an index tag of the image file is generated based on the identification information.
According to the information processing method provided by the embodiment of the invention, the image recognition method is combined with the state data of the image shooting device when the picture is collected, so that an accurate and comprehensive label can be obtained, the algorithm is simple, the use is convenient, and the obtained identification information can fully reflect all aspects of information of the picture. The user can conveniently retrieve a desired image file using the identification information.
FIG. 4 depicts a flow diagram of an information processing method 400 according to another embodiment of the invention. Fig. 5 is an image file captured by an information processing method 400 according to another embodiment of the present invention. The information processing method 400 is similar to some of the steps of the information processing method 100, for example, step S401, image capturing is performed using an image capturing apparatus, similar to step S101, image capturing is performed using an image capturing apparatus. In step S404, first identification information is generated based on the content information and the state information, and similarly to step S104, the first identification information is generated based on the content information and the state information. In step S405, the image file is identified using the first identification information, and similarly to step S105, the image file is identified using the first identification information. For the sake of brevity of the description, only the differences will be described in detail below.
In the information processing method 400 shown in fig. 4, unlike the information processing method 100, for a currently captured image file, state information of an image capturing device in capturing an image is acquired (step S102), and further comprising acquiring at least one focusing operation of the image capturing device at the time of capturing the image, and determining a mapping coordinate position of a focusing point in the image corresponding to the focusing operation (step S402). The image file is analyzed to obtain corresponding content information (step S103), and the method further comprises identifying the content of the image in a predetermined area including the mapping coordinate position to obtain the content information corresponding to the image (step S403).
In step 402, for example, the image capturing device obtains coordinate values (X, Y) of a finger touching the screen when the user selects the focus, or coordinate value positions (X, Y) when the camera automatically selects the focus, and after capturing the image, maps the coordinate values to pixel value positions (M, N) corresponding to the captured image file, and according to the known relationship, X/Y is equal to M/N, thereby determining pixel points or image areas corresponding to the user touching positions in the captured image according to the mapping relationship, and using the points or the areas as the pre-identified key parts. In step 403, the content of the image in the predetermined area including the mapping coordinate position is identified to obtain the content information corresponding to the image. For example, if the user touches a point, the touch point may be enlarged to a predetermined area of a predetermined size, which may be a circle or a square, and the area is identified to obtain the image content information. The image content information obtained by the recognition is used as one aspect of generating the identification information.
In the information processing method according to the embodiment of the invention, the identification information obtained after identifying the focus part is used as the image identification information, so that the core identification information of the image file can be efficiently acquired, and the use of a user is facilitated.
According to an example of the embodiment of the invention, the image acquisition device acquires an image of a moving object. In one embodiment or another embodiment of the invention, when state information of an image acquisition device in the process of acquiring an image is acquired, a plurality of focusing operations of the image acquisition device in the process of acquiring the image of a moving object are acquired, and mapping coordinate positions of focusing points of the plurality of focusing operations corresponding to a plurality of movement moments of the moving object in the image are determined; then, acquiring associated information among a plurality of focusing points according to the mapping coordinate position; further, the identification information is generated based on the content information, the state information, and the association information.
Fig. 5 exemplarily shows an image file according to an embodiment of the present invention, and processing procedures of the information processing method 100 and the information processing method 400 are described below with reference to fig. 5. Firstly, an image acquisition device is used for acquiring images to obtain an image file. Then, the image acquisition device respectively acquires focusing operation corresponding to each motion moment of the moving object when acquiring the image, and determines the mapping coordinate position of a focusing point corresponding to the focusing operation in the image. And then, obtaining the motion trail of the moving object after associating the coordinate positions. And the moving speed of the moving object can be obtained by combining the shooting time. Alternatively, if image content information of the focus position is required, the content of the image in a predetermined area including the mapped coordinate position may also be identified, and content information of the focus in the moving image may be acquired.
Fig. 6 depicts an exemplary structural block diagram of an information processing apparatus 600 according to a third embodiment of the present invention. Fig. 2-3,5 are several examples of image files captured according to the information processing apparatus 600. Next, an information processing apparatus 600 according to an embodiment of the present invention will be described with reference to fig. 2 to 3,5, and 6. The device can be applied to the electronic equipment.
As shown in fig. 6, the image capturing unit 601 performs image capturing using an image capturing apparatus. The captured images may be in the form of pictures, videos, and the like. The state information obtaining unit 602 obtains, for a currently acquired image file, state information of the image acquisition apparatus in an image acquisition process. The state information in the process of acquiring the image comprises: the state information of the image acquisition device before image acquisition, the state information of the image acquisition device during image acquisition, the state information of the image acquisition device after image acquisition, and the state change information before and after acquisition, which is obtained according to the state information of the image acquisition device before and during image acquisition.
The state information of the image capturing device before or at the time of image capturing includes, but is not limited to, parameter information of the image capturing device itself before or at the time of image capturing, such as: position, angle, temperature, etc. And operation information of the user on the image capturing device, for example, information on the movement of the user for focusing, rotating, moving, etc. using the image capturing device, and the coordinate position, duration, movement displacement, etc. of the movement. The state change information of the image acquisition device before and after acquisition includes, but is not limited to, a front and back displacement change track, and an acquisition duration, for example, when an active puppy is photographed, the image acquisition device may need to continuously adjust the position, take a long time to obtain a photo with a proper angle, and obtain a displacement line of the image acquisition device according to a plurality of position parameters of the image acquisition device.
The state information of the image acquisition device after image acquisition includes, but is not limited to, state parameters of the image acquisition device and operation of a user on an acquired image file by using the image acquisition device within a preset time after image acquisition. For example, after the image is captured, the user stores the image in a specific folder within a predetermined time, and the user decorates and processes the image within the predetermined time; or send the image as an attachment to another remote device, etc.
The state information of the image acquisition device in the process of acquiring the image is classified according to the acquisition way, and the method further comprises the following steps: the image acquisition device is used for acquiring parameter information of the image acquisition device, image acquisition device related information detected by the detection device and information acquired from other equipment in the process of acquiring the image. The parameter information of the image acquisition device itself in the process of acquiring the image includes, for example, the size of the acquired image, the resolution of the image, and the like. The information related to the image capturing device detected by the detecting device includes, for example, motion state information of the electronic device in which the image capturing device is located and/or surrounding environment information. For example, sensors in the electronic device detect a motion state of the electronic device when taking a picture, an ambient temperature, and so on. The information acquired from the other device refers to information acquired from the other device connected to the electronic device through a wired or wireless network, for example, received GPS positioning information or the like.
The content information analysis unit 603 analyzes the image file to obtain corresponding content information. By utilizing the image recognition device to recognize the image content, the main reference object or the main content in the image file can be obtained.
The identification information generation unit 604 generates first identification information based on the content information and the state information. Including but not limited to screening out useful information from the status information of the image acquisition device as one aspect of generating image identification information; useful information is screened out from the content information obtained by analysis, and the useful information is used as one aspect of generating identification information.
Fig. 2 exemplarily shows a first image file of an information processing apparatus 600 according to a third embodiment of the present invention, and a process of the information processing apparatus 600 will be described below with reference to fig. 2. Referring to fig. 2, firstly, the image capturing unit 601 captures an image by using an image capturing device to obtain an image file, and then the state information obtaining unit 602 obtains state information of the image capturing device during image capturing for the currently captured image file to obtain GPS positioning information of the image capturing device, so as to determine that the image capturing position is "a certain market in a certain city". Then, the content information analyzing unit 603 analyzes the image file, and the image recognition device recognizes a goal, a soccer ball, a lawn, and the like in the image from fig. 2 as one aspect of generating the identification information. Finally, the identification information generating unit 604 generates identification information by combining the content information and the state information, and can obtain the identification information of "football related activities in a certain market in a certain city".
Further, according to still another example of the present invention, the information processing apparatus 600 in fig. 6 may further include an extended information acquisition unit that acquires related extended information based on the state information and/or the image content information, so that the identification information generation unit 604 generates the identification information based on the above-described image content information, the state information of the image pickup apparatus, and the extended information. For example, after the image is captured, the state information may be used to search in a knowledge base of the electronic device to obtain extended information related to the state information according to the state information of the image capturing device during the image capturing process. For another example, after the content information analyzing unit 603 analyzes the content information in the image, related words of content description are obtained, and the content description words are searched in a knowledge base of the electronic device as keywords, so that information related to the content description words is obtained as extension information. The knowledge base in the electronic equipment comprises application program data in the electronic equipment, such as short messages, telephone records, notebooks, personal photo albums and the like; data in other devices connected to the electronic device, e.g. internet shopping malls, news, etc.
For example, in the example shown in fig. 2, the content information analyzing unit 603 analyzes the image file to obtain content description words such as a soccer ball, a goal, and a lawn, acquires the image pickup apparatus state information via the state information acquiring unit 602, determines that the picture pickup position is "a certain city and a certain market", inputs the content description words such as the soccer ball and the goal lawn into the knowledge base, and obtains "a world cup" as extended information from the news on the internet. In this way, the identification information generating unit 604 can obtain that the identification information of the picture is "a certain market does a soccer related activity in a certain city during the world cup" based on the image content information, the state information of the image pickup apparatus, and the extension information.
Fig. 3A and 3B show a second image file example according to a third embodiment of the present invention. The functional blocks of the information processing apparatus 600 will be described below with reference to fig. 3A and 3B. First, the image capturing unit 601 captures an image using an image capturing device, resulting in fig. 3B. Then, the state information obtaining unit 602 obtains state information of the image capturing device in the process of capturing an image, detects GPS positioning information of the electronic device through a detecting device on the electronic device where the image capturing device is located, and determines the image capturing position. Then, when the extended information acquiring unit acquires the related extended information based on the state information, the map in the electronic device is searched according to the GPS positioning information, and the position is obtained as the "green track", the GPS positioning information is input into the knowledge base, and the image file map 3A of the same shooting location is found from the existing data stored in the electronic device. Then, comparing fig. 3B with fig. 3A, image recognition is performed, and it can be recognized that the lane of fig. 3B has one more "black car tire" or "white car body" than the lane of fig. 3A. In this way, the identification information generation unit 604 can generate the identification information of fig. 3B as "green lane blocked by car today" based on the content information and the state information and the extension information.
In addition, if the user uses the electronic device to take a picture while riding the bicycle to obtain fig. 3A, the detection device in the electronic device where the image capturing device is located detects a signal sent by a sensor on a wearable device such as a user's watch, so as to obtain information such as a motion state, a motion speed, whether there is shake or not, a shake frequency and the like, and after searching through the internet of a knowledge base according to the information, the motion state is determined to be a "riding" state. The content of the image is analyzed to obtain the green track, and the identification information of riding on the green track can be obtained by combining the content.
The identification unit 605 in the information processing apparatus 600 identifies the image file using the identification information. After the image file is identified by the identification information, the image file with the identification information is stored, and an index tag of the image file is generated based on the identification information.
In the information processing device according to the embodiment of the invention, the image recognition device is combined with the state data of the image shooting device when the picture is collected, so that an accurate and comprehensive label can be obtained, the algorithm is simple, the use is convenient, and the obtained identification information can fully reflect all aspects of information of the picture. The user can conveniently retrieve a desired image file using the identification information.
Fig. 7 depicts an exemplary block diagram of an information processing apparatus 700 according to a fourth embodiment of the present invention. Fig. 5 is an image file captured by an information processing apparatus 700 according to a fourth embodiment of the present invention. The information processing apparatus 700 performs image acquisition using an image acquisition apparatus similar to some modules of the information processing apparatus 600, for example, the image acquisition unit 701 performs image acquisition using an image acquisition apparatus similar to the image acquisition unit 601 in the information processing apparatus 600. The identification information generating unit 704 generates the first identification information based on the content information and the state information, and generates the first identification information based on the content information and the state information similarly to the identification information generating unit 604 in the information processing apparatus 600. The identification unit 705 identifies the image file using the first identification information, similarly to the identification unit 605 in the information processing apparatus 600. For the sake of brevity of the description, only the differences will be described in detail below.
In the information processing apparatus 700 shown in fig. 7, the state information acquisition unit 602, unlike the information processing apparatus 600, further includes a first mapped coordinate position determination unit 706. The content information analysis unit 703 further identifies the content of the image in a predetermined area including the mapped coordinate position to acquire content information corresponding to the image.
The first mapping coordinate position determining unit 706 obtains coordinate values (X, Y) of a finger touching the screen when the user selects the focus by using the image capturing device, or coordinate values (X, Y) when the camera automatically selects the focus, maps the coordinate values to pixel value positions (M, N) corresponding to the captured image file after capturing the image, and determines pixel points or image areas corresponding to the user touching positions in the captured image according to the known relationship, where X/Y is M/N, and the points or the areas are used as the key parts to be pre-identified. The content information analyzing unit 703 identifies the content of the image in a predetermined area including the mapped coordinate position to acquire content information corresponding to the image. For example, if the user touches a point, the touch point may be enlarged to a predetermined area of a predetermined size, which may be a circle or a square, and the area is identified to obtain the image content information. The image content information obtained by the recognition is used as one aspect of generating the identification information.
The focus information selected by the camera in the shooting process is important information in the image file, and in the information processing device according to the embodiment of the invention, the identification information obtained by identifying the focus part is used as the image identification information, so that the core identification information of the image file can be efficiently acquired, and the use by a user is facilitated.
According to an example of the embodiment of the invention, the image acquisition device acquires an image of a moving object. In the third embodiment and the fourth embodiment of the present invention, the status information acquiring unit 702 may further include a second mapping coordinate position determining unit, configured to acquire a plurality of focusing operations of the image capturing device when capturing an image of a moving object when acquiring status information of the image capturing device in an image capturing process, and determine mapping coordinate positions of focusing points of the plurality of focusing operations in the image corresponding to a plurality of motion moments of the moving object; then, the association information acquisition unit in the information processing apparatus 600 or the information processing apparatus 700 acquires association information between a plurality of focusing points according to the mapped coordinate position; further, the identification information generation unit 703 generates identification information based on the content information, the state information, and the association information.
Fig. 5 exemplarily shows image files of an information processing apparatus 600 according to a third embodiment and an information processing apparatus 700 according to a fourth embodiment of the present invention, and the processing procedures of the information processing apparatus 600 and the information processing apparatus 700 are described below with reference to fig. 5. First, the image capturing unit 601 or the image capturing unit 701 captures an image using an image capturing device, and obtains an image file. Then, the state information obtaining unit 602 or the first mapped coordinate position determining unit 706 obtains the focusing operation corresponding to each moving moment of the moving object by the image capturing device when capturing the image, and determines the mapped coordinate position of the focusing point corresponding to the focusing operation in the image. And then, the associated information acquisition unit associates the coordinate positions to obtain the motion trail of the moving object. And the moving speed of the moving object can be obtained by combining the shooting time. Alternatively, if image content information of the focus position is required, the content information parsing unit 603 may further identify the content of the image in a predetermined area including the mapped coordinate position, and acquire the content information of the focus in the moving image.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. And the software modules may be disposed in any form of computer storage media. To clearly illustrate this interchangeability of hardware and software, various illustrative components and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It should be understood by those skilled in the art that various modifications, combinations, partial combinations and substitutions may be made in the present invention depending on design requirements and other factors as long as they are within the scope of the appended claims and their equivalents.
Claims (10)
1. An information processing method, the method being used for an electronic device including an image acquisition apparatus, the method comprising:
acquiring an image by using the image acquisition device;
for the image file that is currently being acquired,
acquiring state information of the image acquisition device in the image acquisition process;
analyzing the image file to obtain corresponding content information;
generating first identification information based on the content information and the state information;
identifying the image file by using the first identification information;
the image acquisition device acquires an image of a moving object;
the step of acquiring the state information of the image acquisition device in the process of acquiring the image comprises the following steps:
acquiring a plurality of focusing operations of the image acquisition device when acquiring the image of the moving object, and determining mapping coordinate positions of focusing points of the focusing operations corresponding to a plurality of movement moments of the moving object in the image;
the method further comprises:
acquiring the associated information among the plurality of focusing points according to the mapping coordinate position;
the step of generating first identification information based on the content information and the state information includes:
generating the first identification information based on the content information, the state information, and the association information.
2. The method of claim 1, wherein the method further comprises:
and storing the image file with the first identification information, and generating an index tag of the image file based on the first identification information.
3. The method of claim 1, wherein,
the step of acquiring the state information of the image acquisition device in the process of acquiring the image comprises the following steps:
acquiring at least one focusing operation of the image acquisition device when acquiring the image, and determining a mapping coordinate position of a focusing point corresponding to the focusing operation in the image;
and identifying the content of the image in a predetermined area including the mapping coordinate position to acquire content information corresponding to the image.
4. The method of claim 1, the obtaining status information comprising:
detecting motion state information of the electronic equipment and/or environment information of the electronic equipment to obtain a first detection result;
and generating the first identification information based on the first detection result and the content information.
5. The method of claim 1, wherein the step of generating first identification information based on the content information and the state information is preceded by:
acquiring related extended information based on the acquisition information and/or the image content information;
the step of generating first identification information based on the content information and the state information includes:
generating the first identification information based on the content information, the state information, and the extension information.
6. An information processing apparatus for an electronic device including an image pickup apparatus, the information processing apparatus comprising:
the image acquisition unit is used for acquiring images by using the image acquisition device;
the state information acquisition unit is used for acquiring the state information of the image acquisition device in the image acquisition process for the currently acquired image file;
the content information analysis unit is used for analyzing the image file to obtain corresponding content information;
a first identification information generating unit configured to generate first identification information based on the content information and the state information;
an identification unit configured to identify the image file using the first identification information;
the image acquisition device acquires an image of a moving object;
the state information acquiring unit includes:
the second mapping coordinate position determining unit is used for acquiring a plurality of focusing operations of the image acquisition device when acquiring the image of the moving object and determining mapping coordinate positions of focusing points of the plurality of focusing operations corresponding to a plurality of movement moments of the moving object in the image;
the information processing apparatus further includes:
the associated information acquisition unit is used for acquiring associated information among the focusing points according to the mapping coordinate position;
the first identification information generation unit further generates the first identification information based on the content information, the state information, and the association information.
7. The apparatus according to claim 6, wherein the information processing apparatus further comprises:
and the index tag generating unit is used for storing the image file with the first identification information and generating the index tag of the image file based on the first identification information.
8. The apparatus of claim 6, wherein,
the state information acquiring unit includes:
the first mapping coordinate position determining unit is used for acquiring at least one focusing operation of the image acquisition device when acquiring the image and determining the mapping coordinate position of a focusing point corresponding to the focusing operation in the image;
the content information analysis unit further identifies the content of the image in a predetermined area including the mapping coordinate position to acquire content information corresponding to the image.
9. The apparatus of claim 6, the status information acquisition unit further comprising:
the detection unit is used for detecting the motion state information of the electronic equipment and/or the environment information of the electronic equipment to obtain a first detection result;
the first identification information generation unit further generates the first identification information based on the first detection result and the content information.
10. The apparatus according to claim 6, wherein the information processing apparatus further comprises:
an extended information acquisition unit configured to acquire related extended information based on the acquisition information and/or the image content information before the first identification information acquisition unit generates first identification information based on the content information and the state information;
the first identification information generation unit further generates the first identification information based on the content information, the state information, and the extension information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410838214.6A CN105808542B (en) | 2014-12-29 | 2014-12-29 | Information processing method and information processing apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410838214.6A CN105808542B (en) | 2014-12-29 | 2014-12-29 | Information processing method and information processing apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105808542A CN105808542A (en) | 2016-07-27 |
| CN105808542B true CN105808542B (en) | 2019-12-24 |
Family
ID=56981009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410838214.6A Active CN105808542B (en) | 2014-12-29 | 2014-12-29 | Information processing method and information processing apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105808542B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018072149A1 (en) * | 2016-10-19 | 2018-04-26 | 华为技术有限公司 | Picture processing method, device, electronic device and graphic user interface |
| KR20180070216A (en) * | 2016-12-16 | 2018-06-26 | 삼성전자주식회사 | Method for content tagging and electronic device supporting the same |
| CN108021654A (en) * | 2017-12-01 | 2018-05-11 | 北京奇安信科技有限公司 | A kind of photograph album image processing method and device |
| CN112513799A (en) * | 2018-08-22 | 2021-03-16 | 深圳市欢太科技有限公司 | Shorthand method and device, terminal and storage medium |
| WO2020037576A1 (en) * | 2018-08-22 | 2020-02-27 | 深圳市欢太科技有限公司 | Shorthand method and device, terminal, and storage medium |
| CN112567324A (en) * | 2018-08-22 | 2021-03-26 | 深圳市欢太科技有限公司 | Image shorthand method, terminal and computer storage medium |
| CN113449546A (en) * | 2020-03-24 | 2021-09-28 | 南宁富桂精密工业有限公司 | Indoor positioning method and device and computer readable storage medium |
| CN111145314B (en) * | 2020-04-03 | 2020-07-24 | 速度时空信息科技股份有限公司 | Method for extracting place name symbol of scanning electronic map by combining place name labeling |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2287755A1 (en) * | 2005-07-11 | 2011-02-23 | Eastman Kodak Company | Identifying collection images with special events |
| CN102713714A (en) * | 2010-01-22 | 2012-10-03 | 佳能株式会社 | Automatic focusing apparatus |
| CN102906790A (en) * | 2010-05-26 | 2013-01-30 | 松下电器产业株式会社 | Image information processing apparatus |
| CN103106236A (en) * | 2011-11-14 | 2013-05-15 | 索尼公司 | Information registration device, information registration method, information registration system, information presentation device, informaton presentation method and informaton presentaton system |
| CN103577102A (en) * | 2012-08-06 | 2014-02-12 | 三星电子株式会社 | Method and system for tagging information about image, and apparatus thereof |
-
2014
- 2014-12-29 CN CN201410838214.6A patent/CN105808542B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2287755A1 (en) * | 2005-07-11 | 2011-02-23 | Eastman Kodak Company | Identifying collection images with special events |
| CN102713714A (en) * | 2010-01-22 | 2012-10-03 | 佳能株式会社 | Automatic focusing apparatus |
| CN102906790A (en) * | 2010-05-26 | 2013-01-30 | 松下电器产业株式会社 | Image information processing apparatus |
| CN103106236A (en) * | 2011-11-14 | 2013-05-15 | 索尼公司 | Information registration device, information registration method, information registration system, information presentation device, informaton presentation method and informaton presentaton system |
| CN103577102A (en) * | 2012-08-06 | 2014-02-12 | 三星电子株式会社 | Method and system for tagging information about image, and apparatus thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105808542A (en) | 2016-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105808542B (en) | Information processing method and information processing apparatus | |
| RU2597232C1 (en) | Method for providing a video in real time and device for its implementation, as well as a server and a terminal device | |
| EP3125135B1 (en) | Picture processing method and device | |
| WO2019105440A1 (en) | Video editing and pushing method, system and intelligent mobile terminal | |
| US9269191B2 (en) | Server, client terminal, system and program for presenting landscapes | |
| CN106131627B (en) | A kind of method for processing video frequency, apparatus and system | |
| WO2018233480A1 (en) | Photograph recommendation method and related product | |
| CN105956518A (en) | Face identification method, device and system | |
| CN110650379B (en) | Video abstract generation method and device, electronic equipment and storage medium | |
| CN107995422B (en) | Image shooting method and device, computer equipment and computer readable storage medium | |
| CN108886574B (en) | Shooting guide method, equipment and system | |
| CN105631408A (en) | Video-based face album processing method and processing device | |
| CN107430436B (en) | Automatic detection of panoramic gestures | |
| KR100956159B1 (en) | Apparatus and auto tagging method for life-log | |
| US10838460B2 (en) | Monitoring video analysis system and monitoring video analysis method | |
| EP3323236A1 (en) | Image production from video | |
| CN105809174A (en) | Method and device for identifying image | |
| US20210168279A1 (en) | Document image correction method and apparatus | |
| US9635234B2 (en) | Server, client terminal, system, and program | |
| CN105956091A (en) | Extended information acquisition method and device | |
| US20150215585A1 (en) | System and method for providing live imagery associated with map locations | |
| CN106777071B (en) | Method and device for acquiring reference information by image recognition | |
| WO2017011795A1 (en) | Image production from video | |
| US11574502B2 (en) | Method and device for identifying face, and computer-readable storage medium | |
| KR20120036494A (en) | Method and system for providing real-time broadcasting information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |