WO2017202107A1

WO2017202107A1 - Acquisition method and device for multi-media information

Info

Publication number: WO2017202107A1
Application number: PCT/CN2017/076332
Authority: WO
Inventors: 曹恒
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-05-24
Filing date: 2017-03-10
Publication date: 2017-11-30
Also published as: CN107426484A

Abstract

Provided are an acquisition method and device for multi-media information. The method comprises: in the process of acquiring images of a target portion of a terminal user, generating prompt information for the terminal user, the prompt information being used for prompting the adjustment of an acquisition position of an acquisition device and/or the position of the target portion, so that the target portion satisfies acquisition conditions; and in the case where the target portion satisfies the acquisition conditions, acquiring multi-media information about the target portion by means of the acquisition device. By means of the embodiments of the present invention, the problem that the accuracy of acquired images is relatively low when images of a target object are acquired is solved, thus achieving the effect of improving the accuracy of the images.

Description

Method and device for collecting multimedia information

Technical field

The embodiments of the present invention relate to the field of data collection, and in particular, to a method and an apparatus for collecting multimedia information.

Background technique

Mobile phones, which are the must-have items for modern people, have become more and more intelligent and portable, and their performance is becoming more and more powerful. In the near future, mobile phones can become people's health monitoring and disease diagnosis (such as through: hope, smell, Ask, cut) the important front-end equipment. At present, in the five links of medical treatment (registration, medical treatment, examination, payment, medicine collection), the mobile medical application on the mobile phone can better solve the registration, medical treatment, payment, and drug collection, but it cannot be solved very well. How to carry out the "inspection" link.

For example, for some mobile medical platform websites or apps, when checking, they use the "text description + photo" method to collect user's condition information. Because the patient needs to take photos of the sick person himself, the electronic information platform uploaded to the doctor is limited by the medical knowledge of the patient, and the images taken by the doctor often fail to meet the image standards required by the doctor for online diagnosis. The accuracy of the acquired images is low, which will affect the doctor's judgment and delay the illness.

In the related art, when the image acquisition of the target object is performed, the accuracy of the acquired image is low, and an effective solution has not been proposed yet.

Summary of the invention

The embodiment of the invention provides a method and a device for collecting multimedia information, so as to at least solve the problem that the accuracy of the collected image is low when the target object is image-collected in the related art.

According to an embodiment of the present invention, a method for collecting multimedia information is provided. The method includes: generating prompt information to an end user during image capturing of a target part of an end user, wherein the prompt information is used for Prompt to adjust the collection location and/or destination of the acquisition device The position of the target part is such that the target part satisfies the collection condition; and when the target part satisfies the collection condition, the multimedia information of the target part is collected by the acquisition device.

Optionally, image acquisition is performed on the target part of the terminal user by acquiring the current acquisition image of the collection device, identifying the target location from the current acquisition image, and performing image collection on the identified target location.

Optionally, after performing image collection on the identified target part, determining whether the target part meets the collection condition by determining whether the proportion of the image of the target part in the current collection picture is less than a standard ratio, wherein the standard ratio is In order to satisfy the collection condition, the proportion of the target part in the collection screen of the collection device; and determine whether the position of the target part in the current collection screen is within a preset range; The ratio is not less than the standard ratio, and when it is determined that the position of the target portion is within the preset range, it is determined that the target portion satisfies the collection condition; when the image ratio of the target portion is determined to be less than the standard ratio, and/or the target is determined When the position of the part is not within the preset range, it is determined that the target part does not satisfy the collection condition.

Optionally, after determining whether the target part meets the collection condition, the method further includes: when determining that the target part does not satisfy the collection condition, the current picture ratio and the standard proportion of the target part, and/or current a center of the position and the preset range, determining a target adjustment action to be performed on the collection device; generating first prompt information corresponding to the target adjustment action, wherein the first prompt information is used to indicate that the collection position of the collection device is adjusted, so that In the collected image of the adjusted acquisition device, the target portion is within a preset range and the image ratio of the target portion is not less than the standard ratio.

Optionally, the collecting device is disposed on the mobile device, and after generating the first prompt information corresponding to the target adjusting action, the method further includes: collecting, by using one or more sensors on the mobile device, location change information of the mobile device; The collected position change information determines a current adjustment action of the collection device; and when the current adjustment action does not match the target adjustment action, information for prompting an adjustment error is generated.

Optionally, obtaining the current collection screen of the collection device, and identifying the target location from the current collection screen includes: determining whether the sensitivity of the current collection screen reaches a preset value; determining the current When the sensitivity of the collected image does not reach the preset value, the sensitivity adjustment information is generated, so that the sensitivity of the collected image of the adjusted collecting device reaches a preset value; and the sensitivity of the current captured image is determined to be preset. In the case of a value, the target portion is identified from the current acquisition screen.

Optionally, after acquiring the current collection screen of the collection device, the method further includes: generating second prompt information for indicating the position of the adjustment collection device without identifying the target portion from the current collection screen.

Optionally, before the generating the prompt information for the terminal user, the method further includes: acquiring the description information associated with the multimedia information input by the terminal user; after collecting the multimedia information of the target portion by using the collecting device, the method further includes: Description information and multimedia information are uploaded to the database.

Optionally, after acquiring the description information associated with the multimedia information input by the terminal user, the method further includes: selecting a target part to be collected from the plurality of parts of the terminal user; and acquiring an acquisition condition corresponding to the target part.

Optionally, the multimedia information comprises image information and/or video information.

According to another embodiment of the present invention, there is provided a multimedia information collecting apparatus, the apparatus comprising: a first prompting unit configured to generate a prompt to an end user during image capturing of a target part of the end user The information, wherein the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target portion, so that the target portion satisfies the collection condition; and the collection unit is configured to collect by the collection device when the target portion meets the collection condition. Multimedia information of the target area.

According to another embodiment of the present invention, there is provided a storage medium configurable to store program code for performing the following steps: generating an end user during image acquisition of a target portion of an end user The prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target portion, so that the target portion satisfies the collection condition; and when the target portion meets the collection condition, the multimedia information of the target portion is collected by the collection device. .

In the process of performing image collection on a target part of an end user by using an embodiment of the present invention, Generating prompt information to the end user, the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target portion, so that the target portion meets the collection condition; and when the target portion meets the collection condition, the target is collected by the collection device. The multimedia information of the part can collect the multimedia information that satisfies the collection condition, and solves the problem that the accuracy of the collected image is low when the target object is image-collected, and the accuracy of the collected image is improved.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flowchart of a method for collecting multimedia information according to an embodiment of the present invention;

2 is a flowchart of an optional method for collecting multimedia information according to an embodiment of the present invention;

3 is a schematic diagram of an end user performing an acquisition operation according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a multimedia information collection apparatus according to an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

It is to be understood that the terms "first", "second" and the like in the specification and claims of the present invention are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

Example 1

In this embodiment, a method for collecting multimedia information is provided. FIG. 1 is a flowchart of a method for collecting multimedia information according to an embodiment of the present invention. As shown in FIG. 1, the process includes the following steps:

Step S102, in the process of performing image collection on the target part of the end user, generating A prompt message to the end user.

The prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target portion, so that the target portion meets the collection condition, that is, the terminal user can adjust the collection position of the collection device according to the prompt information (such as the collection angle, etc.). The position of the target portion can be adjusted according to the prompt information so that the target portion satisfies the collection condition.

Step S104, in the case that the target part satisfies the collection condition, the multimedia information of the target part is collected by the collection device.

Through the above steps, in the process of performing image collection on the target part of the end user, generating prompt information for the end user, the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target part, so that the target part is satisfied. Acquisition condition; when the target part meets the collection condition, the multimedia information of the target part is collected by the acquisition device, so that the multimedia information satisfying the collection condition can be collected, and the accurate image acquired when the target object is image-collected is solved. The lower degree of the problem improves the accuracy of the acquired image.

The above method can be used for a medical website or a mobile terminal, and the collecting device can be disposed on the mobile device. The collecting device can include, but is not limited to, a camera on the mobile terminal, a camera on the computer, and an externally connected camera device; the terminal user is The patient's target site is the affected part or the part requested by the doctor; the prompt information includes, but is not limited to, voice information, video information, picture information, and text information; the collection condition is to make the captured image information meet the doctor's diagnosis needs. The set conditions, such as the resolution of the image, the exposure, the location, size, and the like of the diseased part; the multimedia information includes image information and/or video information, such as image information and/or video information of the user's diseased part.

On the online medical health consultation platform or mobile client, the user's shooting can be guided by voice, etc., and the photos collected by the collecting device are automatically judged to meet the requirements. When the requirements are met, the patient is photographed and photographed. Wait, and upload it to the electronic information platform used by the doctor for the doctor to check the patient, give scientific and reasonable advice, or preliminary diagnosis.

When using the above method on a mobile terminal, such as on a mobile phone, the rear camera of the mobile phone is quite In the doctor's eyes, it is possible to take a photo or video of the patient's patient's location (ie, the target area); the rear flash of the mobile phone is equivalent to the flashlight in the doctor's hand, and the shooting effect can be improved by using the flash; the speaker of the mobile phone can pass the doctor The sound and voice adjustment information, etc., through the voice guidance and communication to complete the examination of the patient.

Hereinafter, an embodiment of the present application will be described in detail by taking a mobile phone as an example. The above method of the present invention can be implemented by a mobile phone and an instruction device.

The mobile phone collects the patient's condition image information through the mobile phone components such as the camera and its flash, and guides the patient to adjust the posture of the mobile phone to capture the high-quality disease image through the sensor such as the gyroscope of the mobile phone and the audio component of the mobile phone during the collection process. . The mobile phone is the execution mechanism of the disease image acquisition process, and the goal is to achieve the shooting requirements of the shooting object, the shooting quality, the shooting effect, and the like, and complete the uploading of the disease image information.

The command device provides shooting requirements for the subject, shooting quality, and shooting effects of the mobile phone. The command device may be arranged on the network server side, or may be arranged as a software module locally on the mobile phone, or in a mixed arrangement.

After acquiring the description information associated with the multimedia information input by the terminal user, the collection conditions are different due to different diseased parts, and therefore, the target part that the terminal user needs to collect may be obtained according to the plurality of parts determined by the user; The acquisition condition corresponding to the target part is then photographed. When the target part of the patient is photographed, after starting the mobile phone, it can be realized by the steps shown in FIG. 2:

In step S202, the mobile phone loads the shooting target (ie, the shooting request) issued by the instruction device.

The shooting target information, such as the subject of the mobile phone, the quality of the shooting, and the shooting effect, are issued by the mobile phone loading instruction device.

Optionally, the loaded shooting target is not limited to one shooting object, and may also be a group of shooting objects and their shooting quality and effect requirements, such as resolution, exposure, position and size of the affected part, and the like.

In step S204, the mobile phone starts shooting, and starts to prompt the user to adjust the posture of the mobile phone.

Step S206, the mobile phone compares the captured image and the shooting target in real time, and finds out how the user should Adjust the phone gesture.

In the process of capturing the target part, in order to successfully capture the target part, that is, the user's diseased part, after acquiring the current acquisition picture of the collection device (ie, the mobile phone camera), the target part is not recognized from the current collection picture (ie, suffering from the target part) In the case of a diseased part, new prompt information (ie, second prompt information) for instructing the adjustment of the collection device is generated so that the adjusted acquisition device can acquire an image of the target portion.

Optionally, in order to facilitate the diagnosis of the patient (ie, the end user) according to the captured multimedia information, the sensitivity of the multimedia information may be adjusted (eg, to reach 200), and the current collection screen of the acquisition device is obtained from the current When the target part is identified in the collection screen, it is determined whether the sensitivity of the current collection screen reaches a preset value; when it is determined that the sensitivity of the current collection screen does not reach the preset value, sensitivity adjustment information (such as voice adjustment information) is generated. The user adjusts the shooting setting of the mobile phone according to the voice adjustment information, so that the sensitivity of the collected image of the adjusted collecting device reaches a preset value; when it is determined that the sensitivity of the current collecting screen reaches a preset value, from the current The target part is identified in the acquisition screen.

In step S208, the mobile phone voice guides the user to adjust the gesture of the mobile phone.

After generating the prompt information for the terminal user, the user adjusts the shooting angle, position, and the like of the mobile phone according to the voice prompt information.

If the target part does not satisfy the collection condition, determining a target adjustment action to be performed on the collection device according to the current picture ratio and the standard ratio of the target part, and/or the center of the current position and the preset range; generating corresponding to the target Adjusting the first prompt information of the action, wherein the first prompt information is used to indicate that the collection position of the collection device is adjusted, so that in the collected image of the adjusted collection device, the target portion is within a preset range and the image of the target portion is occupied. The ratio is not less than the standard ratio.

The mobile phone determines the mobile phone in three-dimensional space according to the difference between the current picture ratio and the standard ratio of the image, the current position of the target part, and the coordinate difference between the center of the preset range (ie, the coordinate of the center position). The amount of change in the three dimensions (including the moving distance and the angle of rotation), and according to this, the target adjustment action is obtained, and the patient is informed by voice or the like, the movement track or the movement mode that the mobile phone needs to perform in three dimensions. Specifically, the way of adjustment obtained In the depth direction, that is, the moving distance in the axial direction corresponding to the straight line of the mobile phone and the target portion, and the angle of rotation in the other two axial directions.

In step S210, the mobile phone determines whether the user correctly adjusts the posture of the mobile phone.

After generating the first prompt information corresponding to the target adjustment action, during the end user moving the mobile phone, the location change information of the mobile device is collected by one or more sensors (such as a gyroscope and an acceleration sensor) on the mobile device; The collected position change information determines a current adjustment action of the collection device; and when the current adjustment action does not match the target adjustment action, information for prompting an adjustment error is generated. And by comparing the shooting targets, analyzing the gaps, and combining the sensor information of the mobile phone, the mobile phone posture adjustment path is obtained, and the user is prompted to correct or new adjustment path. The mobile phone guides the patient to adjust the posture of the mobile phone through voice prompts, and monitors the posture adjustment process of the mobile phone in real time to ensure that the patient adjusts the posture of the mobile phone correctly. If yes, step S212 is performed, otherwise, the process returns to step S208.

In step S212, the mobile phone determines whether the current captured image reaches the shooting target.

The mobile phone acquires the current collection screen of the collection device in real time; identifies the target part, that is, the diseased part, from the current collection screen; determines whether the target part satisfies the collection condition, wherein, when it is determined that the target part satisfies the collection condition, the collection device is adopted Collect multimedia information of the target area.

Specifically, after performing image acquisition on the identified target portion, it is determined whether the target portion satisfies the acquisition condition by the following manner, that is, whether the determination of the target portion meets the collection condition can be achieved by: determining that the target portion is in the current collection screen. Whether the proportion of the picture in the picture is smaller than the standard ratio, wherein the standard ratio is the proportion of the target part in the collection screen of the collection device when the collection condition is satisfied; and determining the target part in the current collection picture Whether the position is within a preset range; wherein, when it is determined that the image ratio of the target portion is not less than the standard ratio, and determining that the position of the target portion is within the preset range, determining that the target portion meets the collection condition, step S214 is performed. When it is determined that the proportion of the picture of the target part is less than the standard ratio, and/or, it is determined that the position of the target part is not within the preset range, it is determined that the target part does not satisfy the collection condition. If the collection condition is not satisfied, the process returns to step S208 to perform the operation on the mobile phone. readjust.

In step S214, the mobile phone voice prompts the user to start shooting and acquire an image.

In the above embodiment, after acquiring the shooting target, the mobile phone guides the user to approach the shooting requirement step by step, and the mobile phone uses the mobile phone voice to guide the user to self-collect high-quality disease pictures through the comprehensive analysis of the image comparison and the posture thereof. Shooting requirements. Users can self-collect high-quality pictures of illnesses, and provide doctors with one or several pictures of high quality pictures and good pictures around the location of the disease, for doctors to diagnose on the online platform.

It should be noted that, before generating the prompt information for the terminal user, the description information associated with the multimedia information input by the terminal user is acquired; after the multimedia information of the target portion is collected by the collection device, the description information and the multimedia information are uploaded to the database. So that the doctor can diagnose the patient's condition based on the collected multimedia information.

The following is an example of the application of Xiaoming's throat inflammation as an example:

Xiao Ming’s throat is uncomfortable these days, and it’s a little hot. It feels that the tonsils are inflamed. Xiao Ming hopes to use the telemedicine app on the mobile phone to let the online doctors see if he needs to go to the hospital for examination or to buy some medicine at the pharmacy. You don't have to go to the hospital.

The basic configuration of the mobile phone used by Xiao Ming is as follows: 5.2-inch FHD AMOLED screen, eight-core 1.5GHz processor, 3GB memory, 32GB storage, 13-megapixel AF (Auto Focus), rear camera, dual LED white flash , 8 megapixel FF (Fix Focus, fixed focus) front camera (without flash), 2800mAh battery.

As shown in Figure 3, during operation, Xiao Ming opens the telemedicine app on the mobile phone. In the “Sick Description” interface, the brief text describes his condition and feeling, as well as the temperature and other information, and then clicks on the interface. "Image capture" button, the interface jumps to the "sick part" interface, Xiao Ming clicks on the "throat" button, and then the telemedicine app locally calls the subject of the "throat" condition, the shooting quality, the shooting effect of the shooting target Requested and passed to the phone. For example, the subject: throat, tonsil part; shooting quality: picture resolution is above 3328 * 2496, the area of the tonsil area is more than 40%, and its position is in the middle of the picture; shooting effect: photo ISO (ie Sensitivity) is between 200 and 400. The target received by the mobile terminal The information has been translated into a digital signal that the mobile phone can accept and process. For the subject, it is a picture of the human body's standard throat and tonsil parts.

The phone activates the camera function and turns on the dual LED white light flash, and the voice prompt Xiao Ming: "Please point the camera on the back of your phone toward your mouth, and open the mouth as much as possible. The photo of your throat will be taken below."

According to the voice prompt, Xiao Ming will point the back camera of the mobile phone to his mouth and open his mouth as much as possible. After that, the mobile phone will analyze whether the image captured by the current camera is close to or meet the shooting target. The mobile phone can compare the standard picture of the subject with the current real-time picture to determine whether the shooting requirements are met.

Through image analysis, the mobile phone found that the circular area of the throat is in the middle of the whole image, but it is located in the middle of the whole image. Xiaoming needs to adjust the posture through the mobile phone, so that the circular area of the throat appears in the whole image. Central area. The mobile phone judges the adjustment logic of the photographed image to determine how the posture of the mobile phone should be adjusted. For example, the horizontal position of the mobile phone does not change, and the mobile phone needs to rotate the upper end of the mobile phone toward the user with the central axis of the length as the axis, so that the throat is rounded. The area can be adjusted from the middle of the entire image to the middle of the entire image.

The phone then prompts Xiao Ming to say: “The current throat is in the lower position of the image. Please rotate the upper end of the phone slowly toward your face and keep it in the horizontal direction.” At this time, the phone turns on its own. The gyroscope and the accelerometer use the current mobile phone attitude as the initial attitude, and start to monitor the parameter changes of the sensor in real time. The mobile phone uses the gyro sensor to calculate the rotational angular velocity and the rotation angle of the mobile phone with the length of the central axis as the axis, and the mobile phone passes the acceleration sensor. Calculate whether the mobile phone has a displacement change on the horizontal axis, that is, the mobile phone determines the direction of the gesture adjustment of the mobile phone by calculating its rotation angle and displacement amount, and uses this to detect whether Xiaoming performs the attitude adjustment according to the voice prompt.

The mobile phone confirms the data analysis of the gyroscope and the acceleration sensor, and Xiao Ming is correcting the posture of the mobile phone according to the voice indication.

Then, determine whether the proportion of the throat area meets the shooting requirements. As Xiaoming adjusts the posture of the mobile phone, the position of the throat is gradually centered, and the proportion of the throat area reaches 42% of the entire image. When the mobile phone voice prompts Xiaoming: "Please stabilize the phone, is preparing image sampling, 3, 2, 1, take a picture." When the voice prompts Xiaoming, the mobile phone also raises the resolution of the photo image to 4160*3120 according to the photographing effect and the photographing quality requirement in the shooting target, and adjusts the ISO value of the photograph to reach 400, etc. (It can also be set when the camera is started. ), and complete the photo, that is, the sampling of the disease image.

After taking a picture of Xiao Ming’s throat, it is displayed on the screen of the mobile phone, and Xiao Ming decides whether to upload the picture to the telemedicine platform. When Xiao Ming chooses “Upload”, the medical description information submitted by Xiao Ming and The disease image information is transmitted to the telemedicine platform for the doctor to conduct an online diagnosis, to find out whether Xiao Ming needs to go to the hospital for medical treatment, or go to the pharmacy to purchase the relevant drugs without going to the hospital.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention in essence or the contribution to the related art can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, computer, server, or network device, etc.) to perform the methods described in various embodiments of the present invention.

Example 2

In this embodiment, a device for collecting multimedia information is provided, which is used to implement the foregoing embodiments and preferred embodiments, and details are not described herein. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

FIG. 4 is a schematic diagram of a multimedia information collection apparatus according to an embodiment of the present invention. As shown in FIG. 4, the apparatus includes a first prompting unit 41 and an acquisition unit 43.

The first prompting unit 41 is configured to generate prompt information for the terminal user in the process of performing image collection on the target part of the terminal user.

The collecting unit 43 is configured to collect the multimedia information of the target part through the collecting device when the target part satisfies the collecting condition.

Through the above steps, in the process of performing image collection on the target part of the end user, the first prompting unit generates prompt information for the end user, and the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target part, The target part meets the collection condition; when the target part satisfies the collection condition, the acquisition unit controls the collection device to collect the multimedia information of the target part, so that the multimedia information satisfying the collection condition can be collected, and the image acquisition of the target object is solved. The accuracy of the acquired image is low, and the accuracy of the acquired image is improved.

The collecting device may be disposed on the mobile device, and the collecting device may include, but is not limited to, a camera on the mobile terminal, a camera on the computer, and an external camera device; the terminal user is a patient, the target part is a diseased part or the doctor requests to shoot The prompt information includes, but is not limited to, voice information, video information, picture information, and text information; the collection condition is a condition set for the captured image information to meet the diagnosis requirements of the doctor, such as the resolution of the image, Exposure, location, size, etc. of the diseased part; multimedia information includes image information and/or video information.

It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination. The forms are located in different processors.

Example 3

Embodiments of the present invention also provide a storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

S1, in the process of performing image collection on the target part of the end user, generating prompt information for the end user, the prompt information is used to prompt to adjust the collection position and/or the target part of the collection device. Position so that the target site meets the collection conditions;

S2: Collecting multimedia information of the target part through the collecting device when the target part satisfies the collecting condition.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.

For example, the specific examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

In the embodiment of the present invention, in the process of performing image collection on the target part of the terminal user, prompt information is generated for the terminal user, and the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target part, so that The target part satisfies the collection condition; when the target part satisfies the collection condition, the multimedia information of the target part is collected by the collection device, so that the multimedia information satisfying the collection condition can be collected, and the image acquisition when the target object is collected is solved. The problem of lower accuracy of the image obtained improves the accuracy of the acquired image.

Claims

A method for collecting multimedia information, comprising:

In the process of performing image collection on the target part of the end user, generating prompt information for the end user, wherein the prompt information is used to prompt to adjust the collection position of the collection device and/or the position of the target portion, Having the target site meet the collection condition;

The multimedia information of the target part is collected by the collecting device if the target part satisfies the collecting condition.
The method according to claim 1, wherein the image acquisition of the target part of the end user is performed by:

Obtaining a current collection screen of the collection device;

And identifying the target part from the current acquisition screen, and performing image collection on the identified target part.
The method according to claim 2, wherein after the image acquisition of the identified target portion is performed, it is determined whether the target portion satisfies an acquisition condition by:

Determining whether the proportion of the picture in the current collection picture is smaller than a standard ratio, wherein the standard ratio is that the target part is in the collection device if the collection condition is satisfied The proportion of the captured image;

And determining whether the location of the target part in the current acquisition picture is within a preset range;

When it is determined that the proportion of the picture of the target part is not less than the standard ratio, and determining that the position of the target part is within the preset range, determining that the target part meets the collection condition Determining that the target portion does not satisfy the collection when it is determined that the proportion of the image of the target portion is less than the standard ratio, and/or determining that the location of the target portion is not within the preset range condition.
The method according to claim 2 or 3, wherein after determining whether the target portion satisfies the collection condition, the method further comprises:

Determining, by the current picture occupation ratio of the target part and the standard ratio, and/or the current position and the center of the preset range, when it is determined that the target part does not satisfy the collection condition A target adjustment action performed on the collection device is required;

Generating a first prompt information corresponding to the target adjustment action, wherein the first prompt information is used to indicate adjusting an acquisition position of the collection device, so that in the collected collection screen of the collection device, The target portion is within the preset range and the picture ratio of the target portion is not less than the standard ratio.
The method of claim 4, wherein the collecting device is disposed on the mobile device, and after the generating the first prompt information corresponding to the target adjusting action, the method further comprises:

Collecting location change information of the mobile device by one or more sensors on the mobile device;

Determining, by the collected position change information, a current adjustment action of the collection device;

When the current adjustment operation does not match the target adjustment operation, information for prompting an adjustment error is generated.
The method of claim 2, wherein acquiring the current collection screen of the collection device, and identifying the target portion from the current collection screen comprises:

Determining whether the sensitivity of the current collection picture reaches a preset value;

When it is determined that the sensitivity of the current collection screen does not reach the preset value, the sensitivity adjustment information is generated, so that the sensitivity of the adjusted acquisition screen of the collection device reaches the preset value;

When it is determined that the sensitivity of the current acquisition screen reaches the preset value, the target location is identified from the current acquisition screen.
The method according to claim 2 or 6, wherein after acquiring the current acquisition screen of the collection device, the method further comprises:

In the case where the target portion is not recognized from the current acquisition screen, second prompt information for indicating adjustment of the position of the collection device is generated.
The method of claim 1 wherein

Before generating the prompt information for the terminal user, the method further includes: acquiring description information associated with the multimedia information input by the terminal user;

After collecting the multimedia information of the target part by the collecting device, the method further includes: uploading the description information and the multimedia information to a database.
The method of claim 8, wherein after the obtaining the description information associated with the multimedia information input by the terminal user, the method further comprises:

Selecting the target part to be collected from a plurality of parts of the end user;

Obtaining the collection condition corresponding to the target portion.
The method of claim 1 wherein the multimedia information comprises image information and/or video information.
A multimedia information collecting device includes:

The first prompting unit is configured to generate prompt information for the terminal user in the process of performing image collection on the target part of the terminal user, wherein the prompt information is used to prompt to adjust the collection position and/or location of the collection device. Describe the location of the target site such that the target site meets the collection conditions;

The collecting unit is configured to collect the multimedia information of the target part by using the collecting device if the target part satisfies the collecting condition.