CN114500831A

CN114500831A - Prompting method and device in image acquisition process, electronic equipment and storage medium

Info

Publication number: CN114500831A
Application number: CN202111662969.1A
Authority: CN
Inventors: 不公告发明人
Original assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Current assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Priority date: 2021-12-30
Filing date: 2021-12-30
Publication date: 2022-05-13

Abstract

The embodiment of the invention provides a prompting method, a prompting device, electronic equipment and a readable medium in an image acquisition process, wherein the method comprises the following steps: in the secondary image acquisition process of the user for the same acquisition task, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, so that the situation that the prior acquisition track cannot be found back after single shooting is finished is avoided, the continuity between the acquisition track and acquisition information is ensured, and the quality of image acquisition is further ensured.

Description

Prompting method and device in image acquisition process, electronic equipment and storage medium

Technical Field

The present invention relates to the field of image acquisition prompting technology, and in particular, to an image acquisition prompting method, an image acquisition prompting device, an electronic device, and a computer-readable storage medium.

Background

With the development of network technology, online house-looking has become an important way for people to find houses. For online house watching, a personal house owner or a broker is required to shoot the physical house space of a target house source, and then corresponding pictures are uploaded to a corresponding platform, so that a house searching user can search for a house source matched with the demand of the house searching user in the platform. In order to guarantee the authenticity, space perception and the like of house source display, image acquisition can be carried out on the physical house space of the target house source in a panoramic acquisition mode to obtain a panoramic image corresponding to the target house source, so that a house finding user can browse corresponding house source information through the panoramic image. In the collection process, when the collection process is interrupted due to some reasons, the collection user can collect the image again, but when the image enters the collection process again, the continuity of the collection track cannot be guaranteed, the collected information and the previously collected information are easily split, and the quality of image collection is reduced.

Disclosure of Invention

The embodiment of the invention provides a prompting method and device in an image acquisition process, electronic equipment and a computer readable storage medium, and aims to solve or partially solve the problems that continuity of an acquisition track cannot be guaranteed when a secondary acquisition flow enters a prior acquisition flow in the image acquisition process, and image acquisition quality is low due to the fact that acquired information is split.

The embodiment of the invention discloses a prompting method in an image acquisition process, which provides a graphical user interface through an electronic terminal, and comprises the following steps:

in response to an image acquisition operation, determining an acquisition task corresponding to the image acquisition operation;

if the acquisition task is a historical acquisition task, displaying an acquisition point position identifier and a historical acquisition track corresponding to the historical acquisition task in the graphical user interface;

and acquiring an initial position of the electronic terminal, and if the matching between the initial position and the historical acquisition track fails, outputting movement prompt information aiming at the historical acquisition track, wherein the movement prompt information is used for prompting that the electronic terminal is moved to a target position corresponding to the acquisition point position identification so that the position of the electronic terminal is successfully matched with the historical acquisition track.

Optionally, the method further comprises:

and responding to the movement of the electronic terminal, acquiring the current position of the electronic terminal, and if the current position of the electronic terminal is successfully matched with the historical acquisition track, displaying a position indication mark corresponding to the historical acquisition track in the graphical user interface and hiding the movement prompt information.

Optionally, if the current position of the electronic terminal is successfully matched with the historical acquisition track, displaying a position indication identifier corresponding to the historical acquisition track in the graphical user interface, where the displaying includes:

if the current position of the electronic terminal is successfully matched with the historical acquisition track, displaying an acquisition control window and a real-time image stream in the graphical user interface;

acquiring a current acquisition point position identifier corresponding to the current position, and displaying a position indication identifier corresponding to the historical acquisition track at a position corresponding to the current acquisition point position identifier;

and hiding the movement prompt information.

Optionally, the acquisition control window at least includes an image acquisition control and at least one functional space control corresponding to the acquisition site identifier, and the method further includes:

responding to a collection point location determining instruction, determining a target collection point location control corresponding to the collection point location determining instruction, and generating a target collection point location corresponding to the target collection point location control;

responding to the movement of the electronic terminal, controlling the position indication mark to move according to the movement of the electronic terminal, and displaying a movement track associated with the historical acquisition track;

and responding to the control operation aiming at the image acquisition control, acquiring the image of the environment where the electronic terminal is located, marking the end point of the moving track as a target acquisition point position, and displaying a target acquisition point position identification corresponding to the target acquisition point position at the end point.

Optionally, the performing, in response to the control operation for the image acquisition control, image acquisition on an environment where the electronic terminal is located, marking an end point of the movement trajectory as a target acquisition point location, and displaying, at the end point, a target acquisition point location identifier corresponding to the target acquisition point location includes:

responding to the control operation aiming at the image acquisition control, acquiring images of the environment where the electronic terminal is located, outputting acquisition prompt information corresponding to the target acquisition point position until the image acquisition is completed in the image acquisition process, generating target multimedia information corresponding to the target acquisition point position, and displaying the target multimedia information in the target acquisition point position control;

and marking the end point of the moving track as a target acquisition point position, and displaying a target acquisition point position identifier corresponding to the target acquisition point position at the end point.

Optionally, the acquiring control window further includes at least one acquiring point location control corresponding to the functional space control and a point location adding control, and the determining, in response to an acquiring point location determining instruction, a target acquiring point location control corresponding to the acquiring point location determining instruction and generating a target acquiring point location corresponding to the target acquiring point location control include:

responding to the control operation aiming at the collection point position control, determining a first collection point position control corresponding to the control operation, and generating a first collection point position corresponding to the first collection point position control;

or responding to the control operation aiming at the point location adding control, adding a second acquisition point location control corresponding to the current functional space control, and generating a second acquisition point location corresponding to the second acquisition point location control.

Optionally, the displaying, in the graphical user interface, the acquisition site identifier and the historical acquisition trajectory corresponding to the historical acquisition task includes:

displaying an initial house source house type graph, a collection point position identifier and a history collection track corresponding to the history collection task in the graphical user interface;

wherein the method further comprises:

and in response to generating the target multimedia information, updating the initial house source house type graph into a target house source house type graph matched with the target multimedia information.

Optionally, if the initial position and the historical acquisition trajectory fail to be matched, outputting movement prompt information for the historical acquisition trajectory, where the movement prompt information includes:

acquiring a first real-time stream image corresponding to the initial position and historical multimedia information of the historical acquisition task, wherein the historical multimedia information at least comprises a historical house source image;

and if the comparison between the first real-time stream image and the historical house source image fails, outputting movement prompt information aiming at the historical acquisition track.

Optionally, if the matching between the current position of the electronic terminal and the historical acquisition trajectory is successful, displaying an acquisition control window and a real-time image stream in the graphical user interface, including:

acquiring a second real-time stream image corresponding to the current position;

and if the comparison between the second real-time stream image and the historical house source image is successful, displaying an acquisition control window and a real-time image stream in the graphical user interface.

Optionally, the outputting of the movement prompt information for the historical acquisition trajectory includes:

and displaying text prompt information aiming at the historical acquisition track in the graphical user interface, and outputting voice prompt information corresponding to the text prompt information.

The embodiment of the invention also discloses a prompting device in the image acquisition process, which provides a graphical user interface through an electronic terminal, and the device comprises:

the acquisition task determining module is used for responding to image acquisition operation and determining an acquisition task corresponding to the image acquisition operation;

the first content display module is used for displaying an acquisition point position identifier and a historical acquisition track corresponding to the historical acquisition task in the graphical user interface if the acquisition task is the historical acquisition task;

and the prompt information output module is used for acquiring the initial position of the electronic terminal, and outputting movement prompt information aiming at the historical acquisition track if the matching between the initial position and the historical acquisition track fails, wherein the movement prompt information is used for prompting that the electronic terminal is moved to a target position corresponding to the acquisition point position identification so that the position of the electronic terminal is successfully matched with the historical acquisition track.

Optionally, the method further comprises:

and the second content display module is used for responding to the movement of the electronic terminal, acquiring the current position of the electronic terminal, and displaying a position indication mark corresponding to the historical acquisition track in the graphical user interface and hiding the movement prompt information if the current position of the electronic terminal is successfully matched with the historical acquisition track.

Optionally, the second content display module includes:

the image stream display submodule is used for displaying an acquisition control window and a real-time image stream in the graphical user interface if the current position of the electronic terminal is successfully matched with the historical acquisition track;

the position indication mark display submodule is used for acquiring a current acquisition point mark corresponding to the current position and displaying a position indication mark corresponding to the historical acquisition track at a position corresponding to the current acquisition point mark;

and the prompt message hiding submodule is used for hiding the mobile prompt message.

Optionally, the acquisition control window at least includes an image acquisition control and at least one functional space control corresponding to the acquisition site identifier, and the apparatus further includes:

the acquisition point location determining module is used for responding to an acquisition point location determining instruction, determining a target acquisition point location control corresponding to the acquisition point location determining instruction, and generating a target acquisition point location corresponding to the target acquisition point location control;

the movement track display module is used for responding to the movement of the electronic terminal, controlling the position indication mark to move according to the movement of the electronic terminal and displaying a movement track related to the historical acquisition track;

and the acquisition point position identification display module is used for responding to the control operation aiming at the image acquisition control, acquiring the image of the environment where the electronic terminal is located, marking the end point of the moving track as a target acquisition point position, and displaying a target acquisition point position identification corresponding to the target acquisition point position at the end point.

Optionally, the acquisition site identifier display module includes:

the multimedia information acquisition submodule is used for responding to the control operation aiming at the image acquisition control, acquiring an image of the environment where the electronic terminal is located, outputting acquisition prompt information corresponding to the target acquisition point position until the image acquisition is finished in the image acquisition process, generating target multimedia information corresponding to the target acquisition point position, and displaying the target multimedia information in the target acquisition point position control;

and the acquisition point position identification display sub-module is used for marking the end point of the moving track as a target acquisition point position and displaying a target acquisition point position identification corresponding to the target acquisition point position at the end point.

Optionally, the collection control window further includes at least one collection point location control corresponding to the functional space control and a point location adding control, and the collection point location determining module includes:

the first point location determining sub-module is used for responding to the control operation aiming at the acquisition point location control, determining a first acquisition point location control corresponding to the control operation and generating a first acquisition point location corresponding to the first acquisition point location control;

and the second point location determining submodule is used for responding to the control operation aiming at the point location adding control, adding a second acquisition point location control corresponding to the current functional space control and generating a second acquisition point location corresponding to the second acquisition point location control.

Optionally, the first content display module is specifically configured to:

wherein the apparatus further comprises:

and the family pattern updating module is used for responding to the generation of the target multimedia information and updating the initial house source family pattern into a target house source family pattern matched with the target multimedia information.

Optionally, the prompt information output module includes:

the real-time stream acquisition submodule is used for acquiring a first real-time stream image corresponding to the initial position and historical multimedia information of the historical acquisition task, wherein the historical multimedia information at least comprises a historical house source image;

and the prompt information output submodule is used for outputting the movement prompt information aiming at the historical acquisition track if the comparison between the first real-time streaming image and the historical house source image fails.

Optionally, the image stream display sub-module is specifically configured to:

Optionally, the prompt information output module is specifically configured to:

The embodiment of the invention also discloses electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory finish mutual communication through the communication bus;

the memory is used for storing a computer program;

the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.

Also disclosed is a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform a method according to an embodiment of the invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the terminal can respond to the image acquisition operation to determine the acquisition task corresponding to the image acquisition operation, when the acquisition task is detected to belong to the historical acquisition task and the acquisition can be judged to belong to continuous shooting, the acquisition point position identification and the historical acquisition track corresponding to the historical acquisition task can be displayed in the graphical user interface, the initial position of the electronic terminal is obtained, if the matching between the initial position and the historical acquisition track fails and the position of the electronic terminal is represented to be not in the position which is acquired by the history, the terminal can output the movement prompt information aiming at the historical acquisition track, and the user is prompted by the movement prompt information to move the electronic terminal to the functional space corresponding to the acquisition point position identification, so that the position of the electronic terminal is successfully matched with the historical acquisition track, and therefore, in the secondary image acquisition process aiming at the same acquisition task by the user, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, the situation that the prior acquisition track cannot be found back after single shooting is finished is avoided, the continuity between the acquisition track and the acquisition information is guaranteed, and the quality of image acquisition is further guaranteed.

Drawings

Fig. 1 is a flowchart illustrating steps of a prompting method in an image acquisition process according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 3 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 4 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 5 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 6 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 7 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 8 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

FIG. 9 is a schematic diagram of an image capture interface provided in an embodiment of the present invention;

fig. 10 is a block diagram of a prompting device in an image acquisition process according to an embodiment of the present invention;

fig. 11 is a block diagram of an electronic device provided in an embodiment of the invention;

fig. 12 is a schematic diagram of a computer-readable storage medium provided in an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

As an example, in a process of acquiring a panoramic image, particularly, in a process of automatically acquiring a VR (Virtual Reality) by using a panoramic camera or using a panoramic acquisition function of a device, a camera of the device may provide a corresponding real-time streaming image, And then the device may position pose information of a current picture point by using an SLAM (simultaneous localization And Mapping) according to the real-time streaming image, that is, shooting trajectory information in an image acquisition process, And the device may store all trajectory information to generate a corresponding acquisition trajectory. However, when the user interrupts shooting due to objective or subjective reasons, the user needs to exit the current acquisition process, and when the user enters the prior acquisition process for the second time, the device cannot guarantee the position where the user enters for the second time, and cannot guarantee the continuity of the acquisition track, so that the acquired information and the prior acquired information are easily split, and the quality of image acquisition is reduced.

In view of the above, one of the core invention points of the embodiment of the present invention is that the terminal may respond to an image acquisition operation input by a user, determine an acquisition task corresponding to the image acquisition operation, and identify the acquisition task, if the acquisition task belongs to a history acquisition task, it may be determined that the current acquisition belongs to a secondary acquisition of the history acquisition task, may display an acquisition point location identifier corresponding to the history acquisition task and a history acquisition track in a graphical user interface, and acquire a current initial position of the electronic terminal, and then determine whether the initial position is at a position corresponding to a previous acquisition track, if a matching failure between the initial position and the history acquisition track can represent that the position where the electronic terminal is located is not at a position where the history is acquired, the terminal may output a movement prompt information for the history acquisition track, and prompt the user to move the electronic terminal to a function space corresponding to the acquisition point location identifier through the movement prompt information, the position of the electronic terminal is successfully matched with the historical acquisition track, so that in the secondary image acquisition process of a user for the same acquisition task, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, the situation that the prior acquisition track cannot be found back after single shooting is finished is avoided, the consistency between the acquisition track and acquisition information is ensured, and the quality of image acquisition is further ensured.

Specifically, referring to fig. 1, a flowchart illustrating steps of a prompting method in an image acquisition process provided in an embodiment of the present invention is shown, which may specifically include the following steps:

step 101, responding to an image acquisition operation, and determining an acquisition task corresponding to the image acquisition operation;

in the embodiment of the present invention, the terminal may run corresponding applications, such as a life application, an audio application, a game application, and the like. The life-type application programs can be further divided according to different types, such as a rental and sale room application program, a home service application program, a leisure and entertainment application program and the like. In the embodiment of the present invention, a renting and selling house application is run on a mobile terminal as an example, and a user may upload corresponding house source information through the renting and selling house application, for example, upload after shooting a panoramic image of a house source, and the like.

Optionally, the panoramic image acquisition is to combine a plurality of images acquired for a target scene into one panoramic image, and the basic acquisition principle is to search edge parts of two images and overlap areas with the closest imaging effect to complete automatic image combination. For example, a certain position point in the target scene is taken as a center, horizontal 360 ° and/or vertical 180 ° acquisition is performed, and a plurality of acquired images of the target scene are combined into one panoramic image, so that panoramic acquisition of the target scene is realized.

As an example, the electronic terminal may be a camera or a mobile terminal having a photographing function, and a rental and sales room application may be included in the mobile terminal, through which panoramic image capturing, management, and the like may be performed. In addition, the mobile terminal and the camera can be connected to realize the collaborative shooting. For convenience of understanding and description, the embodiment of the present invention is described by taking an example that a mobile terminal runs a corresponding application program, and it should be understood that the present invention is not limited thereto.

In a specific implementation, in the process of running an application program, a terminal may display a corresponding acquisition task creation interface, where the acquisition task creation interface may include a plurality of object input controls, and a user may input, through the content input controls, content that needs to be acquired by this acquisition task, and then the terminal determines the corresponding acquisition task according to user operation. Wherein the content input controls may include task identification controls, object selection controls, acquisition height controls, acquisition device controls, and the like, the user can input the task identification of the collection task through the task identification control, select the object to be collected of the collection task through the object selection control, the height of the equipment in the acquisition process is set through the acquisition height control, the type of the equipment in the acquisition process is set through the acquisition equipment control, and the like, for example, the user can input the task identifier of the current collection task as "XX item" through the task identifier control, the object input control is used for selecting a bedroom, a living room, a kitchen and the like as the objects to be acquired by the acquisition task, and the acquisition height of the equipment in the acquisition process can be set to be 1.48 meters and the like through the acquisition height control, which is not limited in the invention.

102, if the collection task is a historical collection task, displaying a collection point position identifier and a historical collection track corresponding to the historical collection task in the graphical user interface;

in the embodiment of the invention, a user can newly establish a new acquisition task or select a previous acquisition task in the process of image acquisition, the terminal can acquire a task identifier corresponding to the acquisition task for judging the acquisition task, if the task identifier is not repeated, the terminal can be characterized as a new acquisition task, and the terminal can display a corresponding image acquisition interface according to the input operation of the user on a content control; if the task identifier belongs to the task identifier of the previous acquisition task, the acquisition task belongs to the secondary acquisition task, namely the acquisition task belongs to the historical acquisition task, the terminal can acquire historical acquisition data corresponding to the historical acquisition task, and display an acquisition point identifier and a historical acquisition track corresponding to the historical acquisition task in the graphical user interface according to the historical acquisition data.

Optionally, the historical acquisition data may include historical pose information located by SLAM in the previous acquisition process, and the terminal may generate a historical acquisition track according to the historical pose information and determine a corresponding acquisition point identifier. The acquisition point position can be a point position set by a user aiming at a certain object to be acquired in the acquisition process, after the corresponding acquisition point position is set, the user can move to a target position of an entity space of the object to be acquired, after the target finishes image acquisition, the terminal can generate an acquisition point position identification corresponding to the acquisition point position so as to represent that the image acquisition of the corresponding acquisition point position is finished, and a corresponding acquisition track is generated by connecting different acquisition point positions. For example, for a restaurant, before or during image acquisition, a user may set an acquisition point I located in the middle of the restaurant and acquisition points II, III, IV, V, etc. located at four corners of the restaurant, then, aiming at the first collection point position, a user can move the terminal to the middle of the restaurant and generate a collection point position identifier (I) corresponding to the first collection point position after completing image collection, then the terminal can be moved to four corners of the restaurant in sequence to finish corresponding image acquisition, and acquisition point position marks (two, three, four and five) corresponding to the acquisition point positions are generated, and displaying an acquisition track including an acquisition point position mark, a collection point position mark and a collection point position mark in real time in an image acquisition interface according to the generated acquisition point position mark. In addition, the restaurant may be equally divided into two regions, and the middle of each region may be used as a collection point, and then the image collection may be performed, which is not limited by the present invention.

Through the data processing in the image acquisition process, corresponding acquisition data can be generated after an acquisition task (including task completion or task interruption and the like) is stopped, when the terminal judges that the acquisition task belongs to a historical acquisition task, an acquisition canvas can be displayed in a graphical user interface according to the historical acquisition data corresponding to the historical acquisition task, an initial house source household graph, a historical acquisition track corresponding to the initial house source household graph and acquisition point position identifications corresponding to each acquisition point on the historical acquisition track are displayed on the acquisition canvas,

it should be noted that, in an image acquisition process, it is assumed that an object to be acquired set by a user is a restaurant, a bedroom, or the like, and an acquisition sequence is that a panoramic image is acquired for the restaurant first and then the panoramic image is acquired for the bedroom, so that when the user enters an image acquisition interface for the first time, the terminal can display a real-time flow image of an acquisition control window, an acquisition canvas, and a camera in the image acquisition interface, and the user can control related functions of the acquisition process through the acquisition control window. At this moment, because the collection starting point is not determined, a position indicator can be displayed in the collection canvas, and the position indicator has the functions of indicating direction and positioning, for example, the collection canvas determines the direction according to the upper north, the lower south, and then the terminal can position the current shooting orientation and control the indication direction of the position indicator on the collection canvas. After a user selects a collection position in the environment of the terminal, the terminal can touch an image collection control provided in the collection control window to collect panoramic images, responds to user operation, collects the panoramic images by taking the current position of the terminal as a collection starting point, generates the panoramic images of the restaurant at the collection starting point, and displays a collection point position identification corresponding to the collection starting point on a collection canvas, so that the panoramic image collection of one collection point position of the restaurant is completed.

Referring to fig. 2, which shows a schematic diagram of an image capturing interface provided in an embodiment of the present invention, the image capturing interface 20 is displayed through a graphical user interface of a terminal, and the image capturing interface 20 may include a capturing control window 210, a capturing canvas 220, and a real-time streaming image 230. The acquisition control window 210 may include interactive controls 2101 for executing different functions, such as an image acquisition control, a functional space control corresponding to an object to be acquired set by a user, an acquisition point position control corresponding to the functional space control, a delay acquisition control, a preview control, and the like; the collection canvas 220 may be used to display a house type diagram, a collection track, a collection point location identifier, and the like constructed in real time, so that a user can view a current collection state in real time through the content displayed in the collection canvas; the live streaming image 230 may be an image stream collected by a camera of the terminal in real time, and the live streaming image 230 may change in real time along with the movement of the terminal. In the process of image acquisition, a user may determine a position where image acquisition is performed in a space where the mobile terminal is located, and when image acquisition is not performed yet, the terminal may display only the position indication identifier 2201 in the acquisition canvas 220 to identify a current acquisition orientation, and along with movement of the terminal, the position indication identifier 2201 may move correspondingly, indicate a change in direction, and the like.

Referring to fig. 3, which shows a schematic diagram of an image acquisition interface provided in an embodiment of the present invention, after a user mobile terminal determines an acquisition position, the user mobile terminal may touch an image acquisition control, trigger the terminal to call a camera to acquire a panoramic image with a current position as an acquisition point, and may display an image acquisition interface 30 after the acquisition is completed. The control window 310, the collection canvas 320 and the real-time streaming image 330 may be collected in the image collection interface 30, at this time, since image collection has been performed once, multimedia information (such as a thumbnail of panoramic information) corresponding to the collection start point may be displayed in the collection point location control 3101 in the collection control window 310; the collection canvas 320 may display a collection point location identifier 3201 (e.g., "restaurant (r)), a location indicator identifier 3202, and a house type map 3203 (an area formed by a solid line in the figure) corresponding to the collection start point. In addition, the acquisition control window 310 may further include a point location increasing control 3102, and a user may increase the acquisition point location of the object to be acquired through the point location increasing control 3102, for example, increase the acquisition point location of a restaurant.

In one case, when the user adds a collection point location for the restaurant, the terminal may add a collection point location control for the restaurant in the collection control window, so that the user moves the terminal to a new location and collects panoramic images of the restaurant at the new collection point location, thereby improving the richness of the panoramic images of the restaurant. Specifically, since the collection starting point (i.e., "restaurant (r)) already exists at this time, when the user moves the terminal away from the position corresponding to the collection starting point, the terminal may display a corresponding movement trajectory in the collection canvas according to the motion of the terminal. Referring to fig. 4, a schematic diagram of an image capture interface provided in the embodiment of the present invention is shown, which can display a movement track 430 with a capture point location identifier 420 (i.e., "restaurant (r)) as a starting point in a capture canvas 410 in the image capture interface 40 along with the movement of a terminal. After the user determines the second capture point, the panoramic image may be captured through the image capture control 440, and the related process may refer to the foregoing description, which is not repeated herein.

In another case, the acquisition control window may include a functional space control corresponding to the object to be acquired, such as a functional space control corresponding to the restaurant, a functional space control corresponding to the main horizontal position, and the like, after the user finishes acquiring the panoramic image of the restaurant, the terminal may automatically jump to the acquisition node task corresponding to the main horizontal position, select the functional space control corresponding to the main horizontal position in the acquisition control window, and display the acquisition point position control corresponding to the functional space control, so that the user may acquire the image of the main horizontal position through the image acquisition control. In the process of image acquisition for the main bed, the terminal can display a corresponding moving track in the acquisition canvas according to the motion of the terminal, after the image acquisition of each acquisition point is finished in real time, the corresponding acquisition point identifier is displayed in the acquisition canvas, and the house type diagram is updated, so that on one hand, a user can intuitively and quickly know the position relation among different acquired spaces through the moving track updated in real time, and on the other hand, the space structure among the different acquired spaces is intuitively known through the house type diagram updated in real time, the acquisition point identifier and the like, and the quality of the image acquisition is effectively ensured.

According to the process, in the primary image acquisition process, the acquired data can comprise pose information, multimedia information, acquisition point position information and the like in the acquisition process, a corresponding acquisition track can be generated through the pose information, the acquisition point position identification is displayed on the acquisition track by combining the acquisition point position information, the multimedia information can be a panoramic image which is finished in advance, a user can select to keep the acquired image, and the acquisition can be carried out again to replace the existing panoramic image and the like.

103, acquiring an initial position of the electronic terminal, and if the initial position and the historical acquisition track are unsuccessfully matched, outputting movement prompt information aiming at the historical acquisition track, wherein the movement prompt information comprises information for prompting to move the electronic terminal to a target position corresponding to the acquisition point position identification so as to enable the position of the electronic terminal to be successfully matched with the historical acquisition track.

When the terminal judges the acquisition task as a historical acquisition task, the current initial position can be obtained firstly, the initial position is matched with the historical acquisition track, whether the initial position is located on the historical acquisition track or not is judged, if the initial position does not fall on the historical acquisition track, the terminal is represented to be required to be moved to the corresponding position to be positioned on the historical acquisition track, the terminal can output movement prompt information, so that the user is prompted to move the electronic terminal to a target position corresponding to the acquisition point position identification through the movement prompt information, and the target position is positioned on the previous acquisition track of the acquisition task, and a continuous shooting process of the acquisition task is completed.

Optionally, whether the position of the terminal is on the historical acquisition track or not can be judged by means of image comparison, specifically, a first real-time stream image corresponding to the initial position and historical multimedia information of the historical acquisition task can be obtained, the historical multimedia information at least comprises a historical house source image, and if the comparison between the first real-time stream image and the historical house source image fails, movement prompt information aiming at the historical acquisition track is output. The terminal can display text prompt information aiming at the historical acquisition track in a graphical user interface and output voice prompt information corresponding to the text prompt information.

Specifically, the first real-time stream image may be an image of an environment where the terminal is located, and the terminal may compare a previously acquired historical room source image with the first real-time stream image, and determine whether the environment where the terminal is located is the previously acquired environment according to similarity between the images, so as to determine whether the current position of the terminal is matched with the historical acquisition track. Referring to fig. 5, which shows a schematic diagram of an image acquisition interface provided in an embodiment of the present invention, after determining that an acquisition task is a history acquisition task, a terminal may display an initial house-based diagram 510, a history acquisition trajectory 520, and an acquisition point location identifier 530 (i, ii, iii, iv, etc.) located on the history acquisition trajectory 520 in the image acquisition interface 50, and when the terminal detects that matching between the initial position and the history acquisition trajectory 520 fails, on one hand, a corresponding text prompt message, such as "trajectory loss |, may be displayed in the image acquisition interface 50! The handheld support returns to move in the shot space, and the like, and on the other hand, corresponding voice prompt information can be played, such as 'please reposition to the original track', and the like, so that in the secondary image acquisition process of a user for the same acquisition task, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, the situation that the prior acquisition track cannot be found back after the single shooting is finished is avoided, the continuity between the acquisition track and the acquisition information is ensured, and the quality of image acquisition is further ensured.

When a user moves the terminal to position an original acquisition track, the terminal can respond to the operation of controlling the electronic terminal to move to acquire the current position of the electronic terminal, if the current position of the electronic terminal is successfully matched with the historical acquisition track, a position indication mark corresponding to the historical acquisition track is displayed in a graphical user interface, and movement prompt information is hidden.

In a specific implementation, as a user moves the terminal, the real-time stream image may change in real time, and the terminal may acquire a second real-time stream image corresponding to a current position, and if the second real-time stream image is successfully compared with the historical room source image, the terminal may display the acquisition control window and the second real-time image stream in the graphical user interface, and acquire a current acquisition point location identifier corresponding to the current position, and display a position indication identifier corresponding to the historical acquisition track at a position corresponding to the current acquisition point location identifier, and hide the movement prompt information. The acquisition point position mark can be used for representing how many times of image acquisition are carried out by the user in the current acquisition task, each acquisition can correspond to one acquisition point position, each acquisition point position can correspond to one acquisition point position mark, after the user control terminal moves to a position corresponding to the historical acquisition track, the terminal can determine which acquisition point of the historical acquisition track the current space is located at, and display a position indication mark at a corresponding position of the acquisition point position mark corresponding to the current acquisition point position in the graphical user interface so as to indicate which acquisition point the user is located at currently.

In an example, referring to fig. 6, a schematic diagram of an image acquisition interface provided in an embodiment of the present invention is shown, and assuming that a historical acquisition track includes acquisition point locations (r), g, and r), where the acquisition point location (r) is a point location where image acquisition is performed last in the acquisition task, a user may move a terminal to an environment corresponding to the acquisition point location (r) to locate an interruption point in the last acquisition process, and continue to perform image acquisition on the acquisition task. When the terminal detects that the current location has been located to the point of interruption of the last acquisition process, an acquisition control window 610, a second real-time image stream 620, an initial house layout 630, a historical acquisition trace 640, and an acquisition point location identifier 650 located on the historical acquisition trace 640 may be displayed in the image acquisition interface 60, while displaying a position indicator 660 on the last acquisition site indicator to indicate that the discontinuity in the previous acquisition process has been located, image acquisition can continue, therefore, in the secondary image acquisition process of a user for the same acquisition task, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, the situation that the prior acquisition track cannot be found back after single shooting is finished is avoided, the continuity between the acquisition track and acquisition information is ensured, and the quality of image acquisition is further ensured.

In addition, after the positioning of the acquisition track is completed, the user can acquire images through the interactive controls for executing different functions provided in the acquisition control window. Specifically, the acquisition control window at least comprises an image acquisition control and at least one functional space control corresponding to an acquisition point location identifier, the terminal can respond to an acquisition point location determination instruction, determine a target acquisition point location control corresponding to the acquisition point location determination instruction, generate a target acquisition point location corresponding to the target acquisition point location control, respond to an operation of controlling the electronic terminal to move, instruct the identifier to move according to a movement control position of the electronic terminal, display a movement track associated with a historical acquisition track, respond to a control operation aiming at the image acquisition control, perform image acquisition on an environment where the electronic terminal is located, mark an end point of the movement track as the target acquisition point location, and display the target acquisition point location identifier corresponding to the target acquisition point location at the end point.

For the determination of the collection point, the user may perform re-collection on the collection point where the image collection has been completed, or may add a new collection point, and perform image collection on the newly added collection point, and then the collection control window may include at least one collection point control corresponding to the functional space control and a point addition control. Each functional space control can be associated with a functional space object which is set by a user and needs image acquisition, for example, a restaurant corresponds to one functional space control, a master-slave corresponds to one functional space control, and the like, and the same functional space control can correspond to at least one acquisition point location control and one point location adding control, and different acquisition point location controls can be used for representing different acquisition positions aiming at the functional space object, such as a middle point location, four more corresponding point locations, and the like of the functional space object, so that under the condition that the user wants to acquire images of the acquisition points again, the terminal can respond to the control operation aiming at the acquisition point location controls, determine a first acquisition point location control corresponding to the control operation, and generate a first acquisition point location corresponding to the first acquisition point location control; under the condition that a user wants to add a new acquisition point location, the terminal can respond to the control operation aiming at the point location adding control, add a second acquisition point location control corresponding to the current functional space control, and generate a second acquisition point location corresponding to the second acquisition point location control.

After the acquisition point location is determined, the user can move the terminal to the corresponding target position to complete image acquisition of the corresponding acquisition point location, so that the terminal can display a corresponding movement track in an image acquisition interface according to the movement of the user in the process of moving the terminal, and the movement track can be drawn by taking the end point of the historical acquisition track as a starting point to join the existing historical acquisition track along with the movement of the terminal. After the user determines the position corresponding to the collection point, the terminal can touch the image collection control, respond to the control operation aiming at the image collection control, collect the image of the environment where the electronic terminal is located, and in the process of collecting the image, output the collection prompt information corresponding to the target collection point until the image collection is completed, generate the target multimedia information corresponding to the target collection point, and display the target multimedia information in the target collection point control, mark the end point of the movement track as the target collection point, display the target collection point position mark corresponding to the target collection point at the end point, meanwhile, the terminal can respond to the generated target multimedia information and update the initial house type graph into the target house type graph matched with the target multimedia information, thereby aiming at the secondary image collection of the same collection task, after the user completes the positioning of the collection track according to the movement prompt information, the method and the device have the advantages that the acquisition task can be continuously shot, the house type graph and the acquisition track displayed in the interface can be updated in real time by the terminal in the continuous shooting process, so that a user can visually and quickly know the position relation among different acquired spaces, and the image acquisition quality is guaranteed.

In an example, referring to fig. 7, a schematic diagram of an image capturing interface provided in the embodiment of the present invention is shown, the image capturing interface 70 is displayed through a graphical user interface of a terminal, and the image capturing interface 70 may include a capturing control window 710, a second real-time image stream 720, an initial house-source user-type diagram 730, a historical capturing track 740, a capturing point location identifier 750 located on the historical capturing track 740, and the like. The acquisition control window 710 may include functional space controls 7101 (e.g., "restaurant (2/2)", "main bed (2/2)"), acquisition point location controls 7102 (e.g., optimal point location, other point locations 1, etc.), and point location addition controls 7103, so that a user may touch the point location addition controls 7103 to add a new acquisition point location, or may select an existing acquisition point location control 7102 to perform image acquisition again to replace a previously acquired image.

Referring to fig. 8, which shows a schematic diagram of an image acquisition interface provided in an embodiment of the present invention, when a user touches a point location adding control 8103 to add a new acquisition point location, an acquisition control window 810 may convert the point location adding control into an acquisition point location control and select the acquisition point location control, and then the user may move the terminal by holding the terminal in hand, and along with the movement of the terminal, the terminal may display a movement trajectory (e.g., a trajectory from an acquisition point location identifier to a position indication identifier 820 in the drawing) with an end point of a historical acquisition trajectory as a starting point in the image acquisition interface 80. After the user determines the acquisition position, the image acquisition control 8101 can be touched, and the terminal is triggered to call the camera to acquire the panoramic image. In the collection process, the terminal can output corresponding prompt information to prompt a user not to move the terminal, so that the collection position of the terminal camera is fixed, the collection quality is guaranteed, and the corresponding prompt information is hidden until the collection is completed.

Referring to fig. 9, which shows a schematic diagram of an image acquisition interface provided in the embodiment of the present invention, after a terminal completes image acquisition, a corresponding acquisition positioning identifier 910 may be generated in the image acquisition interface 90 to identify that image acquisition of a corresponding acquisition point is completed, and a corresponding thumbnail is displayed on a corresponding acquisition point control 920 in an acquisition control window at the same time. In addition, a point location adding control 930 can be displayed in the acquisition control window, so that a user can continue to add the acquisition point location through the point location adding control 930, and the richness of the image information is improved by adding the acquisition point location for the object to be acquired.

It should be noted that, the embodiment of the present invention includes but is not limited to the above examples, and it is understood that, under the guidance of the idea of the embodiment of the present invention, a person skilled in the art may also set the method according to practical requirements, and the present invention is not limited to this.

In the embodiment of the invention, the terminal can respond to the image acquisition operation to determine the acquisition task corresponding to the image acquisition operation, when the acquisition task is detected to belong to the historical acquisition task and the acquisition can be judged to belong to continuous shooting, the acquisition point position identification and the historical acquisition track corresponding to the historical acquisition task can be displayed in the graphical user interface, the initial position of the electronic terminal is obtained, if the matching between the initial position and the historical acquisition track fails and the position of the electronic terminal is represented to be not in the position which is acquired by the history, the terminal can output the movement prompt information aiming at the historical acquisition track, and the user is prompted by the movement prompt information to move the electronic terminal to the functional space corresponding to the acquisition point position identification, so that the position of the electronic terminal is successfully matched with the historical acquisition track, and therefore, in the secondary image acquisition process aiming at the same acquisition task by the user, the terminal can guide the user to reposition the continuous shooting process in a position comparison mode, so that the situation that the prior acquisition track cannot be found back after single shooting is finished is avoided, the continuity between the acquisition track and the acquisition information is ensured, and the quality of image acquisition is further ensured.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 10, a block diagram of a prompting device in an image acquisition process provided in an embodiment of the present invention is shown, and a graphical user interface is provided through an electronic terminal, which may specifically include the following modules:

an acquisition task determination module 1001 configured to determine, in response to an image acquisition operation, an acquisition task corresponding to the image acquisition operation;

a first content display module 1002, configured to display, if the acquisition task is a historical acquisition task, an acquisition point identifier and a historical acquisition track that correspond to the historical acquisition task in the graphical user interface;

a prompt information output module 1003, configured to obtain an initial position of the electronic terminal, and if matching between the initial position and the historical acquisition trajectory fails, output a movement prompt information for the historical acquisition trajectory, where the movement prompt information is used to prompt that the electronic terminal is moved to a target position corresponding to the acquisition point location identifier, so that matching between the position of the electronic terminal and the historical acquisition trajectory is successful.

In an alternative embodiment, further comprising:

In an alternative embodiment, the second content display module comprises:

In an optional embodiment, the acquisition control window comprises at least an image acquisition control and at least one functional space control corresponding to the acquisition site identification, the apparatus further comprises:

In an optional embodiment, the acquisition site identifier display module includes:

In an optional embodiment, the collection control window further includes at least one collection point location control and a point location adding control corresponding to the functional space control, and the collection point location determining module includes:

In an optional embodiment, the first content display module 1002 is specifically configured to:

wherein the apparatus further comprises:

In an optional embodiment, the prompt information output module 1003 includes:

In an optional embodiment, the image stream display sub-module is specifically configured to:

In an optional embodiment, the prompt information output module 1003 is specifically configured to:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

In addition, an electronic device is further provided in an embodiment of the present invention, as shown in fig. 11, and includes a processor 1101, a communication interface 1102, a memory 1103 and a communication bus 1104, where the processor 1101, the communication interface 1102 and the memory 1103 complete communication with each other through the communication bus 1104,

a memory 1103 for storing a computer program;

the processor 1101 is configured to implement the following steps when executing the program stored in the memory 1103:

In an alternative embodiment, further comprising:

In an optional embodiment, if the current location of the electronic terminal is successfully matched with the historical acquisition trajectory, displaying a location indicator corresponding to the historical acquisition trajectory in the graphical user interface, including:

and hiding the movement prompt information.

In an optional embodiment, the acquisition control window comprises at least an image acquisition control and at least one functional space control corresponding to the acquisition site identification, the method further comprising:

In an optional embodiment, the performing, in response to the control operation for the image acquisition control, image acquisition on an environment where the electronic terminal is located, marking an end point of the movement trajectory as a target acquisition point, and displaying, at the end point, a target acquisition point identifier corresponding to the target acquisition point includes:

In an optional embodiment, the acquiring control window further includes at least one acquiring point location control corresponding to the functional space control and a point location adding control, and the determining, in response to an acquiring point location determining instruction, a target acquiring point location control corresponding to the acquiring point location determining instruction and generating a target acquiring point location corresponding to the target acquiring point location control includes:

In an optional embodiment, the displaying, in the graphical user interface, an acquisition site identifier corresponding to the historical acquisition task and a historical acquisition trajectory includes:

wherein the method further comprises:

In an optional embodiment, if the initial position fails to be matched with the historical acquisition trajectory, outputting a movement prompt message for the historical acquisition trajectory includes:

acquiring a first real-time streaming image corresponding to the initial position and historical multimedia information of the historical acquisition task, wherein the historical multimedia information at least comprises a historical house source image;

In an optional embodiment, if the matching between the current position of the electronic terminal and the historical acquisition trajectory is successful, displaying an acquisition control window and a real-time image stream in the graphical user interface includes:

In an optional embodiment, the outputting the movement prompt information for the historical acquisition trajectory includes:

The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the terminal and other devices.

The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

In another embodiment of the present invention, as shown in fig. 12, a computer-readable storage medium 1201 is further provided, in which instructions are stored, and when the instructions are run on a computer, the computer is enabled to execute the prompting method in the image capturing process described in the above embodiment.

In a further embodiment of the present invention, there is also provided a computer program product containing instructions, which when run on a computer, causes the computer to execute the prompting method in the image acquisition process described in the above embodiments.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A prompting method in an image acquisition process is characterized in that a graphical user interface is provided through an electronic terminal, and the method comprises the following steps:

2. The method of claim 1, further comprising:

3. The method according to claim 2, wherein if the matching between the current position of the electronic terminal and the historical acquisition trajectory is successful, displaying a position indication identifier corresponding to the historical acquisition trajectory in the graphical user interface includes:

and hiding the movement prompt information.

4. The method of claim 3, wherein the acquisition control window comprises at least an image acquisition control and at least one functional space control corresponding to the acquisition site identification, the method further comprising:

5. The method according to claim 4, wherein the performing image acquisition on the environment in which the electronic terminal is located in response to the control operation for the image acquisition control, marking an end point of the movement trajectory as a target acquisition point location, and displaying a target acquisition point location identifier corresponding to the target acquisition point location at the end point comprises:

6. The method of claim 4, wherein the collection control window further comprises at least one collection point location control corresponding to the functional space control and a point location addition control, and wherein the determining a target collection point location control corresponding to the collection point location determination instruction in response to a collection point location determination instruction and generating a target collection point corresponding to the target collection point location control comprises:

7. The method of claim 5, wherein said displaying in said graphical user interface an acquisition site identification corresponding to said historical acquisition task and a historical acquisition trajectory comprises:

wherein the method further comprises:

8. The method of claim 1, wherein if the initial position and the historical acquisition trajectory fail to be matched, outputting a movement prompt message for the historical acquisition trajectory, comprising:

9. The method according to claim 3, wherein if the matching between the current position of the electronic terminal and the historical acquisition trajectory is successful, displaying an acquisition control window and a real-time image stream in the graphical user interface comprises:

10. The method of claim 1, wherein outputting movement hint information for the historical acquisition trajectory comprises:

11. A prompting device in an image acquisition process is characterized in that a graphical user interface is provided through an electronic terminal, and the device comprises:

12. An electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

the memory is used for storing a computer program;

the processor, when executing a program stored on the memory, implementing the method of any of claims 1-10.

13. A computer-readable storage medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-10.