CN110189398A - House type drawing generating method, device, equipment and storage medium based on off-the-air picture - Google Patents

House type drawing generating method, device, equipment and storage medium based on off-the-air picture Download PDF

Info

Publication number
CN110189398A
CN110189398A CN201910297090.8A CN201910297090A CN110189398A CN 110189398 A CN110189398 A CN 110189398A CN 201910297090 A CN201910297090 A CN 201910297090A CN 110189398 A CN110189398 A CN 110189398A
Authority
CN
China
Prior art keywords
house type
floor plan
initial pictures
air picture
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910297090.8A
Other languages
Chinese (zh)
Inventor
李山亭
徐伟
韦柏松
张珣
陈世喆
曾文韬
刘朦月
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Urban Construction Technology Shenzhen Co Ltd
Original Assignee
Ping An Urban Construction Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Urban Construction Technology Shenzhen Co Ltd filed Critical Ping An Urban Construction Technology Shenzhen Co Ltd
Priority to CN201910297090.8A priority Critical patent/CN110189398A/en
Publication of CN110189398A publication Critical patent/CN110189398A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/16Real estate
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes

Abstract

The invention discloses a kind of house type drawing generating method based on off-the-air picture, comprising the following steps: receive floor plan and generate request, obtain the floor plan and generate and request corresponding initial pictures;The initial pictures are identified by pre-set image identification model, and judge whether the initial pictures are off-the-air picture;When the initial pictures are off-the-air picture, the off-the-air picture is detected by the pre-set image identification model, obtains the house type formation component in the off-the-air picture;According to the position dimension information of the house type formation component and the house type formation component, three-dimensional floor plan is generated.The invention also discloses a kind of floor plan generating means, equipment and storage medium based on off-the-air picture.Terminal carries out image detection identification to initial pictures in the present invention, and when initial pictures are off-the-air picture, off-the-air picture is converted standard floor plan by terminal, realizes automatically generating for standard three-dimensional floor plan.

Description

House type drawing generating method, device, equipment and storage medium based on off-the-air picture
Technical field
The present invention relates to field of image processings, more particularly to the house type drawing generating method based on off-the-air picture, device, equipment And storage medium.
Background technique
In house decoration or second-hand house process of exchange, house usually lacks floor plan, even if there is floor plan, also leads to It is often opened quotient to protect as confidential data, client can not easily obtain floor plan.
Thus, a part of homeowners obtain floor plan by approximate draw of measurement, and clap floor plan is drawn It is that can simply and easily obtain image according to the advantages of, edition floor plan mode of taking pictures, still, the image for acquisition of taking pictures is by pickup light The factors such as line, distance, angle influence, and uneven illumination, image light and shade unevenness, image angle occurs in an edition floor plan image family of taking pictures Degree inclination, scalloping, fogging image etc. cause floor plan inaccurate;The information that party in request obtains from edition floor plan of taking pictures It is inaccurate.Another part homeowners do not provide floor plan simply, only shoots indoor scene, demand is it is to be understood that room Room house type oneself can only be investigated according to indoor photo or entity and piece together floor plan, this is very inconvenient for party in request.
Summary of the invention
The house type drawing generating method that the main purpose of the present invention is to provide a kind of based on off-the-air picture, device, equipment and Storage medium, it is intended to realize automatically generating for standard three-dimensional floor plan.
To achieve the above object, the present invention provides the house type drawing generating method based on off-the-air picture, described based on indoor figure The house type drawing generating method of picture the following steps are included:
It receives floor plan and generates request, obtain the floor plan and generate the corresponding initial pictures of request;
The initial pictures are identified by pre-set image identification model, and judge whether the initial pictures are indoor figure Picture;
When the initial pictures are off-the-air picture, the off-the-air picture is detected by the pre-set image identification model, Obtain the house type formation component in the off-the-air picture;
According to the position dimension information of the house type formation component and the house type formation component, three-dimensional floor plan is generated.
Optionally, described that the initial pictures are identified by pre-set image identification model, and judge that the initial pictures are It is no be off-the-air picture the step of before, comprising:
Different types of off-the-air picture is acquired respectively as sample image, summarizes the sample image to obtain sample image Set;
The sample image of preset ratio is extracted from the sample image set, and passes through the sample graph of preset ratio As building initial pictures identification model;
By iterative algorithm training initial pictures identification model, optimal model parameters are obtained, and training is obtained into optimal mould The corresponding image recognition model of shape parameter is as pre-set image identification model.
Optionally, described that the initial pictures are identified by pre-set image identification model, and judge that the initial pictures are It is no be off-the-air picture the step of, comprising:
Pretreatment is carried out to the initial pictures and removes the redundancy of the initial pictures, and will be passed through pretreated The initial pictures are input to pre-set image identification model;
The pictorial element in the initial pictures is extracted by the pre-set image identification model, and by described image element It is compared with the description components in description components set;
Acquisition and the matched subject image element of the description components include house type in the subject image element simultaneously When component and non-house type component, determine the initial pictures for off-the-air picture.
Optionally, the house type formation component includes house type component and non-house type component;
The position dimension information according to the house type formation component and the house type formation component generates three-dimensional family The step of type figure includes:
The position dimension information for obtaining the house type component and the house type component, by the house type component by corresponding Position dimension information is spliced, and basic floor plan is generated;
When the basis floor plan is imperfect, output is unsatisfactory for the prompt information of formation condition, to prompt user to input New initial pictures;
When the basis floor plan is complete, the position dimension of the non-house type component and the non-house type component is obtained The non-house type component is added to the basic house type image by corresponding position dimension information, obtains three-dimensional house type by information Figure.
Optionally, the position dimension information according to the house type formation component and the house type formation component generates The step of three-dimensional floor plan, comprising:
The house type formation component is compared with the component mark in description components home banking, is obtained and the house type The matched target element mark of formation component;
The position dimension information for obtaining the house type formation component is adjusted by the size in the position dimension information The target element mark;
The target element that adjustment is completed is identified and is combined to default house type by the positional relationship in the position dimension information In template, three-dimensional floor plan is generated.
Optionally, described that the initial pictures are identified by pre-set image identification model, and judge that the initial pictures are It is no be off-the-air picture the step of after, comprising:
When the initial pictures are to take pictures house type image, the house type image of taking pictures is pre-processed, is obtained described The edge line of house type of taking pictures image;
Identify the position dimension information of the corresponding house type formation component of the edge line and the house type formation component, and The house type formation component is generated into two-dimentional house type image by corresponding position dimension information.
Optionally, the position dimension information according to the house type formation component and the house type formation component generates After the step of three-dimensional floor plan, comprising:
Floor plan display request is received, it is aobvious to obtain three-dimensional floor plan and target to be shown in the floor plan display request Show dimension;
When the target shows that dimension is two dimension, the elevation information in the three-dimensional floor plan is removed, obtains described three The corresponding two-dimentional floor plan of dimension floor plan simultaneously exports.
In addition, to achieve the above object, the floor plan generating means based on off-the-air picture that the present invention also provides a kind of are described Floor plan generating means based on off-the-air picture include:
Request receiving module generates request for receiving floor plan, and it is corresponding initial to obtain the floor plan generation request Image;
Image category identification module, for identifying the initial pictures by pre-set image identification model, and described in judgement Whether initial pictures are off-the-air picture;
Picture recognition module, for passing through the pre-set image identification model when the initial pictures are off-the-air picture The off-the-air picture is detected, the house type formation component in the off-the-air picture is obtained;
Floor plan generation module, for the position dimension according to the house type formation component and the house type formation component Information generates three-dimensional floor plan.
In addition, to achieve the above object, the floor plan generating device based on off-the-air picture that the present invention also provides a kind of;
The floor plan generating device based on off-the-air picture includes: memory, processor and is stored in the memory Computer program that is upper and can running on the processor, in which:
Realize that the floor plan based on off-the-air picture is raw as described above when the computer program is executed by the processor The step of at method.
In addition, to achieve the above object, the present invention also provides computer storage mediums;
Computer program, the realization when computer program is executed by processor are stored in the computer storage medium Such as the step of the above-mentioned house type drawing generating method based on off-the-air picture.
A kind of house type drawing generating method based on off-the-air picture, device, equipment and the storage that the embodiment of the present invention proposes are situated between Matter receives floor plan by terminal and generates request, obtains the floor plan and generates the corresponding initial pictures of request;Pass through default figure As the identification model identification initial pictures, and judge whether the initial pictures are off-the-air picture;It is in the initial pictures When off-the-air picture, the off-the-air picture is detected by the pre-set image identification model, obtains the house type in the off-the-air picture Formation component;According to the position dimension information of the house type formation component and the house type formation component, three-dimensional house type is generated Figure.Terminal carries out image detection identification to initial pictures in the present invention, and when initial pictures are off-the-air picture, terminal is by indoor figure As being converted into standard floor plan, realizes automatically generating for three-dimensional floor plan, simultaneously effective ensure that the accurate of three-dimensional floor plan Property.
Detailed description of the invention
Fig. 1 is the apparatus structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to;
Fig. 2 is that the present invention is based on the flow diagrams of the house type drawing generating method first embodiment of off-the-air picture;
Fig. 3 is that the present invention is based on the citings for house type image of taking pictures in the house type drawing generating method fourth embodiment of off-the-air picture Schematic diagram;
Fig. 4 is that the present invention is based on the functional block diagrams of one embodiment of floor plan generating means of off-the-air picture.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
As shown in Figure 1, the terminal that Fig. 1 is the hardware running environment that the embodiment of the present invention is related to (is called based on interior The floor plan generating device of image, wherein the floor plan generating device based on off-the-air picture can be by individually based on interior The floor plan generating means of image are constituted, and are also possible to be combined by other devices with the floor plan generating means based on off-the-air picture Formed) structural schematic diagram.
The terminal of that embodiment of the invention can be also possible to mobile terminal with fixed terminal, e.g., the Intelligent air with network savvy Tune, intelligent electric lamp, intelligent power, intelligent sound box, autonomous driving vehicle, PC (personal computer) personal computer, intelligence Energy mobile phone, tablet computer, E-book reader, portable computer etc..
As shown in Figure 1, the terminal may include: processor 1001, for example, central processing unit Central Processing Unit, CPU), network interface 1004, user interface 1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 For realizing the connection communication between these components.User interface 1003 may include display screen (Display), input unit ratio Such as keyboard (Keyboard), optional user interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004 may include optionally that (such as Wireless Fidelity WIreless-FIdelity, WIFI connect standard wireline interface and wireless interface Mouthful).Memory 1005 can be high speed RAM memory, be also possible to stable memory (non-volatile memory), For example, magnetic disk storage.Memory 1005 optionally can also be the storage device independently of aforementioned processor 1001.
Optionally, terminal can also include camera, RF (Radio Frequency, radio frequency) circuit, sensor, audio Circuit, WiFi module;Input unit, than display screen, touch screen;Network interface can in blanking wireless interface in addition to WiFi, bluetooth, Probe etc..Wherein, sensor such as optical sensor, motion sensor and other sensors.Specifically, optical sensor can wrap Include ambient light sensor and proximity sensor;Certainly, mobile terminal can also configure gyroscope, barometer, hygrometer, thermometer, The other sensors such as infrared sensor, details are not described herein.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal of terminal structure shown in Fig. 1, can wrap It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
As shown in Figure 1, the computer software product, which is stored in a storage medium, (storage medium: is called computer storage Medium, computer media, readable medium, readable storage medium storing program for executing, computer readable storage medium are directly medium etc., storage Medium can be non-volatile readable storage medium, such as RAM, magnetic disk, CD) in, including some instructions use is so that an end End equipment (can be mobile phone, computer, server, air conditioner or the network equipment etc.) executes each embodiment institute of the present invention The method stated, as may include operating system, network communication module, use in a kind of memory 1005 of computer storage medium Family interface module and computer program.
In terminal shown in Fig. 1, network interface 1004 is mainly used for connecting background server, carries out with background server Data communication;User interface 1003 is mainly used for connecting client (user terminal), carries out data communication with client;And processor 1001 can be used for calling the computer program stored in memory 1005, and execute that following embodiment of the present invention provides based on Step in the house type drawing generating method of off-the-air picture.
The present embodiment proposes a kind of house type drawing generating method based on off-the-air picture, applied to terminal as shown in Figure 1.
It is described to be based on room the present invention is based in the first embodiment of the house type drawing generating method of off-the-air picture referring to Fig. 2 The house type drawing generating method of interior image includes:
Step S10 receives floor plan and generates request, obtains the floor plan and generates the corresponding initial pictures of request.
Terminal receives floor plan and generates request, wherein the floor plan that terminal receives generates the request side of can be different Formula triggering, house type image and the off-the-air picture based on upload or family of taking pictures for example, user's upload off-the-air picture is perhaps taken pictures Type image triggers floor plan and generates request;For another example, user opens the camera of terminal, is shot by the camera of terminal indoor Video, at the same time user speech input " being converted into house type image " triggering floor plan generate request;Family is received in terminal After type figure generates request, terminal obtains floor plan and generates the corresponding initial pictures of request.It should be noted that in the present embodiment Initial pictures quantity can be the concrete condition prompt user that perhaps multiple or terminal are generated according to floor plan and upload The initial pictures of corresponding quantity.
Step S20 identifies the initial pictures by pre-set image identification model, and judge the initial pictures whether be Off-the-air picture.
After terminal gets initial pictures, terminal needs to identify initial pictures, determines the class of initial pictures Type, thus according to type (image type is respectively as follows: off-the-air picture and shooting house type image) corresponding figure of selection of initial pictures As processing strategie, to generate corresponding floor plan, specifically, the step of terminal determines initial pictures type, comprising:
Step a carries out the redundancy that pretreatment removes the initial pictures to the initial pictures, and will be by pre- place The initial pictures after reason are input to pre-set image identification model;
Step b extracts the pictorial element in the initial pictures by the pre-set image identification model, and by the figure Pixel element is compared with the description components in description components set;
Step c, acquisition and the matched subject image element of the description components, are wrapped simultaneously in the subject image element When component containing house type and non-house type component, determine the initial pictures for off-the-air picture.
That is, terminal carries out the redundancy of pretreatment removal initial pictures to initial pictures, wherein preprocessing process can be with Have digitlization, geometric transformation, normalization, it is smooth, restore and enhancing, to carry out its pretreated mesh to initial pictures be to disappear Except information unrelated in initial pictures, restore useful real information, enhances detectability for information about and to the maximum extent Simplify data, to improve the reliability of feature extraction, image segmentation, matching and identification;Initial pictures are located in advance in the present embodiment The step of reason, they may be specifically set according to specific situations, for example, being set as carrying out feature extraction, segmentation and matching to initial pictures Preceding carried out processing.
After initial pictures pretreatment, terminal will be input to pre-set image identification mould by pretreated initial pictures Type;Wherein, pre-set image identification model refers to the pre-set algorithm for image recognition, and terminal is identified by pre-set image Pictorial element in model extraction initial pictures, wherein pictorial element include house type component (house type component include wall, window, Door etc. corresponding element), non-house type component (non-house type component includes: the furniture such as bed, desk, TV) and other decorative elements (other decorative elements include the element except house type component and non-house type component, for example, plant, curtain, scenery and people etc.).
Then, pictorial element is compared terminal with the description components in description components set, wherein description components collection Conjunction refers to that the pre-set set for preserving house type component and non-house type component, terminal obtain and the matched target of description components Pictorial element, for example, terminal recognition has subject image element into initial pictures: wall;Target image is obtained in terminal recognition After element, terminal need to judge in subject image element whether and meanwhile comprising house type component and non-house type component.
That is, terminal determines initial pictures when in subject image element simultaneously not including house type component and non-house type component It is not off-the-air picture.For example, initial pictures are to hang over the photo drawn a portrait on wall, terminal, which can recognize, mesh in initial pictures Logo image element: wall (house type component), but in initial pictures do not include non-house type component, terminal determines that initial pictures are not Off-the-air picture, that is to say, that terminal cannot generate corresponding floor plan based on the initial pictures, and terminal exports prompt information.
Conversely, terminal determines initial pictures when simultaneously including house type component and non-house type component in subject image element For off-the-air picture;For example, initial pictures are the layout that extension is parlor, terminal, which can recognize, target image in initial pictures Element: wall (house type component) and TV (non-house type component) etc., terminal determine that initial pictures are off-the-air pictures.Terminal can be with Identification, which is carried out, based on the off-the-air picture generates corresponding floor plan, specifically:
Step S30 detects the room by the pre-set image identification model when the initial pictures are off-the-air picture Interior image obtains the house type formation component in the off-the-air picture.
When determining initial pictures is off-the-air picture, terminal detects off-the-air picture, terminal by pre-set image identification model The house type formation component in image is obtained by pre-set image identification model, wherein house type formation component includes house type component (family Type component includes wall, window, door etc. corresponding element) and non-house type component (non-house type component includes: bed, desk, TV etc. Furniture);That is, terminal is deleted unrelated pictorial element is generated in off-the-air picture with house type, retains house type image and generate phase The house type formation component of pass.
Then, after the house type formation component of identification obtained in off-the-air picture, terminal identifies mould by pre-set image Type identifies the corresponding type information of house type formation component, location information and dimension information;For example, terminal recognition is to house type generation group The edge line of door and wall intersection in part, terminal determine that specifically which is partially door, which is partially wall, and size is how many, door With the positional relationship of wall and other house type formation components so that terminal generates floor plan according to the conclusion of identification, specifically:
Step S40 generates three according to the position dimension information of the house type formation component and the house type formation component Tie up floor plan.
Terminal obtains the position dimension information of house type formation component and house type formation component that identification obtains, wherein this reality Apply position dimension information in example be one general designation, that is, in position dimension information include house type formation component size, one The positional relationship of house type formation component and other house type formation components, then, terminal is by all house type module informations detected It is integrated to a Zhang San to tie up in floor plan, that is, the classification and house type formation component of terminal recognition house type formation component are in initial pictures In relative dimensional coordinate, then, terminal is by environment measuring and Surface testing as a result, fitting the depth of picture different location Information is spent, and then the component of room picture is generated into three-dimensional coordinate.After obtaining result for every picture, terminal obtains depth inspection The y-axis information of model and the x-axis information of Surface testing model are surveyed, three-dimensional floor plan has been ultimately generated.
Terminal is off-the-air picture in initial pictures by carrying out image detection identification to initial pictures in the present embodiment When, off-the-air picture is converted standard floor plan by terminal, realizes automatically generating for three-dimensional floor plan, simultaneously effective ensure that three Tie up the accuracy of floor plan.
Further, on the basis of first embodiment of the invention, the floor plan the present invention is based on off-the-air picture is proposed The second embodiment of generation method.
The present embodiment be first embodiment step S20 before the step of, in the present invention pass through pre-set image identification model Before identifying initial pictures, terminal needs first to construct pre-set image recognition mode, specifically illustrates pre-set image in the present embodiment The construction method of identification model, specifically, the construction step of pre-set image identification model, comprising:
Step S01 acquires different types of off-the-air picture as sample image respectively, the sample image is summarized to obtain Sample image set.
Terminal acquires different types of off-the-air picture as sample image respectively, that is, terminal acquires magnanimity from network Off-the-air picture, using the off-the-air picture of acquisition as sample image, terminal summarizes each sample image to obtain sample image terminal Set.
Step S02 extracts the sample image of preset ratio from the sample image set, and is constructed by sample image Initial pictures identification model.
Terminal extracts preset ratio from sample image set, and (wherein, preset ratio refers to that pre-set house type generates Component extracts ratio, and preset ratio can be arranged according to concrete scene, for example, preset ratio is set as sample graph 0.1%) Picture, terminal construct initial pictures identification model using the sample image of preset ratio, wherein the sheet of the initial pictures identification model Matter is more than one points of classifier, that is, user marks window, wall, the house types such as door component or standard first in sample image TV, the non-house type component such as bed, then, terminal are fitted a function according to the markup information of user, and terminal is according to the function pair Window, wall in image, mono- identification classification of Men Jinhang.
Step S03 obtains optimal model parameters by iterative algorithm training initial pictures identification model, and will be trained To the corresponding image recognition model of optimal model parameters as pre-set image identification model.
Terminal passes through iterative algorithm training initial pictures identification model, that is, the initial pictures identification model of terminal building can Can there is a situation where to identify mistake etc., in order to improve the accuracy of image recognition model identification, terminal utilizes the sample graph image set Image pattern in conjunction is trained initial pictures identification model.Wherein, for being one to the training of initial pictures identification model The process of a machine learning, the process of the machine learning can be a variety of by neural network, genetic algorithm, support vector machines etc. Mode realizes that terminal obtains optimal model parameters by the way that machine learning image recognition model is corresponding, and terminal simultaneously obtains training The corresponding image recognition model of optimal model parameters is as pre-set image identification model.
Wherein, two ways, mode one can be used to the training of initial pictures identification model in the present embodiment, setting is known Other parameter stops handling, mode two for example, recognition accuracy is 98%, and frequency of training is arranged in terminal: being 1000 times, so Afterwards, the image pattern that terminal extracts 0.1% from sample image set every time is trained initial pictures identification model, adjusts The parameter of image recognition model, iteration 1000 times, terminal is using the corresponding parameter of image recognition model after 1000 times as most Excellent model parameter, and training is obtained the corresponding image recognition model of optimal model parameters as pre-set image and identifies mould by terminal Type.Corresponding image recognition model is arranged according to specific identification demand in the present embodiment, it is ensured that image recognition it is accurate Property, improve image processing efficiency.
Further, on the basis of the above embodiments, the floor plan generation side the present invention is based on off-the-air picture is proposed The 3rd embodiment of method.
The present embodiment is the refinement of step S40 in first embodiment, and the family based on off-the-air picture is given in the present embodiment Type figure generates different implementations, comprising:
Implementation one, the house type component and non-house type component for including in terminal analysis house type formation component, then according to House type component and non-house type component substep generate, specifically:
Step S41 obtains the position dimension information of the house type component and the house type component, by the house type component Spliced by corresponding position dimension information, generates basic floor plan.
Terminal obtains the position dimension information of the house type component and house type component that include in house type formation component, for example, eventually End obtains wall and door in image, and then, terminal obtains the size and relative positional relationship of wall and door, then, terminal House type component is spliced by corresponding position dimension information, generates basic floor plan, wherein basic floor plan refers to house type The corresponding a few several Rooms in room of figure.
Basic floor plan generate complete after, terminal judge generation basic floor plan it is whether reasonable, that is, terminal according to Whether floor plan is continuous, to determine subsequent processing steps, specifically:
Step S42, when the basis floor plan is imperfect, output is unsatisfactory for the prompt information of formation condition, with prompt User inputs new initial pictures.
When terminal determines that basic floor plan is imperfect, that is, the house type component that the basis floor plan also lacks, terminal according to The house type component got cannot generate complete floor plan, at this point, terminal output is unsatisfactory for the prompt information of formation condition, To prompt user to input new initial pictures.
Step S43 obtains the non-house type component and the non-house type component when the basic floor plan is complete The non-house type component is added to the basic house type image by corresponding position dimension information, obtained by position dimension information Three-dimensional floor plan.
When terminal determines that basic floor plan is complete, terminal obtains the position dimension of non-house type component and non-house type component Non- house type component is added to basic house type image by corresponding position dimension information, obtains three-dimensional floor plan by information, terminal.? The house type formation component substep that terminal is obtained according to identification in the present embodiment generates floor plan, ensure that the integrality of house type image And accuracy.
Implementation two, terminal generate house type image according to images match, specifically:
Step S44, by the house type formation component in description components home banking component mark be compared, obtain with The matched target element mark of house type formation component.
House type formation component is compared terminal with the component mark in description components home banking, wherein description components Home banking is that pre-set floor plan generates relevant component label set, for example, description components home banking be in preserve Desk is identified as four feet of a brown cuboid band, and washing machine is identified as silver color cuboid, and terminal obtains description components It is identified in home banking with the matched target element of house type formation component.
Step S45 obtains the position dimension information of the house type formation component, by the size in the position dimension information Size adjusts the target element mark.
Terminal obtains the position dimension information of house type formation component, the size adjustment in terminal opsition dependent dimension information The size of corresponding target element mark, for example, the size of desk is 1 meter of length in house type formation component, it is 0.8 meter wide, it is 0.9 meter high, The size that terminal is identified according to the corresponding component of size adjusting desk of desk.
The target element that adjustment is completed is identified and is combined to by the positional relationship in the position dimension information by step S46 In default house type template, three-dimensional floor plan is generated.
The target element that adjustment is completed is identified into the positional relationship in opsition dependent dimension information and is combined to default house type template In, wherein default house type template is pre-set house type Prototype drawing, and terminal can add component mark in default house type template Know, for example, terminal determines table position are as follows: desk is opposite with wall a, and desk is put at the middle part of wall a by wall a, and terminal presses desk Positional relationship generates three-dimensional floor plan by table combination into default house type template.Terminal is identified according to component in the present embodiment Generate corresponding floor plan, it is ensured that the normalization of floor plan is conveniently checked.
Further, on the basis of the above embodiments, the floor plan generation side the present invention is based on off-the-air picture is proposed The fourth embodiment of method.
The present embodiment be in the first implementation after step S20 the step of, this implementation is not off-the-air picture in initial pictures, and It is that the take pictures house type drawing generating method of floor plan includes:
Step S50 pre-processes the house type image of taking pictures when the initial pictures are to take pictures house type image, Obtain the edge line of the house type image of taking pictures.
When initial pictures are to take pictures house type image, that is, user uploads house type image of taking pictures as shown in Figure 3, terminal To taking pictures, house type image is pre-processed, wherein and terminal is identical with the first embodiment the pre-treatment step for house type image of taking pictures, The present embodiment does not repeat, and after terminal is to house type image preprocessing of taking pictures, terminal is obtained taking pictures the edge line of house type image.
Step S60 identifies the position dimension of the corresponding house type formation component of the edge line and the house type formation component Information, and the house type formation component is generated into two-dimentional house type image by corresponding position dimension information.
The corresponding house type formation component of terminal recognition edge line, that is, the edge line determination that terminal is obtained according to identification is taken pictures The corresponding size positions information of house type formation component and house type formation component for including in house type image, then, terminal house type are raw Two-dimentional house type image is generated by corresponding position dimension information at component.Terminal is based on an edition floor plan generation of taking pictures in the present embodiment Corresponding electronic edition standard floor plan ensure that floor plan generates comprehensive.
It should be added that terminal can also correspond in the present embodiment when shooting floor plan seems 3-D image Generating three-dimensional is house type image, and it is identical as the principle for generating two-dimentional house type image to generate three-dimensional house type image, but needs in ruler Increase an elevation information when very little identification, wherein the elevation information identification for edition floor plan of taking pictures can be correspondingly arranged image recognition It is required that the present embodiment does not repeat.
Further, on the basis of the above embodiments, the floor plan generation side the present invention is based on off-the-air picture is proposed 5th embodiment of method.
The present embodiment be in the first implementation after step S40 the step of, terminal can be according to the demand of user in this implementation Corresponding display floor plan, specifically, the house type drawing generating method based on off-the-air picture includes:
Step S70 receives floor plan display request, obtains three-dimensional floor plan to be shown in the floor plan display request Dimension is shown with target.
Terminal receives floor plan display request, wherein the house type image display request that terminal receives can be not Tongfang Formula triggering, for example, user inputs: " xxx building house type " and clicking the corresponding display button of terminal, triggering floor plan, which is shown, asks It asks, after terminal receives floor plan display request, terminal obtains three-dimensional floor plan to be shown in floor plan display request Dimension is shown with target, that is, terminal determines that corresponding three-dimensional floor plan to be shown and target show dimension according to display request, Wherein, user can oneself three-dimensional floor plan of setting display or the two-dimentional floor plan of display.Dimension is shown in user setting target When for three-dimensional, the corresponding three-dimensional house type image of terminal output,
Step S80 removes the elevation information in the three-dimensional floor plan, obtains when the target shows that dimension is two dimension To the corresponding two-dimentional floor plan of the three-dimensional floor plan and export.
When target shows that dimension is two dimension, terminal removes the elevation information in three-dimensional floor plan, obtains the three-dimensional family The corresponding two-dimentional floor plan of type figure simultaneously exports, and in the present embodiment when user needs to show two-dimentional floor plan, terminal can be by three Dimension floor plan is handled, and the elevation information in three-dimensional floor plan is removed, and obtains the corresponding two-dimentional floor plan of three-dimensional floor plan simultaneously Input, meets the query demand of user.
In addition, the embodiment of the present invention also proposes a kind of floor plan generating means based on off-the-air picture, described referring to Fig. 4 Floor plan generating means based on off-the-air picture include:
Request receiving module 10 generates request for receiving floor plan, and it is corresponding just to obtain the floor plan generation request Beginning image;
Image category identification module 20 for identifying the initial pictures by pre-set image identification model, and judges institute State whether initial pictures are off-the-air picture;
Picture recognition module 30, for identifying mould by the pre-set image when the initial pictures are off-the-air picture Type detects the off-the-air picture, obtains the house type formation component in the off-the-air picture, wherein the house type formation component includes House type component and non-house type component;
Floor plan generation module 40, for the position ruler according to the house type formation component and the house type formation component Very little information generates three-dimensional floor plan.
Optionally, the floor plan generating means based on off-the-air picture, comprising:
Sample acquisition module, for acquiring different types of off-the-air picture respectively as sample image, by the sample graph As summarizing to obtain sample image set;
Initial construction module, for extracting the sample image of preset ratio from the sample image set, and by pre- If the sample image of ratio constructs initial pictures identification model;
Model training module, for obtaining optimal model parameters by iterative algorithm training initial pictures identification model, and Training is obtained into the corresponding image recognition model of optimal model parameters as pre-set image identification model.
Optionally, described image classification identification module 20, comprising:
Pretreatment unit, for carrying out the redundancy that pretreatment removes the initial pictures to the initial pictures, and Pre-set image identification model will be input to by the pretreated initial pictures;
Comparing unit is identified, for extracting the image primitive in the initial pictures by the pre-set image identification model Element, and described image element is compared with the description components in description components set;
Spectral discrimination unit, for acquisition and the matched subject image element of the description components, in the target image When in element simultaneously including house type component and non-house type component, determine the initial pictures for off-the-air picture.
Optionally, the house type formation component includes house type component and non-house type component;The floor plan generation module 40, Include:
It is initially generated unit, it, will be described for obtaining the position dimension information of the house type component and the house type component House type component is spliced by corresponding position dimension information, generates basic floor plan;
Information alert unit, for when the basis floor plan is imperfect, output to be unsatisfactory for the prompt letter of formation condition Breath, to prompt user to input new initial pictures;
First generation unit, for obtaining the non-house type component and the non-family when the basis floor plan is complete The non-house type component is added to the basic floor plan by corresponding position dimension information by the position dimension information of type component Picture obtains three-dimensional floor plan.
Optionally, the floor plan generation module 40, comprising:
Matching unit is compared, for comparing the house type formation component and the component mark in description components home banking It is right, it obtains and is identified with the matched target element of the house type formation component;
Adjustment unit is obtained, for obtaining the position dimension information of the house type formation component, is believed by the position dimension Size in breath adjusts the target element mark;
Second generation unit is closed for that will adjust the target element completed mark by the position in the position dimension information System is combined in default house type template, generates three-dimensional floor plan.
Optionally, the floor plan generating means based on off-the-air picture, comprising:
Edge line obtain module, for the initial pictures be take pictures house type image when, to the house type image of taking pictures It is pre-processed, obtains the edge line of the house type image of taking pictures;
Two-dimentional generation module, for identification corresponding house type formation component of the edge line and the house type formation component Position dimension information, and the house type formation component is generated into two-dimentional house type image by corresponding position dimension information.
Optionally, the floor plan generating means based on off-the-air picture, comprising:
It shows receiving module, for receiving floor plan display request, obtains to be shown in the floor plan display request Three-dimensional floor plan and target show dimension;
House type display module, for when the target shows that dimension is two dimension, removing the height in the three-dimensional floor plan Information is spent, the corresponding two-dimentional floor plan of the three-dimensional floor plan is obtained and is exported.
Wherein, the step of each Implement of Function Module of the floor plan generating means based on off-the-air picture can refer to the present invention Each embodiment of house type drawing generating method based on off-the-air picture, details are not described herein again.
In addition, the embodiment of the present invention also proposes a kind of computer storage medium.
Computer program, the realization when computer program is executed by processor are stored in the computer storage medium Operation in house type drawing generating method provided by the above embodiment based on off-the-air picture.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body/operation/object is distinguished with another entity/operation/object, without necessarily requiring or implying these entity/operations/ There are any actual relationship or orders between object;The terms "include", "comprise" or its any other variant meaning Covering non-exclusive inclusion, so that the process, method, article or the system that include a series of elements not only include that A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or The intrinsic element of system.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged Except there is also other identical elements in process, method, article or the system for including the element.
For device embodiment, since it is substantially similar to the method embodiment, related so describing fairly simple Place illustrates referring to the part of embodiment of the method.The apparatus embodiments described above are merely exemplary, wherein making It may or may not be physically separated for the unit of separate part description.In can selecting according to the actual needs Some or all of the modules realize the purpose of the present invention program.Those of ordinary skill in the art are not making the creative labor In the case where, it can it understands and implements.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art The part contributed out can be embodied in the form of software products, which is stored in one as described above In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone, Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills Art field, is included within the scope of the present invention.

Claims (10)

1. a kind of house type drawing generating method based on off-the-air picture, which is characterized in that the floor plan based on off-the-air picture is raw At method the following steps are included:
It receives floor plan and generates request, obtain the floor plan and generate the corresponding initial pictures of request;
The initial pictures are identified by pre-set image identification model, and judge whether the initial pictures are off-the-air picture;
When the initial pictures are off-the-air picture, the off-the-air picture is detected by the pre-set image identification model, is obtained House type formation component in the off-the-air picture;
According to the position dimension information of the house type formation component and the house type formation component, three-dimensional floor plan is generated.
2. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that described to pass through default figure As identification model identifies the initial pictures, and before judging the step of whether initial pictures are off-the-air picture, comprising:
Different types of off-the-air picture is acquired respectively as sample image, and the sample image is summarized to obtain sample graph image set It closes;
The sample image of preset ratio is extracted from the sample image set, and passes through the sample image structure of preset ratio Build initial pictures identification model;
By iterative algorithm training initial pictures identification model, optimal model parameters are obtained, and training is obtained into optimal models ginseng The corresponding image recognition model of number is as pre-set image identification model.
3. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that described to pass through default figure As the identification model identification initial pictures, and the step of whether initial pictures are off-the-air picture judged, comprising:
The redundancy that pretreatment removes the initial pictures is carried out to the initial pictures, and will be by pretreated described Initial pictures are input to pre-set image identification model;
The pictorial element in the initial pictures is extracted by the pre-set image identification model, and by described image element and in advance If the description components in assembly set are compared;
Acquisition and the matched subject image element of the description components include house type component in the subject image element simultaneously When with non-house type component, determine the initial pictures for off-the-air picture.
4. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that the house type generation group Part includes house type component and non-house type component;
The position dimension information according to the house type formation component and the house type formation component generates three-dimensional floor plan The step of include:
The house type component is pressed corresponding position by the position dimension information for obtaining the house type component and the house type component Dimension information is spliced, and basic floor plan is generated;
When the basis floor plan is imperfect, output is unsatisfactory for the prompt information of formation condition, to prompt user to input newly Initial pictures;
When the basis floor plan is complete, the position dimension information of the non-house type component and the non-house type component is obtained, The non-house type component is added to the basic house type image by corresponding position dimension information, obtains three-dimensional floor plan.
5. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that described according to the family The step of position dimension information of type formation component and the house type formation component, generation three-dimensional floor plan, comprising:
The house type formation component is compared with the component mark in description components home banking, obtains and is generated with the house type The target element of component matching identifies;
The position dimension information for obtaining the house type formation component, by described in the size adjustment in the position dimension information Target element mark;
The target element that adjustment is completed is identified and is combined to default house type template by the positional relationship in the position dimension information In, generate three-dimensional floor plan.
6. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that described to pass through default figure As identification model identifies the initial pictures, and after judging the step of whether initial pictures are off-the-air picture, comprising:
When the initial pictures are to take pictures house type image, the house type image of taking pictures is pre-processed, obtains described take pictures The edge line of house type image;
Identify the position dimension information of the corresponding house type formation component of the edge line and the house type formation component, and by institute It states house type formation component and generates two-dimentional house type image by corresponding position dimension information.
7. the house type drawing generating method based on off-the-air picture as described in claim 1, which is characterized in that described according to the family After the step of position dimension information of type formation component and the house type formation component, generation three-dimensional floor plan, comprising:
Floor plan display request is received, three-dimensional floor plan and target display dimension to be shown in the floor plan display request are obtained Degree;
When the target shows that dimension is two dimension, the elevation information in the three-dimensional floor plan is removed, obtains the three-dimensional family The corresponding two-dimentional floor plan of type figure simultaneously exports.
8. a kind of floor plan generating means based on off-the-air picture, which is characterized in that the floor plan based on off-the-air picture is raw Include: at device
Request receiving module generates request for receiving floor plan, obtains the floor plan and generates the corresponding initial pictures of request;
Image category identification module for identifying the initial pictures by pre-set image identification model, and judges described initial Whether image is off-the-air picture;
Picture recognition module, for being detected by the pre-set image identification model when the initial pictures are off-the-air picture The off-the-air picture obtains the house type formation component in the off-the-air picture;
Floor plan generation module is used for the position dimension information according to the house type formation component and the house type formation component, Generate three-dimensional floor plan.
9. a kind of floor plan generating device based on off-the-air picture, which is characterized in that the floor plan based on off-the-air picture is raw Forming apparatus includes: memory, processor and is stored in the computer journey that can be run on the memory and on the processor Sequence, in which:
When the computer program is executed by the processor realize as described in any one of claims 1 to 7 based on interior The step of house type drawing generating method of image.
10. a kind of computer storage medium, which is characterized in that be stored with computer program, institute in the computer storage medium State the house type based on off-the-air picture realized as described in any one of claims 1 to 7 when computer program is executed by processor The step of drawing generating method.
CN201910297090.8A 2019-04-12 2019-04-12 House type drawing generating method, device, equipment and storage medium based on off-the-air picture Pending CN110189398A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910297090.8A CN110189398A (en) 2019-04-12 2019-04-12 House type drawing generating method, device, equipment and storage medium based on off-the-air picture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910297090.8A CN110189398A (en) 2019-04-12 2019-04-12 House type drawing generating method, device, equipment and storage medium based on off-the-air picture

Publications (1)

Publication Number Publication Date
CN110189398A true CN110189398A (en) 2019-08-30

Family

ID=67714314

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910297090.8A Pending CN110189398A (en) 2019-04-12 2019-04-12 House type drawing generating method, device, equipment and storage medium based on off-the-air picture

Country Status (1)

Country Link
CN (1) CN110189398A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110689028A (en) * 2019-10-09 2020-01-14 中国人民公安大学 Site map evaluation method, site survey record evaluation method and site survey record evaluation device
CN110765540A (en) * 2019-11-04 2020-02-07 深圳镜界智能科技有限公司 System and method for matching house type graph with various self-contained designs
CN111096714A (en) * 2019-12-25 2020-05-05 江苏美的清洁电器股份有限公司 Control system and method of sweeping robot and sweeping robot
CN111127648A (en) * 2019-12-30 2020-05-08 杭州网易再顾科技有限公司 Indoor plane map generation method and device and sweeping map generation method
CN112200916A (en) * 2020-12-08 2021-01-08 深圳市房多多网络科技有限公司 Method and device for generating house type graph, computing equipment and storage medium
CN111096714B (en) * 2019-12-25 2024-05-10 美智纵横科技有限责任公司 Control system and method of sweeping robot and sweeping robot

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101930627A (en) * 2010-09-10 2010-12-29 西安新视角信息科技有限公司 Three-dimensional dwelling size modeling method based on two-dimensional dwelling size diagram
CN104821011A (en) * 2015-05-20 2015-08-05 郭小虎 Method of generating 3D house type model by 2D house type model based on camera shooting
CN107067461A (en) * 2016-12-24 2017-08-18 上海与德信息技术有限公司 The construction method and device of indoor stereo figure
CN108717726A (en) * 2018-05-11 2018-10-30 北京家印互动科技有限公司 Three-dimensional house type model generating method and device
CN108961405A (en) * 2018-07-23 2018-12-07 广东易凌科技股份有限公司 The Real Estate Information System serviced towards the public based on SOA
CN109218524A (en) * 2018-08-27 2019-01-15 山东大唐宅配家居有限公司 The cell phone application and method that house measurement generates floor plan are carried out based on video recording of taking pictures
CN109598783A (en) * 2018-11-20 2019-04-09 西南石油大学 A kind of room 3D modeling method and furniture 3D prebrowsing system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101930627A (en) * 2010-09-10 2010-12-29 西安新视角信息科技有限公司 Three-dimensional dwelling size modeling method based on two-dimensional dwelling size diagram
CN104821011A (en) * 2015-05-20 2015-08-05 郭小虎 Method of generating 3D house type model by 2D house type model based on camera shooting
CN107067461A (en) * 2016-12-24 2017-08-18 上海与德信息技术有限公司 The construction method and device of indoor stereo figure
CN108717726A (en) * 2018-05-11 2018-10-30 北京家印互动科技有限公司 Three-dimensional house type model generating method and device
CN108961405A (en) * 2018-07-23 2018-12-07 广东易凌科技股份有限公司 The Real Estate Information System serviced towards the public based on SOA
CN109218524A (en) * 2018-08-27 2019-01-15 山东大唐宅配家居有限公司 The cell phone application and method that house measurement generates floor plan are carried out based on video recording of taking pictures
CN109598783A (en) * 2018-11-20 2019-04-09 西南石油大学 A kind of room 3D modeling method and furniture 3D prebrowsing system

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110689028A (en) * 2019-10-09 2020-01-14 中国人民公安大学 Site map evaluation method, site survey record evaluation method and site survey record evaluation device
CN110765540A (en) * 2019-11-04 2020-02-07 深圳镜界智能科技有限公司 System and method for matching house type graph with various self-contained designs
CN111096714A (en) * 2019-12-25 2020-05-05 江苏美的清洁电器股份有限公司 Control system and method of sweeping robot and sweeping robot
CN111096714B (en) * 2019-12-25 2024-05-10 美智纵横科技有限责任公司 Control system and method of sweeping robot and sweeping robot
CN111127648A (en) * 2019-12-30 2020-05-08 杭州网易再顾科技有限公司 Indoor plane map generation method and device and sweeping map generation method
CN111127648B (en) * 2019-12-30 2023-07-21 杭州网易再顾科技有限公司 Indoor plane map generation method and device and cleaning map generation method
CN112200916A (en) * 2020-12-08 2021-01-08 深圳市房多多网络科技有限公司 Method and device for generating house type graph, computing equipment and storage medium

Similar Documents

Publication Publication Date Title
CN109961009B (en) Pedestrian detection method, system, device and storage medium based on deep learning
CN110189398A (en) House type drawing generating method, device, equipment and storage medium based on off-the-air picture
WO2020010979A1 (en) Method and apparatus for training model for recognizing key points of hand, and method and apparatus for recognizing key points of hand
US8848088B2 (en) Product identification using mobile device
CN105308549B (en) Information processing unit, control method, program and storage medium
CN109816745B (en) Human body thermodynamic diagram display method and related products
US9965895B1 (en) Augmented reality Camera Lucida
CN104094082A (en) Virtual ruler
CN104781849A (en) Fast initialization for monocular visual simultaneous localization and mapping (SLAM)
CN110472480A (en) Item identification method, device and computer readable storage medium
CN107347138A (en) Image processing method, device, storage medium and terminal
CN110163956A (en) Three-dimensional house type drawing generating method, device, equipment and storage medium
CN111968247B (en) Method and device for constructing three-dimensional house space, electronic equipment and storage medium
CN109151442A (en) A kind of image capturing method and terminal
US20180262713A1 (en) Dynamically modeling an object in an environment from different perspectives
CN111506758A (en) Method and device for determining article name, computer equipment and storage medium
KR102418992B1 (en) Electronic device and the Method for providing Augmented Reality Service thereof
WO2019000464A1 (en) Image display method and device, storage medium, and terminal
US11604904B2 (en) Method and system for space design
US11501409B2 (en) Electronic device for image synthesis and operating method thereof
CN109785439A (en) Human face sketch image generating method and Related product
US10535154B2 (en) System, method, and program for image analysis
CN111241869B (en) Material checking method and device and computer readable storage medium
CN105683959A (en) Information processing device, information processing method, and information processing system
CN115830280A (en) Data processing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination