WO2019023959A1 - 一种基于智能终端的空间布局控制方法及空间布局控制系统 - Google Patents

一种基于智能终端的空间布局控制方法及空间布局控制系统 Download PDF

Info

Publication number
WO2019023959A1
WO2019023959A1 PCT/CN2017/095547 CN2017095547W WO2019023959A1 WO 2019023959 A1 WO2019023959 A1 WO 2019023959A1 CN 2017095547 W CN2017095547 W CN 2017095547W WO 2019023959 A1 WO2019023959 A1 WO 2019023959A1
Authority
WO
WIPO (PCT)
Prior art keywords
indoor space
layout
layout configuration
item
initial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2017/095547
Other languages
English (en)
French (fr)
Inventor
王一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Transsion Communication Co Ltd
Original Assignee
Shenzhen Transsion Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Transsion Communication Co Ltd filed Critical Shenzhen Transsion Communication Co Ltd
Priority to PCT/CN2017/095547 priority Critical patent/WO2019023959A1/zh
Publication of WO2019023959A1 publication Critical patent/WO2019023959A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis

Definitions

  • the present invention relates to the field of intelligent terminals, and in particular, to a spatial layout control method based on an intelligent terminal and a spatial layout control system.
  • the search engine technology returns relevant content that satisfies the matching rule to the user according to the keyword provided by the user, which greatly improves the efficiency of information retrieval.
  • the search engine technology due to the versatility of search engine technology, it is not well suited to users of different backgrounds, different query purposes and search needs in different periods.
  • using a search engine the user must first extract keywords according to their own needs. Obviously, whether the proposed keyword can accurately summarize the user's needs seriously affects the availability of the search engine's returned results, which extracts keywords for the user.
  • the search engine simply returns all the results that satisfy the match to the user, and often a large part of the content is not required by the user, causing the user to extract the content he needs in a large number of returned results.
  • the layout of the interior space due to the specificity of the type, quantity, size, shape and style of the items in different spaces and spaces, it is difficult for the user to obtain the desired layout result by simple searching.
  • the spatial layout control method and the spatial layout control system combine the three-dimensional panoramic technology, the digital image processing technology, the image recognition technology, etc., and realize the personalized recommendation suitable for the user space layout in an intuitive, convenient, fast and accurate manner.
  • the invention combines the three-dimensional panoramic technology, the multi-angle, all-round display space and the three-dimensional panoramic image of the objects in the space, the user can manipulate and realize the interactive observation and movement from any angle, and the most realistic feeling of the final layout result;
  • Image processing and image recognition technology accurately extract and identify the layout of indoor space and indoor objects;
  • the invention combines personalized recommendation technology to more accurately capture the user's interest points by recording and excavating the content read by the user, based on pre-set
  • the rules or filtering system filters out the layout design that meets the user's point of interest, and responds to the user's individualized requirements in a timely and accurate manner, improves the user's layout efficiency, and greatly saves the user's time and money.
  • an object of the present invention is to provide a spatial layout control method and a spatial layout control system based on an intelligent terminal.
  • the invention discloses a spatial layout control method based on an intelligent terminal, comprising the following steps:
  • the recommended layout configuration is replaced with the initial layout configuration and displayed.
  • the size parameter of the indoor space includes one or more of a shape, a size, a boundary, and the like of the indoor space;
  • the initial layout configuration of the item includes one or more of the type, number, shape, size, position, relative relationship, and the like of the item.
  • the step of acquiring a recommended layout configuration of the item based on the size parameter of the indoor space comprises:
  • the space layout control method further includes:
  • the modified layout configuration is replaced with the recommended layout configuration and displayed.
  • the space layout control method further includes:
  • the indoor space and the indoor space are acquired based on the captured image of the indoor space, and the current three-dimensional image of the item is included;
  • Parsing the indoor space and the layout element of the item in the current three-dimensional image acquiring a size parameter of the indoor space, and a current layout configuration of the item;
  • the comparison displays the initial three-dimensional image and the current three-dimensional image, and the initial layout configuration and the current layout configuration.
  • the present invention also provides a spatial layout control system based on an intelligent terminal, which is characterized in that it comprises an image module, an analysis module, an acquisition module, and a display module;
  • the image module acquires an initial three-dimensional image of the indoor space and the indoor space including an item based on a captured image of an indoor space in the smart terminal;
  • the parsing module parses the indoor space and the layout elements of the item in the initial three-dimensional image, and acquires a size parameter of the indoor space and an initial layout configuration of the item;
  • the acquiring module acquires a recommended layout configuration of the item based on the size parameter of the indoor space
  • the display module replaces the recommended layout configuration with the initial layout configuration and displays.
  • the size parameter of the indoor space includes one or more of a shape, a size, a boundary, and the like of the indoor space;
  • the initial layout configuration of the item includes one or more of the type, number, shape, size, position, relative relationship, and the like of the item.
  • the acquiring module includes a connecting unit, a searching unit, and a returning unit;
  • the connecting unit is connected to a local or network database
  • the searching unit searches for a recommended layout configuration suitable for the indoor space based on the size parameter of the indoor space;
  • the return unit returns the recommended layout configuration.
  • the space layout control system further includes a modification module
  • the modifying module includes modifying an acquiring unit and modifying the display unit;
  • the modification obtaining unit obtains a modification of the recommended layout configuration by the user, and obtains a modified layout configuration
  • the modification display unit replaces the modified layout configuration with the recommended layout configuration and displays.
  • the spatial layout control system further includes a comparison module
  • the comparison module includes a comparison acquisition unit and a comparison display unit;
  • the comparison acquiring unit acquires the current three-dimensional image of the indoor space and the indoor space based on the captured image of the indoor space;
  • the comparison analysis unit analyzes the indoor space and the layout elements of the item in the current three-dimensional image, and acquires a size parameter of the indoor space and a current layout configuration of the item;
  • the comparison display unit compares and displays the initial three-dimensional image and the current three-dimensional image, and the initial layout configuration and the current layout configuration.
  • the invention combines the three-dimensional panoramic technology, the multi-angle, all-round display space and the three-dimensional panoramic image of the objects in the space, the user can manipulate and realize the interactive observation and movement from any angle, and the final real-estimation result.
  • the invention combines image processing and image recognition technology to accurately extract and identify the layout of indoor space and indoor objects
  • the invention combines the personalized recommendation technology, records and mines the content read by the user, more fully captures the current user interest point, and selects a layout design conforming to the user style based on a preset rule or filtering system, and is more timely and Accurately respond to the individual needs of users.
  • FIG. 1 is a flow chart showing a spatial layout control method in accordance with a preferred embodiment of the present invention
  • FIG. 2 is a flow chart showing steps of obtaining a recommended layout for a spatial layout control method according to a preferred embodiment of the present invention
  • FIG. 3 is a flow chart showing the steps of modifying a recommended layout configuration of a spatial layout control method in accordance with a preferred embodiment of the present invention
  • FIG. 4 is a flow chart showing a comparison display step of a spatial layout control method in accordance with a preferred embodiment of the present invention
  • Figure 5 is a block diagram showing the structure of a spatial layout control system in accordance with a preferred embodiment of the present invention.
  • a spatial terminal control method based on an intelligent terminal includes the following steps:
  • S100 Acquire an initial three-dimensional image of the indoor space and the indoor space including an item based on a captured image of an indoor space in the smart terminal;
  • S300 Acquire a recommended layout configuration of the item based on the size parameter of the indoor space
  • the size parameter of the indoor space includes one or more of a shape, a size, a boundary, and the like of the indoor space;
  • the initial layout configuration of the item includes one or more of the type, number, shape, size, position, relative relationship, and the like of the item.
  • the spatial layout control method provided by the present invention can be applied to an intelligent terminal, and the smart terminal can be implemented in various forms.
  • the smart terminal described in the present invention may include mobiles such as mobile phones, smart phones, notebook computers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), navigation devices, smart watches, and the like.
  • Terminals, as well as fixed terminals such as digital TVs, desktop computers, and the like.
  • the present invention will be described on the assumption that the smart terminal is a smart phone.
  • configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • Step S100 Acquire an initial three-dimensional image of the indoor space and the indoor space including an item based on a captured image of an indoor space in the smart terminal;
  • the spatial layout control method provided by the present invention utilizes a panoramic camera in a smart phone to synthesize an initial three-dimensional image by capturing a panoramic image of the indoor space and indoor objects.
  • the three-dimensional panoramic technology is a virtual reality technology based on still images.
  • the common camera combines the fisheye lens to capture the image information of the entire scene, so it is necessary to take several photos at multiple angles.
  • the user firstly performs panoramic shooting on the indoor space through the panoramic camera of the smart phone, for example, panoramic shooting of the living room of the user's house, the space of the living room is 360 degrees, and the camera of the smart phone needs to be rotated by 60 degrees. Take an image, take a total of 6 images, then take 2 images from the top of the living room, and finally get 8 images, and splicing 8 images into a 3D panoramic image of the living room for the user's virtual reality browsing.
  • the user is provided with various functions for manipulating images, such as zooming in, zooming in, moving left and right, etc., and can adjust the distance, zoom in and out, and move the scene in all directions to achieve the effect of simulating and reproducing the real environment of the scene, as if Being in a real environment gives users a new feeling.
  • various functions for manipulating images such as zooming in, zooming in, moving left and right, etc.
  • the camera range of smartphones is limited.
  • Most smartphones with camera functions are equipped with a rear camera, while the field of view of the existing rear camera is mostly between 58 and 65 degrees.
  • the range of the captured image will still be unable to capture a panoramic picture that can be seen by the ordinary naked eye due to the shooting limitations of the single camera itself. Therefore, when performing panoramic shooting on the indoor space, according to the specific shape and size of the indoor space, one or more images need to be taken.
  • the framing range of the camera is adjusted, so that two adjacent two The shooting angle of the image or the captured image partially overlaps, so that the image stitching is performed normally, the problem of no distant dead angle is achieved, and a consistent three-dimensional panoramic image can be obtained by multiple shooting.
  • the real 3D real scene is simulated, and the immersion is strong, giving the user an immersive feeling
  • the file is small, easy to transfer, suitable for network use, publishing a variety of formats, suitable for various forms of applications;
  • technologies such as virtual reality visualization brought by 3D panoramic technology can help people better reconstruct reality, experience reality and transform reality in the virtual world of computers and networks.
  • the user based on the three-dimensional panoramic technology to capture and synthesize three-dimensional panoramic images, the user can not only feel the three-dimensional real scene of the indoor space and the objects in the space more intuitively, multi-angle, and all-round, but also can manipulate and realize interaction from any angle.
  • Sexual observation, experience, movement, transformation, virtual space modification in the virtual space in the intelligent terminal improve the user experience and finishing efficiency, simple and convenient, greatly saving the user's time and money.
  • Step S200 Parsing the indoor space and the layout element of the item in the initial three-dimensional image, and acquiring a size parameter of the indoor space and an initial layout configuration of the item;
  • the spatial layout control method combines the image processing technology and the image recognition technology to analyze the initial three-dimensional image generated by the shooting, and acquires the layout information in the initial three-dimensional image.
  • the layout information includes, but is not limited to, a size parameter of the indoor space and an initial layout configuration of the item.
  • the size parameter of the indoor space includes, but is not limited to, one or more of the shape, size, and boundary of the indoor space;
  • the initial layout configuration of the item includes, but is not limited to, the type, quantity, shape, size, and position of the item.
  • Step S200 can be divided into the following two steps:
  • Step S210 Parsing the initial three-dimensional image, extracting and distinguishing the indoor space and the indoor items.
  • This step uses digital image processing techniques, including image transformation, image enhancement techniques, etc., combined with image recognition technology.
  • the conversion of analog image to digital image is realized by image transformation, which facilitates subsequent processing.
  • the methods of image transformation mainly include Fourier transform, Walsh-Hadamard transform and discrete Kafner-Levy transform.
  • Fourier transform is Fourier transform, including Fourier transform and Fourier inverse transform, Fourier transform is used to transform from real to frequency domain, and Fourier inverse transform is used to convert from frequency domain to real domain.
  • the two-dimensional Fourier transform is used to transform from the spatial domain to the transform domain.
  • the transform domain image is the two-dimensional spectrum of the original spatial domain image.
  • the DC term is proportional to the average of the original image brightness, and the high-frequency term is characterized. The intensity and direction of the edge changes in the image.
  • the Walsh-Adamama transform and the discrete Kafner-Levy transform can also realize the conversion function from analog image to digital image.
  • the implementation method of Walsh-Adamama transform is relative to Fu.
  • the inner-leaf transformation is simpler, the computer has higher computing speed and the storage capacity is small;
  • the discrete Kaffner-Levy transform is a transformation based on the statistical properties of the image, also known as the Hotlin transform or the eigenvector transform.
  • the image is transformed from the real number domain to the frequency domain by Fourier transform, Walsh-Hadamard transform and discrete Kafner-Levy transform, there are different frequency components in the image.
  • the image transformation is gentle at low frequency components in the frequency domain.
  • the same block of the same color in the original image is the same or similar and the color block without color mutation is transformed into the frequency domain and then is the low frequency component; the abrupt part or the edge part of the original image is in the frequency domain.
  • the high-frequency components for example, adjacent color patches having large color differences in the original image are converted to the frequency domain and their boundaries correspond to high-frequency components.
  • image enhancement technology is used to enhance the high-frequency components of the image, so that the outline of the image is clear, which is convenient for extraction.
  • the image transformed into the frequency domain is filtered by a high-pass filter, the low-frequency component is suppressed, the high-frequency component is passed, and the high-frequency component is enhanced, thereby enhancing the edge, and the outline of the indoor space and the indoor object is clear, and the extraction is easy.
  • image segmentation can be realized, thereby extracting indoor space and indoor objects. the goal of.
  • the feature recognition strategy of indoor space and indoor objects is established.
  • image recognition technology is combined.
  • the recognition process includes feature extraction, index building and query steps.
  • Step S220 After extracting and distinguishing the indoor space and the indoor item, acquiring the size parameter of the indoor space and the initial layout configuration of the item.
  • the size parameters of the indoor space and the initial layout configuration of the indoor items are calculated. Considering the thickness, volume, operating efficiency, process cost, etc. of the smartphone, it is necessary to rationally utilize the resources of the smartphone to improve the transmission speed and reduce the memory overhead. To this end, the indoor space and the indoor item characteristics can be extracted in step S210.
  • the user directly gives partial guidance information, for example, inputting the size of the indoor space, marking the name and location information of the air conditioner, the television, the sofa on the initial three-dimensional image, etc., on the basis of which the smart phone is combined with the user's given Guide information, calculate the size parameters of the indoor space and the initial layout configuration of the indoor items, simplify the data processing of the smart phone, and improve the operating efficiency.
  • partial guidance information for example, inputting the size of the indoor space, marking the name and location information of the air conditioner, the television, the sofa on the initial three-dimensional image, etc.
  • Step S300 Acquire a recommended layout configuration of the item based on the size parameter of the indoor space
  • step S300 further includes:
  • S320 Find a recommended layout configuration suitable for the indoor space based on the size parameter of the indoor space;
  • the spatial layout control method provided by the invention combines image recognition technology, and the recognition process includes several steps of image preprocessing, image segmentation, feature extraction, and judgment matching.
  • a cloud database generated based on a picture database of a massive image of a network platform and a network photo album may be connected, and image identification is performed through a massive resource in the cloud database.
  • S320 Find a recommended layout configuration suitable for the indoor space based on the size parameter of the indoor space;
  • the smartphone When the smartphone performs image recognition, it is not limited to image resources in the local or cloud database, and may be other resources such as text and web link.
  • the photos of the spatial layout stored in the cloud database are generally submitted by other users.
  • the photos submitted by the user often contain obvious features of the space, and the obvious features of the space may be in space or space. These obvious features can be used as an important condition for identification, either in whole or in part.
  • image recognition when performing image recognition, first, determining feature information of the object in the space or space, uploading the extracted feature information to a database, and storing the image or information containing the feature information in the database Matches, narrows the search, saves computing resources, and reduces recognition time.
  • feature information of the indoor space and the indoor object is extracted, and the extracted feature information is uploaded to a database, and matched with an image or information stored in the database and containing the feature information, and the corresponding space is searched for and acquired.
  • Layout configuration
  • the smart phone since the smart phone also has a rich sensor, it can provide context information when the image is taken, such as geographic location information acquired by GPS, and can also use the information to assist the image recognition.
  • the spatial layout control method provided by the invention also incorporates a personalized recommendation technique.
  • the personalized recommendation technology is mainly developed in the field of web page access. According to the technology used, it can be divided into two categories: one is a rule-based personalized recommendation system; the other is an information filtering system. Among them, the information filtering system can be subdivided into a content-based filtering system and a collaborative filtering system.
  • the rule-based personalized recommendation system firstly extracts the content of interest that the user has not read according to the content of interest that the current user has read, and then sorts the content according to the degree of support (or importance) of the rule. And presented to the user.
  • the extraction of rules is usually done automatically by user or by mining techniques. The more rules there are, the higher the accuracy of the recommendation.
  • the content-based filtering system implements recommending resources to users by calculating the similarity between user behavior characteristics and resource characteristics.
  • the collaborative filtering system is similar to the content filtering based system, but compares the similarities between different users, finds several of the most similar neighbor users, and predicts the user's interests through neighboring users, thereby recommending resources to the users.
  • P2P Peer to Peer
  • P2P applications are increasingly favored by users.
  • no central node provides services, and the status of all nodes is equal.
  • Each node is both serviced.
  • the requesting party is also the provider of the service.
  • P2P has changed the previous information sharing method based on C/S architecture. Users change from passive information receptors to active information sources, and users can conveniently contribute local resources through P2P system.
  • the personalized service based on P2P system is still in its infancy.
  • the content of personalized service recommendation for P2P system also includes recommendation friends, and P2P system provides a kind of user through interest. Find ways to find interesting content.
  • the spatial layout control method provided by the present invention can be based on a web page access field or a P2P technology. Specifically, since the matching images and information may be very large and mixed in the identification process, after the cloud database determines that the matching is successful, further screening is needed to determine whether it can be confirmed and returned. The judgment of whether the matched image and the information can be confirmed and returned can be performed in various ways, for example, according to the user's preset, or according to the system configuration, or according to the spatial layout and the degree of similarity of the style, according to the image or information being browsed and Click the number of the number, according to the user's usage habits and history to determine whether to confirm and return.
  • the recommended layout configuration replaced and displayed, including the recommended layout configuration returned may also include how to make the initial layout configuration a rationalization scheme for the recommended layout configuration, which can be set according to the shortest time and the least number of handling.
  • the modified layout configuration is replaced with the recommended layout configuration and displayed.
  • the target layout configuration of the modified space and the finishing scheme are displayed.
  • the indoor space and the indoor space are acquired based on the captured image of the indoor space, and the current three-dimensional image of the item is included;
  • Parsing the indoor space and the layout element of the item in the current three-dimensional image acquiring a size parameter of the indoor space, and a current layout configuration of the item;
  • the comparison displays the initial three-dimensional image and the current three-dimensional image, and the initial layout configuration and the current layout configuration.
  • the spatial layout control method provided by the present invention after completing step S400: replacing the recommended layout configuration with the initial layout configuration and displaying, displaying a recommended layout configuration and/or a rationalization finishing scheme in a screen of the smart phone, recommending a layout configuration
  • the initial layout configuration can be used to replace the display, or it can be compared at the same time.
  • the rationalization finishing scheme can be marked on the image of the recommended layout configuration or the initial layout configuration, or can be scrolled up and down or viewed by the user.
  • the user can move and modify the objects in the space or space in the recommended layout configuration, record the modified layout configuration and finishing scheme, and display the modified layout configuration and the modified finishing scheme in real time, and the user recommends Modifications and movements of the layout configuration can be undone and saved.
  • the system also supports users to upload their own layout configuration of the room, as a reference for other users, or after the user organizes according to the recommended layout configuration and finishing scheme, uploads the three-dimensional image of the indoor space and indoor objects, and organizes the The image is displayed in contrast to the original image.
  • the invention also provides a spatial layout control system based on an intelligent terminal, comprising an image module, an analysis module, an acquisition module and a display module;
  • the image module acquires an initial three-dimensional image of the indoor space and the indoor space including an item based on a captured image of an indoor space in the smart terminal;
  • the parsing module parses the indoor space and the layout elements of the item in the initial three-dimensional image, and acquires a size parameter of the indoor space and an initial layout configuration of the item;
  • the acquiring module acquires a recommended layout configuration of the item based on the size parameter of the indoor space
  • the display module replaces the recommended layout configuration with the initial layout configuration and displays.
  • the size parameter of the indoor space includes one or more of a shape, a size, a boundary, and the like of the indoor space;
  • the initial layout configuration of the item includes one or more of the type, number, shape, size, position, relative relationship, and the like of the item.
  • the acquiring module includes a connecting unit, a searching unit, and a returning unit;
  • the connecting unit is connected to a local or network database
  • the searching unit searches for a recommended layout configuration suitable for the indoor space based on the size parameter of the indoor space;
  • the return unit returns the recommended layout configuration.
  • the spatial layout control system further includes a modification module
  • the modifying module includes modifying an acquiring unit and modifying the display unit;
  • the modification obtaining unit obtains a modification of the recommended layout configuration by the user, and obtains a modified layout configuration
  • the modification display unit replaces the modified layout configuration with the recommended layout configuration and displays.
  • the spatial layout control system further includes a comparison module
  • the comparison module includes a comparison acquisition unit and a comparison display unit;
  • the comparison acquiring unit acquires the current three-dimensional image of the indoor space and the indoor space based on the captured image of the indoor space;
  • the comparison analysis unit analyzes the indoor space and the layout elements of the item in the current three-dimensional image, and acquires a size parameter of the indoor space and a current layout configuration of the item;
  • the comparison display unit compares and displays the initial three-dimensional image and the current three-dimensional image, and the initial layout configuration and the current layout configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种基于智能终端的空间布局控制方法及空间布局控制系统,其中,空间布局控制方法包括以下步骤:基于该智能终端内一室内空间的拍摄图像,获取室内空间及室内空间包含物品的初始三维图像;解析初始三维图像内室内空间及物品的布局要素,获取室内空间的尺寸参数及物品的初始布局配置;基于室内空间的尺寸参数,获取物品的一推荐布局配置;将推荐布局配置替换初始布局配置并显示。该控制方法结合了三维全景技术、数字图像处理技术、图像识别技术等,更加直观、方便、快速、精准地实现适合用户空间布局的个性化推荐。

Description

一种基于智能终端的空间布局控制方法及空间布局控制系统 技术领域
本发明涉及智能终端领域,尤其涉及一种基于智能终端的空间布局控制方法及空间布局控制系统。
背景技术
古语云,一屋不扫,何以扫天下。室内空间的整理布局这件看似简单的事情,其实正是思维清晰的体现,更是审美与生活态度的体现。空间布局合理、物品清晰整洁,可以显著提升人们的生活品质。伴随计算机网络技术的飞速发展,互联网已经成为人们获取、交流信息的重要平台。目前,人们对于室内空间的整理布局也越来越依赖于互联网,越来越多的人习惯于从互联网搜集空间布局的技巧,依照互联网上的布局图片来整理布局自己的房间。
在这种背景下,如何使用户能够在互连网的信息海洋中快速、准确找到适合自己的、感兴趣的空间整理方案,是需要进一步解决的难题。搜索引擎技术根据用户提供的关键字,把满足匹配规则的相关内容返回给用户,极大地提高了信息检索的效率。但是,由于搜索引擎技术具有通用性,不能很好地满足不同背景的用户、不同查询目的和不同时期的搜索需求。一方面,使用搜索引擎,用户必须首先根据自己的需求提取关键字,显然,所提出的关键字是否能够准确概括用户的需求严重影响到搜索引擎的返回结果的可用性,这就对用户提取关键字的能力提出了较高的要求,特别地,对于空间的布局整理,当用户需要的信息是由图片记载时,无法对图片中的内容进行检索;另一方面,即使用户提取的关键词是准确的,搜索引擎也仅仅是简单地把满足匹配的结果全部返回给用户,而结果中往往有相当一大部分内容是用户不需要的,导致用户不得不在大量返回的结果中提取自己所需要的内容;更重要的是,对于室内空间的整理布局来说,由于不同空间及空间内物品种类、数量、尺寸、形状、风格的特定性,用户很难通过简单的搜索得到想要的布局结果。
因此本发明提供的空间布局控制方法及空间布局控制系统,结合了三维全景技术、数字图像处理技术、图像识别技术等,直观、方便、快速、精准地实现适合用户空间布局的个性化推荐。本发明结合三维全景技术,多角度、全方位展示空间及空间内物品的三维全景图像,用户可从任一角度操纵并实现互动性地观察、移动,最真实的感受最终布局结果;本发明结合图像处理、图像识别技术,准确提取并识别室内空间及室内物品的布局;本发明结合个性化推荐技术,通过记录挖掘用户阅读过的内容,更充分地捕捉用户的兴趣点,基于预先设定的规则或过滤系统,筛选出符合用户兴趣点的布局设计,更加及时和准确的应对用户的个性化需求,提高了用户的整理布局效率,大大节省了用户的时间和金钱。
发明内容
为了克服上述技术缺陷,本发明的目的在于提供一种基于智能终端的空间布局控制方法及空间布局控制系统。
本发明公开了一种基于智能终端的空间布局控制方法,包括以下步骤:
基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间 的尺寸参数及所述物品的初始布局配置;
基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
将所述推荐布局配置替换所述初始布局配置并显示。
优选地,所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
优选地,基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置的步骤包括:
连接一本地或网络数据库;
基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
返回所述推荐布局配置。
优选地,所述空间布局控制方法还包括:
获取用户对所述推荐布局配置的修改,得到修改布局配置;
将所述修改布局配置替换所述推荐布局配置并显示。
优选地,所述空间布局控制方法还包括:
用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
本发明还提供了一种基于智能终端的的空间布局控制系统,其特征在于,包括图像模块、解析模块、获取模块、显示模块;
所述图像模块,基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
所述解析模块,解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
所述获取模块,基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
所述显示模块,将所述推荐布局配置替换所述初始布局配置并显示。
优选地,所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
优选地,所述获取模块,包括连接单元、查找单元、返回单元;
所述连接单元,连接一本地或网络数据库;
所述查找单元,基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
所述返回单元,返回所述推荐布局配置。
优选地,所述空间布局控制系统还包括修改模块;
所述修改模块,包括修改获取单元,修改显示单元;
所述修改获取单元,获取用户对所述推荐布局配置的修改,得到修改布局配置;
所述修改显示单元,将所述修改布局配置替换所述推荐布局配置并显示。
优选地,所述空间布局控制系统还包括对比模块;
所述对比模块,包括对比获取单元,对比显示单元;
所述对比获取单元,在用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
所述对比解析单元,解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
所述对比显示单元,对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
采用了上述技术方案后,与现有技术相比,具有以下有益效果:
1.本发明结合三维全景技术,多角度、全方位展示空间及空间内物品的三维全景图像,用户可从任一角度操纵并实现互动性地观察、移动,最真实的感受最终布局结果。
2.本发明结合图像处理、图像识别技术,准确提取并识别室内空间及室内物品的布局;
3.本发明结合个性化推荐技术,通过记录挖掘用户阅读过的内容,更充分地捕捉当前用户兴趣点,基于预先设定的规则或过滤系统,筛选出符合用户风格的布局设计,更加及时和准确的应对用户的个性化需求。
附图说明
图1为符合本发明一优选实施例中,空间布局控制方法的流程示意图;
图2为符合本发明一优选实施例中,空间布局控制方法的获取推荐布局配置步骤的流程示意图;
图3为符合本发明一优选实施例中,空间布局控制方法的修改推荐布局配置步骤的流程示意图;
图4为符合本发明一优选实施例中,空间布局控制方法的对比显示步骤的流程示意图;
图5为符合本发明一优选实施例中,空间布局控制系统的结构示意图。
附图标记:
100-空间布局控制系统;11-图像模块;12-解析模块;13-获取模块;14-显示模块;15-修改模块;16-对比模块。
具体实施方式
以下结合附图与具体实施例进一步阐述本发明的优点。
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
在本公开使用的术语是仅仅出于描述特定实施例的目的,而非旨在限制本公开。在本公开和所附权利要求书中所使用的单数形式的“一”、“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其他含义。还应当理解,本文中使用的术语“和/或”是指并包含一个或多个相关联的列出项目的任何或所有可能组合。
在本公开使用的术语仅是为了描述特定实施例,而并非旨在限制本申请。空间相关的术语,例如“上”、“下”、“左”、“右”等方位名词,在文中使用以便于说明其中的相对关系。
在本发明的描述中,除非另有规定和限定,对于本领域的普通技术人员而言,可以根据具体情况理解术语的具体含义。
在后续的描述中,使用用于表示元件的诸如“模块”、“单元”等的后缀仅为了有利 于本发明的说明,其本身并没有特定的意义,仅表示系统的一部分。因此,“模块”与“单元”可以混合地使用。
参考图1,本发明提供的一种基于智能终端的空间布局控制方法,包括以下步骤:
S100:基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
S200:解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
S300:基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
S400:将所述推荐布局配置替换所述初始布局配置并显示。
在一优选实施例中,所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
本发明提供的空间布局控制方法,可以应用于智能终端,智能终端可以以各种形式来实施。例如,本发明中描述的智能终端可以包括诸如移动电话、智能电话、笔记本电脑、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置、智能手表等的移动终端,以及诸如数字TV、台式计算机等的固定终端。下面,假设智能终端为智能手机,对本发明进行说明。然而,本领域技术人员将理解的是,除了特别用于移动目的的元件之外,根据本发明的实施方式的构造也能够应用于固定类型的终端。
步骤S100:基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
本发明提供的空间布局控制方法,利用智能手机内的全景摄像头,通过拍摄室内空间及室内物品的全景图像进而合成初始三维图像。
与传统三维技术及以vrml为代表的网络三维技术都采用计算机生成图像的方式来建立三维模型相比,三维全景技术是利用实景照片建立虚拟环境,按照照片拍摄-数字化-图像拼接-生成场景的模式来完成虚拟现实的创建,更为简单实用。
三维全景技术是基于静态图像的虚拟现实技术,通过普通相机结合鱼眼镜头,捕捉整个场景的图像信息,因此需要多角度拍摄数张照片。具体到本实施例中,用户首先通过智能手机的全景摄像头对室内空间进行全景拍摄,例如,对用户房屋的客厅进行全景拍摄,客厅的空间为360度空间,需要将智能手机摄像头每转动60度拍摄一张图像,共拍摄6张图像,再从客厅的上方拍摄得到2张图像,最终得到8张图像,将8张图像拼接合成客厅的三维全景图像,用于用户的虚拟现实浏览。同时,提供给用户各种操纵图像的功能,如拉近距离,放大,左右移动等,可以任意调整远近,放大缩小,各个方向移动观看场景,以达到模拟和再现场景的真实环境的效果,仿佛置身真实的环境之中,带给用户全新的感受。
可以理解的是,智能手机的摄像头拍摄范围有限,大多数带有拍照功能的智能手机都设置有一个后置摄像头,而现有的后置摄像头的视场拍摄角度大都在58~65度之间,这样,即便采用拍摄范围最大的65度视场角的照相摄像头,其拍摄图像的范围仍然会因为单个摄像头本身的拍摄局限而不能拍摄到像普通肉眼所能看到的全景图片。因此,对室内空间进行全景拍摄时,根据室内空间的具体形状和尺寸,需要拍摄一张或多张图像,通过调整拍摄待整理空间的位置及角度,调整摄像头的取景范围,使得相邻两张图像的拍摄角度或拍摄的图像存在部分重叠,从而使得图像拼接正常进行,达到无远距离死角的问题,并可通过多次拍摄,得到一致的三维全景图像。
由上述三维全景技术得到的三维全景图像,和以往的建模、图片等表现形式相比,有以下几个方面的优势:
1、真实感强,三维全景图像基于真实图片的制作而成,相比其他建模生成对象更真实可信;
2、相较于平面图片可以表达更多的图像信息,并可以任意控制,交互性能好;
3、经过对图像的透视处理模拟真实三维实景,沉浸感强烈,给用户带来身临其境的感觉;
4、生成方便,制作周期短,制作成本低;
5、文件小,传输方便,适合网络使用,发布格式多样,适合各种形式的应用;
6、包容性强,可添加文字、图片、视频、flash等多种功能。
7、兼容性好,可与传统二维网站相结合,效果更好。
因此,三维全景技术所带来的虚拟现实可视化等技术,可以帮助人们在计算机和网络这个虚拟世界中更好地重建现实,体验现实和改造现实。具体在本发明中,基于三维全景技术拍摄并合成三维全景图像,用户不仅可以更直观、多角度、全方位地感受室内空间及空间内物品的三维实景,而且可从任一角度操纵并实现互动性地观察、体验、移动、改造,在智能终端中这个虚拟的空间内进行空间的虚拟整理改造,提高了用户的使用体验和整理效率,简单方便,大大节约了用户的时间和金钱。
步骤S200:解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
本发明提供的空间布局控制方法,结合图像处理技术、图像识别技术,解析拍摄生成的初始三维图像,获取初始三维图像内的布局信息。该布局信息包括但不限于室内空间的尺寸参数及物品的初始布局配置。其中,室内空间的尺寸参数,包括但不限于室内空间的形状、尺寸、边界等的一种或多种;物品的初始布局配置,包括但不限于物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。步骤S200可以分为以下两个步骤:
步骤S210:对初始三维图像进行解析,提取并区分室内空间及室内物品。
这一步骤采用数字图像处理技术,包括图像变换、图像增强技术等,并结合图像识别技术。
首先,通过图像变换实现模拟图像到数字图像的转换,方便后续的处理,图像变换的方法主要有傅里叶变换、沃尔什-阿达玛变换以及离散卡夫纳-勒维变换。傅里叶变换即Fourier变换,包括傅里叶正变换与傅里叶逆变换,傅里叶正变换实现从实数域到频域的转换,傅里叶逆变换实现从频域到实数域的转换,此处采用二维傅里叶正变换,从空间域变换到转换域,转换域图像是原空间域图像的二维频谱,其直流项与原图像亮度的平均值成比例,高频项表征图像中边缘变化的强度和方向。除傅里叶变换外,沃尔什-阿达玛变换与离散卡夫纳-勒维变换也可以实现模拟图像到数字图像的转换功能,其中,沃尔什-阿达玛变换的实现方法相对与傅里叶变换更简单,计算机的运算速度更高,存储容量小;离散卡夫纳-勒维变换是以图像的统计特性为基础的变换,又称霍特林变换或本征向量变换。
通过傅里叶变换、沃尔什-阿达玛变换以及离散卡夫纳-勒维变换中的任一种变换方法实现图像从实数域变换到频域后,在图像中存在不同的频率分量,原图像变换平缓处为频域中的低频分量,如,原图像中同一块颜色相同或相近且没有颜色突变的色块变换到频域后为低频分量;原图像突变部分或边缘部分为频域中的高频分量,如,原图像中存在颜色差别较大的相邻色块,则转换至频域后其边界对应高频分量。因此,在提取室内空间及室内物品时,采用图像增强技术,强化图像高频分量,使图像中轮廓清晰,从而方便提取。此处,通过高通滤波器对变换到频域的图像进行滤波,抑制低频分量,使高频分量通过,实现高频分量的增强,从而强化边缘,使室内空间及室内物品的轮廓清晰,便于提取。
强化室内空间及室内物品的轮廓后,需要对拍摄图像进行分割,提取室内空间及室内物品。根据图像中像素的亮度及颜色进行分割,包括灰度阀值分割法、区域生长分割法、边缘分割法以及基于直方图递归分割法,均可实现图像的分割,从而达到提取室内空间及室内物品的目的。
建立室内空间及室内物品的特征识别策略,在此过程中结合了图像识别技术,识别过程包括特征提取、建立索引build、查询几个步骤。通过对室内空间及室内物品的特征进行判断,如长度、宽度、各部分比例等,或通过对区别特征的设置,实现对室内空间及室内物品的区分。
步骤S220:提取并区分室内空间及室内物品后,获取所述室内空间的尺寸参数及所述物品的初始布局配置。
根据提取的室内空间及室内物品,计算得到室内空间的尺寸参数及室内物品的初始布局配置。考虑到智能手机的厚度、体积、运行效率、工艺成本等方面,需要将智能手机的资源进行合理利用,提高传输速度、减小内存开销,为此,可以在步骤S210提取室内空间及室内物品特征后,用户直接给出部分指引信息,例如,输入室内空间的尺寸,在初始三维图像上标记出空调、电视机、沙发的名称与位置信息等,在此基础上,智能手机结合用户给出的指引信息,计算得到室内空间的尺寸参数及室内物品的初始布局配置,将智能手机的数据处理简化,提高运行效率。
步骤S300:基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
参考图2,在一优选实施例中,步骤S300进一步包括:
S310:连接一本地或网络数据库;
S320:基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
S330:返回所述推荐布局配置。
本发明提供的空间布局控制方法,结合图像识别技术,识别过程包括图像预处理、图像分割、特征提取、判断匹配几个步骤。
S310:连接一本地或网络数据库;
具体在连接数据库时,可以有多种方式,例如连接本地数据库,预先通过网上下载、人工收集等方式获取各种空间整理的图像,并保存到本地数据库中,但是对于智能设备飞速发展的时代而言,在实际连接使用这种方式创建的本地数据库时,数据库的内容往往是非常有限的,不可能全面覆盖到所有用户可能拍摄到的空间或物体。为此,本实施例中,还可以连接一基于网络平台、网络相册的海量图片的图片数据库而生成的云端数据库,通过云端数据库中的海量资源进行图像识别。
S320:基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
智能手机进行图像识别时,不限于本地或云端数据库中的图像资源,也可以是文字、网页链接等其他资源。
云端数据库中存储的空间布局的照片一般是其他用户拍摄提交的,例如对于客厅装修布局的照片,用户提交的照片中往往包含有该空间的明显特征,该空间的明显特征可能是空间或空间内物体的整体或部分,这些明显特征可以作为识别的重要条件。具体地,为提高识别的效率,在进行图像识别时,首先确定该空间或空间内物体的特征信息,将提取的特征信息上传至数据库,并与数据库中保存的包含该特征信息的图像或信息进行匹配,缩小搜索的范围,节省计算资源,减少识别的时间。具体在本实施例中,提取室内空间及室内物体的特征信息,将提取的特征信息上传至数据库,并与数据库中保存的包含该特征信息的图像或信息进行匹配,查找并获取适合该空间的布局配置。
另外,由于智能手机还带有丰富的传感器,可以为图像提供拍照时的上下文信息,如GPS获取的地理位置信息等,还可以利用这些信息对图像进行辅助识别。
S330:返回所述推荐布局配置。
本发明提供的空间布局控制方法,还结合个性化推荐技术。个性化推荐技术主要是在Web页面访问领域展开的,根据其所采用的技术可以分为两大类:一类是基于规则的个性化推荐系统;一类是信息过滤系统。其中,信息过滤系统又可以细分为基于内容的过滤系统和协作过滤系统。基于规则的个性化推荐系统首先根据当前用户阅读过的感兴趣的内容,按照规则推算出用户还没有阅读过的感兴趣的内容,然后根据规则的支持度(或重要程度),对这些内容排序并展现给用户。规则的提取通常是通过用户定制或通过挖掘技术自动发现。规则越多,推荐的准确度越高。基于内容的过滤系统是通过计算用户行为特征和资源特征的相似度来实现向用户推荐资源。协作过滤系统与基于内容过滤的系统相似,不过比较的是不同用户之间的相似度,找出若干个最相似的邻居用户,并通过邻居用户来预测用户的兴趣,从而向用户推荐资源。
随着P2P(Peer to Peer)技术的成熟,P2P应用越来越受到用户的青睐,在P2P网络中,没有中心节点专门提供服务,所有节点之间的地位是平等的,每个节点既是服务的请求方,也是服务的提供方。P2P改变了以往的基于C/S架构的信息共享方式,用户从被动的信息受体转变为主动的信息源,用户通过P2P系统方便地把本地的资源贡献出来。目前,基于P2P系统的个性化服务还处于起步阶段,相对基于Web的个性化服务来说,面向P2P系统的个性化服务推荐的内容还包括推荐好友,P2P系统提供了一种通过感兴趣的用户找到感兴趣的内容的途径。
本发明提供的空间布局控制方法,个性化推荐技术可以基于web页面访问领域,也可以基于P2P技术。具体地,由于在识别过程中,匹配得到的图像及信息可能数量非常庞大且鱼龙混杂,因此在云端数据库判断匹配成功后,还需再进一步筛选,判断是否可以确认并返回。对匹配得到的图像及信息是否可以确认并返回的判断可以有多种方式,例如,按照用户的预先设定、或者按照系统配置、或者按照空间布局及风格相似程度、按照图像或信息被浏览与点击数量的多少、按照用户的使用习惯与历史记录判断是否确认并返回。
S400:将所述推荐布局配置替换所述初始布局配置并显示。
替换并显示的推荐布局配置,包括返回的推荐布局配置,也可以包括如何使得初始布局配置成为推荐布局配置的合理化方案,该合理化方案可以依据用时最短、搬运次数最少等方式设定。
参考图3,在一优选实施例中,进一步地,替换并显示的推荐布局配置后:
获取用户对所述推荐布局配置的修改,得到修改布局配置;
将所述修改布局配置替换所述推荐布局配置并显示。显示修改后所述空间的所述目标布局配置及所述整理方案。
参考图4,在一优选实施例中,进一步地,替换并显示的推荐布局配置后:
用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
本发明提供的空间布局控制方法,在完成步骤S400:将所述推荐布局配置替换所述初始布局配置并显示后,在智能手机的屏幕内显示推荐布局配置和/或合理化整理方案,推荐布局配置与初始布局配置可以替换显示,也可以同时对比显示,合理化整理方案可以标记在推荐布局配置或初始布局配置的图像上,也可以上下滚动播放或通过用户滑动查看。用户可以在推荐布局配置中对空间或空间内物体进行移动和修改,记录修改后的布局配置及整理方案,并实时显示修改后的布局配置及修改后的整理方案,用户对推荐 布局配置的修改和移动可以撤销和保存。
此外,还支持用户上传自己对房间的布局配置,作为其他用户的参考,或者,用户按照推荐布局配置及整理方案进行整理后,上传整理后室内空间及室内物体的三维图像,并将整理后的图像与初始图像对比显示。
本发明还提供了一种基于智能终端的空间布局控制系统,包括图像模块、解析模块、获取模块、显示模块;
所述图像模块,基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
所述解析模块,解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
所述获取模块,基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
所述显示模块,将所述推荐布局配置替换所述初始布局配置并显示。
在一优选实施例中,所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
在一优选实施例中,所述获取模块,包括连接单元、查找单元、返回单元;
所述连接单元,连接一本地或网络数据库;
所述查找单元,基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
所述返回单元,返回所述推荐布局配置。
在一优选实施例中,所述空间布局控制系统还包括修改模块;
所述修改模块,包括修改获取单元,修改显示单元;
所述修改获取单元,获取用户对所述推荐布局配置的修改,得到修改布局配置;
所述修改显示单元,将所述修改布局配置替换所述推荐布局配置并显示。
在一优选实施例中,所述空间布局控制系统还包括对比模块;
所述对比模块,包括对比获取单元,对比显示单元;
所述对比获取单元,在用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
所述对比解析单元,解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
所述对比显示单元,对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
应当注意的是,本发明的实施例有较佳的实施性,且并非对本发明作任何形式的限制,任何熟悉该领域的技术人员可能利用上述揭示的技术内容变更或修饰为等同的有效实施例,但凡未脱离本发明技术方案的内容,依据本发明的技术实质对以上实施例所作的任何修改或等同变化及修饰,均仍属于本发明技术方案的范围内。

Claims (10)

  1. 一种基于智能终端的空间布局控制方法,其特征在于,包括以下步骤:
    基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
    解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
    基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
    将所述推荐布局配置替换所述初始布局配置并显示。
  2. 如权利要求1所述的空间布局控制方法,其特征在于,
    所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
    所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
  3. 如权利要求1所述的空间布局控制方法,其特征在于,
    基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置的步骤包括:
    连接一本地或网络数据库;
    基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
    返回所述推荐布局配置。
  4. 如权利要求1所述的空间布局控制方法,其特征在于,
    所述空间布局控制方法还包括:
    获取用户对所述推荐布局配置的修改,得到修改布局配置;
    将所述修改布局配置替换所述推荐布局配置并显示。
  5. 如权利要求1所述的空间布局控制方法,其特征在于,
    所述空间布局控制方法还包括:
    用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
    解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
    对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
  6. 一种基于智能终端的空间布局控制系统,其特征在于,包括图像模块、解析模块、获取模块、显示模块;
    所述图像模块,基于所述智能终端内一室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的初始三维图像;
    所述解析模块,解析所述初始三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的初始布局配置;
    所述获取模块,基于所述室内空间的所述尺寸参数,获取所述物品的一推荐布局配置;
    所述显示模块,将所述推荐布局配置替换所述初始布局配置并显示。
  7. 如权利要求6所述的空间布局控制系统,其特征在于,
    所述室内空间的所述尺寸参数,包括所述室内空间的形状、尺寸、边界等的一种或多种;
    所述物品的所述初始布局配置,包括所述物品的种类、数量、形状、尺寸、位置、相对关系等的一种或多种。
  8. 如权利要求6所述的空间布局控制系统,其特征在于,
    所述获取模块,包括连接单元、查找单元、返回单元;
    所述连接单元,连接一本地或网络数据库;
    所述查找单元,基于所述室内空间的所述尺寸参数,查找适合所述室内空间的推荐布局配置;
    所述返回单元,返回所述推荐布局配置。
  9. 如权利要求6所述的空间布局控制系统,其特征在于,
    所述空间布局控制系统还包括修改模块;
    所述修改模块,包括修改获取单元,修改显示单元;
    所述修改获取单元,获取用户对所述推荐布局配置的修改,得到修改布局配置;
    所述修改显示单元,将所述修改布局配置替换所述推荐布局配置并显示。
  10. 如权利要求6所述的空间布局控制系统,其特征在于,
    所述空间布局控制系统还包括对比模块;
    所述对比模块,包括对比获取单元,对比显示单元;
    所述对比获取单元,在用户按照所述推荐布局配置布局所述室内空间后,基于所述室内空间的拍摄图像,获取所述室内空间及所述室内空间包含物品的当前三维图像;
    所述对比解析单元,解析所述当前三维图像内所述室内空间及所述物品的布局要素,获取所述室内空间的尺寸参数及所述物品的当前布局配置;
    所述对比显示单元,对比显示所述初始三维图像与所述当前三维图像,以及所述初始布局配置与所述当前布局配置。
PCT/CN2017/095547 2017-08-02 2017-08-02 一种基于智能终端的空间布局控制方法及空间布局控制系统 Ceased WO2019023959A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095547 WO2019023959A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的空间布局控制方法及空间布局控制系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095547 WO2019023959A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的空间布局控制方法及空间布局控制系统

Publications (1)

Publication Number Publication Date
WO2019023959A1 true WO2019023959A1 (zh) 2019-02-07

Family

ID=65232325

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/095547 Ceased WO2019023959A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的空间布局控制方法及空间布局控制系统

Country Status (1)

Country Link
WO (1) WO2019023959A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1987691A (zh) * 2006-10-30 2007-06-27 中山大学 一种数字家庭家具控制器
CN103413245A (zh) * 2013-07-23 2013-11-27 西安发威电子科技有限公司 一种基于数据库的家具选择方法
CN105122304A (zh) * 2012-11-14 2015-12-02 微软技术许可有限责任公司 使用增强现实的对居住空间的实时设计
CN106096153A (zh) * 2016-06-16 2016-11-09 上海营匠网络科技有限公司 室内装潢实景体验场景提供方法及系统
CN106126817A (zh) * 2016-06-24 2016-11-16 深圳市彬讯科技有限公司 一种基于空间信息的物品布局方法及装置
CN106815440A (zh) * 2017-01-19 2017-06-09 深圳市彬讯科技有限公司 一种家居户型设计的结构物品智能布局方法及系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1987691A (zh) * 2006-10-30 2007-06-27 中山大学 一种数字家庭家具控制器
CN105122304A (zh) * 2012-11-14 2015-12-02 微软技术许可有限责任公司 使用增强现实的对居住空间的实时设计
CN103413245A (zh) * 2013-07-23 2013-11-27 西安发威电子科技有限公司 一种基于数据库的家具选择方法
CN106096153A (zh) * 2016-06-16 2016-11-09 上海营匠网络科技有限公司 室内装潢实景体验场景提供方法及系统
CN106126817A (zh) * 2016-06-24 2016-11-16 深圳市彬讯科技有限公司 一种基于空间信息的物品布局方法及装置
CN106815440A (zh) * 2017-01-19 2017-06-09 深圳市彬讯科技有限公司 一种家居户型设计的结构物品智能布局方法及系统

Similar Documents

Publication Publication Date Title
US11488355B2 (en) Virtual world generation engine
Hand Visuality in Social Media: Researching Images
US20210103779A1 (en) Mobile image search system
US9542778B1 (en) Systems and methods related to an interactive representative reality
KR101557297B1 (ko) 장치에 내장된 3d 콘텐츠 집계
US9727565B2 (en) Photo and video search
TWI617930B (zh) 空間物件搜尋排序方法、系統與電腦可讀取儲存裝置
US10242280B2 (en) Determining regions of interest based on user interaction
CN116319862A (zh) 一种智能匹配数字图书馆的系统及方法
CN109074358A (zh) 提供与用户兴趣有关的地理位置
TWI464665B (zh) 實施於通訊裝置之媒體內容管理系統與方法
CN112989214A (zh) 一种旅游信息展示方法及相关设备
US10089762B2 (en) Methods for navigating through a set of images
US11817129B2 (en) 3D media elements in 2D video
CN105023266A (zh) 增强现实实现方法、装置和终端设备
Doulamis et al. 4D modelling in cultural heritage
JP2019159537A (ja) 画像検索装置、画像検索方法、電子機器及びその制御方法
CN105117399A (zh) 一种图像搜索方法和装置
TW201823929A (zh) 移動物件的虛擬訊息遠距管理方法與應用系統
CN117544829B (zh) 视频生成方法及装置
EP3400537B1 (en) Method for navigating through a set of images
US20140286624A1 (en) Method and apparatus for personalized media editing
CN104137101B (zh) 用于管理媒体文件的方法、装置和计算机程序产品
CN114707055B (zh) 一种融合图像内容和特征提取的拍照姿势推荐方法
KR102745087B1 (ko) 영상 소스에 기반한 가상 인물 객체 및 가상 공연 서비스 제공 방법, 그리고 이를 가상 자산으로 이용하는 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17920581

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17920581

Country of ref document: EP

Kind code of ref document: A1