WO2019128101A1 - 一种投影区域自适应的动向投影方法、装置及电子设备 - Google Patents

一种投影区域自适应的动向投影方法、装置及电子设备 Download PDF

Info

Publication number
WO2019128101A1
WO2019128101A1 PCT/CN2018/089304 CN2018089304W WO2019128101A1 WO 2019128101 A1 WO2019128101 A1 WO 2019128101A1 CN 2018089304 W CN2018089304 W CN 2018089304W WO 2019128101 A1 WO2019128101 A1 WO 2019128101A1
Authority
WO
WIPO (PCT)
Prior art keywords
projection
candidate
area
regions
image
Prior art date
Application number
PCT/CN2018/089304
Other languages
English (en)
French (fr)
Inventor
杨伟樑
高志强
许剑波
林清云
Original Assignee
广景视睿科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广景视睿科技（深圳）有限公司 filed Critical 广景视睿科技（深圳）有限公司
Publication of WO2019128101A1 publication Critical patent/WO2019128101A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/80—Geometric correction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the embodiments of the present invention relate to the field of projection display technologies, and in particular, to a projection area adaptive moving projection method, device, and electronic device.
  • the main purpose of the present application is to provide a projection area adaptive moving direction projection method, device and electronic device, so as to solve the problem that the projection display effect is compared when the direction of the user's intentional projection is affected by the projection space environment in the prior art. Poor, the user experience is not good.
  • an embodiment of the present application provides a projection area adaptive moving projection method, including:
  • Projection is performed according to the projection angle.
  • the acquiring the panoramic image of the projection environment comprises: performing image acquisition at different angles on the image of the projection environment by changing an acquisition direction of the image, obtaining a plurality of images, and synthesizing the panoramic image according to the plurality of images.
  • performing the score evaluation on the plurality of candidate projection regions includes: performing a score evaluation on the plurality of candidate projection regions according to the region elements of the candidate projection region, where the region elements include One or more of area, outline, angle, and color.
  • the feature information further includes: an area, a location, and an angle of the candidate projection area.
  • the selecting a most suitable projection area according to the projection intention of the user and the feature information corresponding to the plurality of candidate projection areas respectively, and the step of calculating the projection angle further includes:
  • the alternative projection area in which the active object is present is discarded.
  • an embodiment of the present application provides a projection area adaptive moving projection device, where the device includes:
  • a panoramic image acquisition unit for acquiring a panoramic image of the projection environment
  • An image processing unit configured to divide the panoramic image into a plurality of divided regions, and form a plurality of candidate projected regions based on the plurality of divided regions;
  • An image evaluation unit configured to perform a score evaluation on the plurality of candidate projection regions
  • An information recording unit configured to record and save feature information corresponding to each of the plurality of candidate projection regions, wherein the feature information includes a score of the candidate projection region;
  • a calculation analysis unit configured to select a most suitable projection area according to the projection intention of the user and the feature information corresponding to the plurality of candidate projection areas, and calculate a projection angle
  • a projection unit for projecting according to the projection angle.
  • the device further includes: a trigger activation unit, wherein the trigger activation unit is configured to activate a motion projection device in a standby state.
  • the trigger activation unit includes:
  • a remote control module for starting a standby projection device in a standby state by a user controlling a micro button device carried with the user;
  • a voice module configured to activate a moving projection device in a standby state according to a corresponding voice command
  • the motion recognition module is configured to receive a body language trigger such as a gesture acquired by the image acquisition unit, and activate a moving projection device in a standby state.
  • the panoramic image collecting unit includes:
  • An image acquisition module for acquiring an image of a projection environment
  • a first direction control module configured to change an acquisition direction of the image, so that the image acquisition module performs image acquisition of images of the projection environment at different angles to obtain multiple images
  • an image synthesis module configured to synthesize the panoramic image according to the plurality of images.
  • the projection unit includes:
  • a second direction control module configured to perform projection according to the projection angle
  • Projection correction module for correction of projected images.
  • an electronic device including:
  • At least one processor and,
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method as described above.
  • embodiments of the present application provide a non-transitory computer readable storage medium storing computer-executable instructions for causing an electronic The device performs the method as described above.
  • an embodiment of the present application provides a computer program product, the computer program product comprising a computer program stored on a computer readable storage medium, the computer program comprising program instructions, when the program instruction is used by an electronic device When executed, the electronic device is caused to perform the method as described above.
  • the present application discloses a projection area adaptive moving projection method, device and electronic device, by dividing the projection environment into a plurality of candidate projection regions, And when the user's projection intention is obtained, the most suitable candidate projection area is selected according to the position information of the projection intention, and the projection can be avoided in an area where the image distortion or the like is easily unclear in the corner or other obstacles.
  • the projection display enhances the user's comfort in viewing the projected picture while enhancing the user's viewing experience while ensuring that the user always has the visual enjoyment of the projected picture.
  • FIG. 1 is a schematic flow chart of a projection area adaptive moving direction projection method provided by an embodiment of the present application
  • FIG. 2 is a diagram showing an example of dividing a panoramic image into a plurality of divided regions according to an embodiment of the present application
  • FIG. 3 is a diagram showing an example of forming a plurality of candidate projection regions based on a plurality of divided regions in FIG. 2 according to an embodiment of the present application;
  • FIG. 4 is a diagram showing an example of a positional relationship between a user projection intention and a plurality of candidate projection regions shown in FIG. 3 according to an embodiment of the present application;
  • FIG. 5 is a diagram showing an example of selecting a projection area based on the positional relationship shown in FIG. 4 according to an embodiment of the present application;
  • FIG. 6 is a diagram showing another example of selecting a projection area based on the positional relationship shown in FIG. 4 according to an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of a projection area adaptive motion projection apparatus according to an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of a trigger activation unit of the projection area adaptive moving projection device shown in FIG. 7;
  • FIG. 9 is a schematic structural diagram of a panoramic image capturing unit of the projection area adaptive moving projection device shown in FIG. 7;
  • FIG. 10 is a schematic structural diagram of a projection unit of the projection area adaptive moving projection device shown in FIG. 7;
  • FIG. 11 is a schematic structural diagram of hardware of an electronic device according to an embodiment of the present application.
  • the embodiment of the present application provides a projection area adaptive moving direction projection method, device, and electronic device.
  • the method, the device, and the electronic device can avoid projection in an area where an image defect or the like is easily unclear in a corner or other obstacles.
  • the display enhances the user's comfort in viewing the projected picture while enhancing the user's viewing experience while ensuring that the user always has the visual enjoyment of the projected picture.
  • FIG. 1 is a schematic flowchart of a projection area adaptive moving direction projection method according to an embodiment of the present application. Referring to FIG. 1, the method includes:
  • the panoramic image is a combined image of a plurality of images collected by using different angles to the surrounding environment
  • the panoramic image implementation manner of the collected projection environment includes: by changing an image capturing direction, Image acquisition is performed on the surrounding environment to obtain a plurality of images at different angles, and the panoramic image is synthesized based on the plurality of images.
  • the projection environment before performing image segmentation on the panoramic image, the projection environment may be first identified and analyzed, and a plurality of different segment regions may be formed according to different types and shapes of different objects in the projection environment.
  • the divided area divided in many cases includes a large area occupying a large part of a large area and a small area scattered in a large area, for example, a white wall has several small black areas.
  • the principle of the nearest merge may be adopted to merge the small area to the small area.
  • an alternative projection area is formed.
  • a wall has some small areas such as paintings or windows. You can combine small areas such as paintings or windows with large areas of the wall according to certain image processing algorithms, and merge the areas. Normalization is performed to obtain an alternative projection area. If there is more than one segmentation area connected, then a similarity rule can be defined (for example, the average pixel is used as the similarity reference, the smaller the average pixel difference is, the more similar), and the adjacent and most similar regions are merged.
  • the image may be filtered, for example, by selecting a suitable structural element to perform an etching operation on the image, and the large area color may cover some small areas.
  • an example image as shown in FIG. 2 can be obtained, in which the divided region includes a plurality of large regions 202 and many small regions. 201.
  • the small area 201 can be merged into the adjacent large area 202, so that, as shown in FIG. 3, the candidate projection area in the panoramic image can be obtained: the first candidate projection area 301 a second alternative projection area 302 and a third alternative projection area 303.
  • performing the score evaluation on the candidate projection area includes: performing scores on the plurality of candidate projection areas according to the area, the outline, the angle, the color, and the like of the candidate projection area. Evaluation. For example, the larger the area of the candidate projection area is, the better the consistency of the area is, the more convenient it is to adjust the projection angle, so that the score of the evaluation is higher; the more contours of the candidate projection area indicate the area There may be obstacles such as corners or ornaments, so that the scores evaluated are lower; the smaller the projection angle of the candidate projection area is, the higher the score is. The darker the color of the candidate projection area is. The clearer the effect of the projection display in this area, the higher the image contrast, and the higher the score scored.
  • the feature information includes area information such as an area, a position, a color, an angle, and a score of the candidate projection area.
  • storing the feature information corresponding to the plurality of candidate projection regions includes: recording a score of the plurality of candidate projection regions, and dividing the plurality of candidate projection regions according to different scores, for example, The plurality of candidate projection area addition markers prioritize the scores of the scores, and the higher the priority candidate regions are selected as the projection regions.
  • the “projection intention” is used to represent the direction in which the user's line of sight is located, which can be determined by tracking and identifying the user's line of sight.
  • the corresponding position of the projection intention in the panoramic image ie, the position information of the direction angle of the user's intentional projection
  • the corresponding position of the projection intention in the panoramic image may be first determined, and then based on the position, from the plurality of candidate projection regions Find the most suitable projection area; finally calculate the projection angle based on the most suitable projection area.
  • the feature information of all the candidate projection areas is recorded in the above step 104, and the area information includes area information such as area, position, color angle, score, etc.; therefore, in this embodiment, in order to eliminate the need for the user. Re-adjust the viewing angle to ensure that the user can always face the visual impression of the projected picture.
  • the user's projection intention is centered on the corresponding position in the panoramic image, and one or more candidate projection areas located near the center position are selected.
  • the selected one or more candidate projection regions are prioritized; and then a higher priority device is selected.
  • the projection area is selected as the most suitable projection area; finally, the projection angle is recalculated according to the position of the most suitable projection area, so that the projection picture falls into the most suitable projection area.
  • the corresponding position of the projection intention of the user in the panoramic image shown in FIG. 3 is the area 401.
  • the projection screen will fall to Different alternative projection areas (for example, falling on different wall surfaces) may cause unclear projection and distortion of the projected image, which may affect the user's viewing experience.
  • the candidate projection area near the region 401 can be found to be nearby: the first candidate projection area 301 and the second candidate projection area 302; by the feature information according to the two ( For example, the color is prioritized (for example, assuming that the hue of the projected content is closer to the hue of the first alternative projection area 301, the second alternative projection area 302 has a higher priority than the first in order to improve the contrast.
  • the candidate projection area 301) may determine that the second candidate projection area 302 is the most suitable projection area; finally, as shown in FIG. 5, calculate the projection angle according to the position information of the most suitable projection area, so that the projection screen 402 is made. Falling into the second alternative projection area 302.
  • the first alternative projection area 301 is taken as the most suitable projection area, and the projection angle is recalculated based on the position information of the first alternative projection area 301 such that the projected picture 403 falls into the first alternative projection area 301.
  • the projection lens may be rotated to project the projection angle.
  • correction of the projection screen may also be performed; wherein the correction of the projection screen includes correction of the shape and/or brightness of the projection content.
  • the beneficial effects of the embodiments of the present application are: different from the prior art, the present application discloses a projection area adaptive moving projection method, the method includes: collecting a panoramic image of a projection environment. Dividing the panoramic image into a plurality of divided regions, and forming a plurality of candidate projection regions based on the plurality of divided regions; performing score evaluation on the plurality of candidate projected regions; recording and saving the plurality of devices Selecting feature information corresponding to the projection area respectively, wherein the feature information includes a score of the candidate projection area; selecting the most suitable one according to the projection intention of the user and the feature information corresponding to the plurality of candidate projection areas respectively Projection area, calculate projection angle; project according to the projection angle.
  • FIG. 7 is a schematic structural diagram of a projection area adaptive motion projection apparatus according to an embodiment of the present application.
  • the motion projection device 70 includes:
  • the trigger activation unit 701 is configured to activate the motion projection device in a standby state.
  • FIG. 8 is a schematic structural diagram of a trigger activation unit of a projection area adaptive moving projection device according to an embodiment of the present disclosure
  • the trigger activation unit 701 includes:
  • a remote control module 801 configured to activate a moving projection system in a standby state by a user controlling a micro button device carried with the user;
  • a voice module 802 configured to start a standby projection system according to a corresponding voice command
  • the motion recognition module 803 is configured to receive a body language trigger such as a gesture collected by the image acquisition unit, and activate a motion projection system in a standby state.
  • the user can activate the moving projection device 70 in the standby state by controlling the micro button device, the corresponding voice command or the body language, which is carried by the user, wherein the moving projection device 70 is equipped with a central processing module (figure The central processing module is connected (not shown) and controls each unit in the moving projection device 70.
  • the central processing module can be activated by triggering the activation unit 701 (not shown) The activation of the motion projection device 70 is controlled.
  • the panoramic image collecting unit 702 is configured to collect a panoramic image of the projection environment
  • FIG. 9 is a schematic structural diagram of a panoramic image acquisition unit of a projection area adaptive moving projection device provided by an embodiment of the present application.
  • the panoramic image acquisition unit 702 includes:
  • the image acquisition module 901 is configured to collect an image of a projection environment
  • the first direction control module 902 is configured to change an acquisition direction of the image, so that the image acquisition module performs image acquisition of images of the projection environment at different angles to obtain multiple images.
  • the image synthesis module 903 is configured to synthesize a panoramic image of the projection environment according to the plurality of images.
  • the image acquisition module 901 changes the image collection direction of the surrounding environment by the first direction control module 902 to obtain multiple images at different angles, and uses the image synthesis module 903 to perform different angles. Multiple images are combined into a panoramic image.
  • the image processing unit 703 is configured to divide the panoramic image into a plurality of divided regions, and form a plurality of candidate projected regions based on the plurality of divided regions;
  • the projection environment may be first identified and analyzed, and formed according to different types and shapes of different objects in the projection environment. Different partition areas.
  • the segmentation area segmented by the image processing unit 703 in many cases includes a plurality of large areas occupying a large area and small areas scattered in a large area, for example, a small area on a white wall is small. Black spots.
  • the image processing unit 703 may adopt the principle of the nearest merge to merge the small areas nearby.
  • a large area adjacent to the small area thereby forming an alternative projection area.
  • a wall has some small areas such as paintings or windows. You can combine small areas such as paintings or windows with large areas of the wall according to certain image processing algorithms, and merge the areas. Normalization is performed to obtain an alternative projection area. If there is more than one segmentation area connected, then a similarity rule can be defined (for example, the average pixel is used as the similarity reference, the smaller the average pixel difference is, the more similar), and the adjacent and most similar regions are merged.
  • the image may be filtered, for example, by selecting a suitable structural element to perform an etching operation on the image, and the large area color may cover some small areas.
  • An image evaluation unit 704 configured to perform a score evaluation on the plurality of candidate projection regions
  • the image evaluation unit 704 performs a score evaluation on the plurality of candidate projection regions according to the area, the outline, the angle, the color, and the like of the candidate projection area.
  • the image evaluation unit 704 marks the first candidate projection area 301, the second candidate projection area 302, and the third candidate projection area 303 according to the evaluation criteria described above. Not shown in the figure), the selection priority of the candidate projection area is distinguished according to the mark.
  • the information recording unit 705 is configured to record and save feature information corresponding to each of the plurality of candidate projection regions;
  • the feature information includes area information such as an area, a position, a color, an angle, and a score of the candidate projection area.
  • the information recording unit 705 is specifically configured to: record a score of a plurality of candidate projection regions, and divide the plurality of candidate projection regions according to different scores, for example, by using the plurality of candidate projections
  • the area addition flag prioritizes the level of the score, and the higher the priority candidate area is selected as the projection area.
  • the calculation analysis unit 706 is configured to select a most suitable projection area according to the projection intention of the user and the feature information corresponding to the plurality of candidate projection areas, and calculate a projection angle;
  • the “projection intention” is used to represent the direction in which the user's line of sight is located, which can be determined by tracking and identifying the user's line of sight.
  • the calculation analysis unit 706 may first determine the position of the projection intention in the panoramic image (ie, the position information of the direction angle of the user's intentional projection), and then based on the position, from the plurality of Find the most suitable projection area in the candidate projection area; finally calculate the projection angle based on the most suitable projection area.
  • the feature information includes area information such as area, position, color angle, score, and the like; therefore, in the present embodiment, The user re-adjusts the viewing angle to ensure that the user can always face the visual impression of the projected picture.
  • the calculation analyzing unit 706 may first select one or more of the center position near the corresponding position in the panoramic image.
  • An alternative projection area then prioritizing the selected one or more candidate projection areas according to one or more of the feature information such as area, color, score, etc.; and then selecting a priority
  • the higher candidate projection area is used as the most suitable projection area; finally, the projection angle is recalculated according to the position of the most suitable projection area, so that the projection picture falls into the most suitable projection area.
  • the corresponding position of the projection intention of the user in the panoramic image shown in FIG. 3 is the area 401.
  • the projection screen will fall to Different alternative projection areas (for example, falling on different wall surfaces) may cause unclear projection and distortion of the projected image, which may affect the user's viewing experience.
  • the candidate projection area near the region 401 can be found to be nearby: the first candidate projection area 301 and the second candidate projection area 302; by the feature information according to the two ( For example, the color is prioritized (for example, assuming that the hue of the projected content is closer to the hue of the first alternative projection area 301, the second alternative projection area 302 has a higher priority than the first in order to improve the contrast.
  • the candidate projection area 301) may determine that the second candidate projection area 302 is the most suitable projection area; finally, as shown in FIG. 5, calculate the projection angle according to the position information of the most suitable projection area, so that the projection screen 402 is made. Falling into the second alternative projection area 302.
  • the moving projection device The apparatus 70 further includes a dynamic detection unit for dynamically detecting whether there is a moving object in the plurality of candidate projection areas, and if so, discarding an alternative projection area in which the active object exists. For example, as shown in FIG. 6, if the dynamic detecting unit detects that the moving object 405 exists in the second candidate projection area 302, the second candidate projection area may be discarded in order to avoid the occlusion of the user's line of sight by the moving object. 302.
  • the calculation analysis unit 706 can use the first candidate projection area 301 as the most suitable projection area, and then recalculate the projection angle based on the position information of the first candidate projection area 301, so that the projection screen 403 falls into the first In the alternative projection area 301.
  • a projection unit 707 configured to perform projection according to the projection angle
  • FIG. 10 is a schematic structural diagram of a projection unit of a projection area adaptive moving projection device according to an embodiment of the present application.
  • the projection unit 707 includes:
  • a second direction control module 1001 configured to perform projection according to the projection angle
  • Projection correction module 1002 for correction of projected images.
  • the projection lens may be rotated by the second direction control module 1001 to project the projection angle.
  • the correction of the projection screen may also be performed by the projection correction module 1002; wherein the correction of the projection screen includes correcting the shape and/or brightness of the projection content.
  • the panoramic image acquisition unit 702 collects images at different angles from the surrounding projection environment and merges them into a panoramic image.
  • the processing unit 703 divides the panoramic image into a plurality of divided regions, and forms a plurality of candidate projected regions based on the plurality of divided regions; the image evaluating unit 704 performs a score evaluation on the plurality of candidate projected regions,
  • the information recording unit 705 records feature information respectively corresponding to the plurality of candidate projection regions, wherein the feature information includes a score of the candidate projection region, and the calculation analysis unit 706 is based on a projection intention of the user and
  • the feature information corresponding to the plurality of candidate projection regions respectively selects a most suitable projection region to calculate a projection angle; and the projection unit 707 projects the projection according to the projection angle.
  • the beneficial effects of the embodiments of the present application are: different from the prior art, the present application discloses a projection area adaptive moving projection device, the device includes: a panoramic image acquisition unit, an image A processing unit, an image evaluation unit, an information recording unit, a calculation analysis unit, and a projection unit.
  • a panoramic image acquisition unit an image A processing unit
  • an image evaluation unit an information recording unit
  • a calculation analysis unit a projection unit.
  • the motion projection device 70 can perform the motion projection method provided by the embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method.
  • the motion projection method provided by the embodiment of the present application.
  • FIG. 11 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present disclosure.
  • the electronic device may be a projector or a related device capable of controlling a projection lens.
  • the electronic device 110 includes:
  • One or more processors 1101 and a memory 1102, one processor 1101 is taken as an example in FIG.
  • the processor 1101 and the memory 1102 may be connected by a bus or other means, and the connection in FIG. 1101 is taken as an example.
  • the memory 1102 is a non-volatile computer readable storage medium, and can be used for storing non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions corresponding to the motion projection method in the embodiment of the present application. / unit (for example, the trigger activation unit 701, the panoramic image acquisition unit 702, the image processing unit 703, the image evaluation unit 704, the information recording unit 705, the calculation analysis unit 706, and the projection unit 707 shown in FIG. 7).
  • the processor 1101 performs various functional applications and data processing of the electronic device 110 by executing non-volatile software programs, instructions, and units stored in the memory 1102, that is, implementing the dynamic projection method of the method embodiments.
  • the memory 1102 can include a stored program area that can store an operating system, an application required for at least one function, and a stored data area that can store data created according to the use of the moving projection device 70, and the like.
  • memory 1102 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 1102 can optionally include memory remotely located relative to processor 1101, which can be connected to electronic device 110 over a network.
  • Embodiments of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • the one or more units are stored in the memory 1102, and when executed by the one or more processors 1101, perform a method of motion projection as described above, for example, performing the method of FIG. 1 described above Steps 101 to 106 implement the functions of the units 701-707 in FIG.
  • the electronic device 110 can perform the motion projection method provided by the present application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the motion projection method provided by the present application.
  • Embodiments of the present application provide a non-transitory computer readable storage medium storing computer-executable instructions that are executed by one or more processors,
  • the functions of the units 701-707 in Fig. 7 can be implemented by performing the method steps 101 to 106 of Fig. 1 described above.
  • the device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical. Units can be located in one place or distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • the embodiments can be implemented by means of software plus a general hardware platform, and of course, by hardware.
  • One of ordinary skill in the art will appreciate that all or part of the processes for implementing the described embodiments may be performed by a computer program in a computer program product, the computer program being readable by a computer.
  • the computer program when executed, may include the flow of an embodiment of the methods as described.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

本申请实施例涉及投影显示技术领域，特别是涉及一种投影区域自适应的动向投影方法、装置及电子设备，其中，所述方法包括：采集投影环境的全景图像；将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；对所述多个备选投影区域进行分值评估；记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；根据所述投影角度进行投影。通过上述方法，可以避开在墙角或者有其他障碍物等容易引起图像畸形显示不清晰的区域进行投影显示，提高了用户观看投影画面的舒适感，增强了用户的观看体验。

Description

一种投影区域自适应的动向投影方法、装置及电子设备
相关申请的交叉参考
本申请要求于2017年12月31日提交中国专利局、申请号为201711494846.5、发明名称为“一种投影区域自适应的动向投影方法、装置及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及投影显示技术领域，特别是涉及一种投影区域自适应的动向投影方法、装置及电子设备。
背景技术
随着科学技术的发展和人民生活水平的不断提高，人们对视觉感受方面的要求越来越高，一方面，人们对人机界面的显示器件的要求越来越向着微型、大屏以及高分辨率方向发展；另一方面，在显示效果上，人们又倾向于追求增强现实、身临其境的视觉享受。目前，互动投影技术正逐渐进入人们的日常生活中，并且在逐步向追踪用户意向的方向发展。
发明人在实现本申请的过程中发现，现有的互动投影技术缺乏灵活性，当用户意向投影的方向因投影空间环境影响，投影显示效果会比较差，用户体验不好。
发明内容
有鉴于此，本申请的主要目的在于提供一种投影区域自适应的动向投影方法、装置及电子设备，以解决现有技术中当用户意向投影的方向因投影空间环境影响，投影显示效果会比较差，用户体验不好的问题。
为了解决上述的技术问题，本申请实施例公开了如下技术方案：
第一方面，本申请实施例提供了一种投影区域自适应的动向投影方法，包 括：
采集投影环境的全景图像；
将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；
对所述多个备选投影区域进行分值评估；
记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；
根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；
根据所述投影角度进行投影。
可选的，所述采集投影环境的全景图像包括：通过改变图像的采集方向，对投影环境的图像进行不同角度的图像采集，得到多个图像，并根据所述多个图像合成全景图像。
可选的，所述对所述多个备选投影区域进行分值评估包括：根据所述备选投影区域的区域要素对所述多个备选投影区域进行分值评估，所述区域要素包括面积、轮廓、角度以及颜色中的一种或者多种。
可选的，所述特征信息还包括：所述备选投影区域的面积、位置以及角度。
可选的，所述根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度的步骤之前还包括：
动态检测所述多个备选投影区域中是否存在活动物体；
如果存在，则舍弃存在所述活动物体的备选投影区域。
第二方面，本申请实施例提供了一种投影区域自适应的动向投影装置，所述装置包括：
全景图像采集单元，用于采集投影环境的全景图像；
图像处理单元，用于将所述全景图像分割为多个分割区域，并基于所述多 个分割区域形成多个备选投影区域；
图像评估单元，用于对所述多个备选投影区域进行分值评估；
信息记录单元，用于记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；
计算分析单元，用于根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；
投影单元，用于根据所述投影角度进行投影。
可选的，所述装置还包括：触发启动单元，所述触发启动单元用于启动待机状态的动向投影装置。
可选的，所述触发启动单元包括：
遥控模块，用于通过用户控制随身携带的微型按钮装置，启动待机状态的动向投影装置；和/或
语音模块，用于根据相应的语音指令，启动待机状态的动向投影装置；和/或
动作识别模块，用于接受图像采集单元采集的手势等肢体语言触发，启动待机状态的动向投影装置。
可选的，所述全景图像采集单元包括：
图像采集模块，用于采集投影环境的图像；
第一方向控制模块，用于改变图像的采集方向，以使所述图像采集模块对投影环境的图像进行不同角度的图像采集，得到多个图像；
图像合成模块，用于根据所述多个图像合成全景图像。
可选的，所述投影单元包括：
第二方向控制模块，用于根据所述投影角度进行投影；
投影校正模块，用于投影图像的校正。
第三方面，本申请实施例提供了一种电子设备，包括：
至少一个处理器；以及，
与所述至少一个处理器通信连接的存储器；其中，
所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如上所述的方法。
第四方面，本申请实施例提供了一种非易失性计算机可读存储介质，所述非易失性计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使电子设备执行如上所述的方法。
第五方面，本申请实施例提供了一种计算机程序产品，所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被电子设备执行时，使所述电子设备执行如上所述的方法。
本申请实施方式的有益效果是：区别于现有技术的情况，本申请公开了一种投影区域自适应的动向投影方法、装置及电子设备，通过将投影环境划分为多个备选投影区域，并在获取到用户的投影意向时，根据该投影意向的位置信息选取出最合适的备选投影区域进行投影，可以避开在墙角或者有其他障碍物等容易引起图像畸形显示不清晰的区域进行投影显示，在保证用户一直有正视投影画面的视觉享受的同时，提高了用户观看投影画面的舒适感，增强了用户的观看体验。
附图说明
一个或多个实施例通过与之对应的附图中的图片进行示例性说明，这些示例性说明并不构成对实施例的限定，附图中具有相同参考数字标号的元件表示为类似的元件，除非有特别申明，附图中的图不构成比例限制。
图1是本申请实施例提供的一种投影区域自适应的动向投影方法的流程示意图；
图2是本申请实施例提供的一种将全景图像分割为多个分割区域的示例图；
图3是本申请实施例提供的一种基于图2中多个分割区域形成多个备选投 影区域的示例图；
图4是本申请实施例提供的一种用户投影意向与图3所示的多个备选投影区域的位置关系示例图；
图5是本申请实施例提供的一种基于图4所示的位置关系选择投影区域的示例图；
图6是本申请实施例提供的另一种基于图4所示的位置关系选择投影区域的示例图；
图7是本申请实施例提供的一种投影区域自适应的动向投影装置的结构示意图；
图8是图7所示的投影区域自适应的动向投影装置的触发启动单元的结构示意图；
图9是图7所示的投影区域自适应的动向投影装置的全景图像采集单元的结构示意图；
图10是图7所示的投影区域自适应的动向投影装置的投影单元的结构示意图；
图11是本申请实施例提供的一种电子设备的硬件结构示意图。
具体实施方式
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
此外，下面所描述的本申请各个实施方式中所涉及到的技术特征只要彼此之间未构成冲突就可以相互组合。
本申请实施例提供投影区域自适应的动向投影方法、装置及电子设备，通过上述方法、装置及电子设备，可以避开在墙角或者有其他障碍物等容易引起 图像畸形显示不清晰的区域进行投影显示，在保证用户一直有正视投影画面的视觉享受的同时，提高了用户观看投影画面的舒适感，增强了用户的观看体验。
图1是本申请实施例提供的一种投影区域自适应的动向投影方法的流程示意图，请参照图1，所述方法包括：
101：采集投影环境的全景图像；
在本申请实施例中，所述全景图像为通过不同角度对周围环境进行采集的多个图像的合并图像，基于此，所述采集投影环境的全景图像实施方式包括：通过改变图像的采集方向，对周围环境进行图像采集，得到不同角度下的多个图像，并根据所述多个图像合成全景图像。
102：将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；
在本申请实施例中，对所述全景图像进行图像分割之前，可以首先对所述投影环境进行识别分析，通过根据所述投影环境中不同物体的种类形状的不同形成多个不同的分割区域。其中，在很多情况下分割出来的分割区域包括若干占据大部分面积的大区域以及零散地落在大区域中的小区域，例如，一面白墙上有几个面积不大黑点。
进一步地，由于小区域的面积一般很小，并不会对整体投影效果产生影响，因此，在本实施例中，可以采用就近合并的原则，将所述小区域就近合并到与所述小区域近邻的大区域中，从而形成备选投影区域。例如：某一墙面上具有一些挂画或者窗户等小区域，可以按照一定的图像处理算法，将这些挂画或者窗户等小区域与墙面这一大区域进行合并，并对合并后的区域进行归一化处理，从而得到一个备选投影区域。如果有不止一个分割区域相连，那么可以定义一个相似度的规则(比如，将平均像素作为相似度参考，平均像素差越小越相似)，将相邻且最相似的区域合并。或者，对所述图像进行滤波处理，比如，选取一个合适的结构元素，对图像进行腐蚀操作，附近大区域颜色就可以把一些小的区域覆盖。
举例来说，假设将某投影场景的全景图像分割为多个分割区域后可以得到 如图2所示的示例图，在该全景图像中，其分割区域包含了多个大区域202以及许多小区域201。根据一定的算法，可以将所述小区域201合并到相邻的大区域202中，从而，如图3所示，可以得到该全景图像中的备选投影区域包括：第一备选投影区域301、第二备选投影区域302以及第三备选投影区域303。
103：对所述多个备选投影区域进行分值评估；
在本申请实施例中，对所述备选投影区域进行分值评估包括：根据所述备选投影区域的面积、轮廓、角度、颜色等区域要素对所述多个备选投影区域进行分值评估。例如：所述备选投影区域的面积越大，表明该区域一致性越好，越方便调整投影角度，从而评估的分值越高；所述备选投影区域的轮廓线越多，表明该区域内可能存在边边角角或者摆件等障碍物，从而评估的分值越低；所述备选投影区域的投影角度调整越小评估的分值越高；所述备选投影区域的颜色越暗，在该区域进行投影显示的效果越清晰明显，图像对比度越高，从而评估的分值越高。
104：记录保存所述多个备选投影区域分别对应的特征信息；
在本申请实施例中，所述特征信息包括所述备选投影区域的面积、位置、颜色、角度、分值等区域信息。所述记录保存多个备选投影区域对应的特征信息包括：记录多个备选投影区域的分值，根据分值的不同将所述多个备选投影区域进行划分，例如：可以通过在所述多个备选投影区域添加标记对分值的高低进行优先级的区分，优先级越高的备选投影区域被选为投影区域的可能性越大。
105：根据用户的投影意向以及所述多个备选投影区域对应的特征信息，选择最适合的投影区域，计算投影角度；
在本申请实施例中，所述“投影意向”用于表征用户的视线所在的方向，其可以通过对用户的视线进行追踪识别来确定。当获取到用户的投影意向时，可以首先确定该投影意向在全景图像中对应的位置(即，用户意向投影的方向角度的位置信息)，然后基于该位置，从所述多个备选投影区域中寻找出一个最合适的投影区域；最后根据该最合适的投影区域计算投影角度。
其中，由于上述步骤104已经记录保存有所有备选投影区域的特征信息，并且，该特征信息中包括面积、位置、颜色角度、分值等区域信息；因此，在本实施例中，为了无需用户重新调整观看角度，保证用户可以一直有正视投影画面的视觉感受，可以首先以用户的投影意向在全景图像中对应的位置为中心，选择出位于该中心位置附近的一个或者多个备选投影区域；然后再根据面积、颜色、分值等特征信息中的一种或者多种，对选择出的所述一个或者多个备选投影区域进行优先级排列；进而选择出一个优先级较高的备选投影区域作为最合适的投影区域；最后根据该最合适的投影区域所在的位置重新计算投影角度，以使投影画面落入该最合适的投影区域中。
举例来说，如图4所示，假设用户的投影意向在图3所示的全景图像中对应的位置为区域401，此时，若直接根据用户的投影意向进行投影，其投影画面会落到不同的备选投影区域上(比如，落在不同的墙面上)，容易造成投影不清晰、投影画面产生畸变等情况，影响用户的观看体验。因此，在本实施例中，以区域401为中心，可以寻找到其附近的备选投影区域包括：第一备选投影区域301和第二备选投影区域302；通过根据两者的特征信息(比如，颜色)进行优先级排列(比如，假设投影内容的色调与第一备选投影区域301的色调更为接近，则为了能够提高对比度，第二备选投影区域302的优先级高于第一备选投影区域301)，可以确定第二备选投影区域302为最合适的投影区域；最后，如图5所示，根据该最合适的投影区域的位置信息计算投影角度，以使投影画面402落入第二备选投影区域302。
进一步地，考虑到在实际应用场景中，有可能会存在人员或者其他可移动物体在某些备选投影区域中走动，不利于提升用户的观看体验，在一些实施例中，在根据用户的投影意向以及所述多个备选投影区域对应的特征信息，选择最适合的投影区域，计算投影角度之前，还动态检测所述多个备选投影区域中是否存在活动物体，如果存在，则舍弃存在所述活动物体的备选投影区域。比如，如图6所示，若此时动态检测到第二备选投影区域302中存在活动物体405，则，为了避开活动物体对用户视线的遮挡，可以舍弃第二备选投影区域302，从 而，将第一备选投影区域301作为最合适的投影区域，进而基于第一备选投影区域301的位置信息重新计算投影角度，以使投影画面403落入第一备选投影区域301中。
106：根据所述投影角度进行投影。
在本申请实施例中，在确定了投影角度后，可以将投影镜头转动所述投影角度进行投影。其中，所述根据所述投影角度进行投影时，还可以进行投影画面的校正；其中所述投影画面的校正包括对投影内容进行外形和/或亮度的校正。
通过上述技术方案可知，本申请实施例的有益效果是：区别于现有技术的情况下，本申请公开了一种投影区域自适应的动向投影方法，所述方法包括：采集投影环境的全景图像；将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；对所述多个备选投影区域进行分值评估；记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；根据所述投影角度进行投影。通过上述方法，可以避开在墙角或者有其他障碍物等容易引起图像畸形显示不清晰的区域进行投影显示，在保证用户一直有正视投影画面的视觉享受的同时，提高了用户观看投影画面的舒适感，增强了用户的观看体验。
图7是本申请实施例提供的一种投影区域自适应的动向投影装置的结构示意图。请参阅图7，所述动向投影装置70包括：
触发启动单元701，用于启动待机状态的所述动向投影装置。
请结合图8，图8是本申请实施例提供的一种投影区域自适应的动向投影装置的触发启动单元的结构示意图；
所述触发启动单元701包括：
遥控模块801，用于通过用户控制随身携带的微型按钮装置，启动待机状态的动向投影系统；和/或
语音模块802，用于根据相应的语音指令，启动待机状态的动向投影系统；和/或
动作识别模块803，用于接受图像采集单元采集的手势等肢体语言触发，启动待机状态的动向投影系统。
在本申请实施例中，用户可以通过控制随身携带的微型按钮装置，相应的语音指令或者肢体语言，启动待机状态的动向投影装置70，其中，所述动向投影装置70装有中央处理模块(图中未示出)，所述中央处理模块连接(图中未示出)并控制着所述动向投影装置70中的各单元，通过触发启动单元701可以启动所述中央处理模块(图中未示出)控制所述动向投影装置70的启动。
全景图像采集单元702，用于采集投影环境的全景图像；
请结合图9，图9是本申请实施例提供的一种投影区域自适应的动向投影装置的全景图像采集单元的结构示意图；
所述全景图像采集单元702包括：
图像采集模块901，用于采集投影环境的图像；
第一方向控制模块902，用于改变图像的采集方向，以使所述图像采集模块对投影环境的图像进行不同角度的图像采集，得到多个图像；
图像合成模块903，用于根据所述多个图像合成所述投影环境的全景图像。
在本申请实施例中，所述图像采集模块901通过第一方向控制模块902改变周围环境的图像采集方向，得到不同角度下的多个图像，并通过所述图像合成模块903将不同角度下的多个图像合成全景图像。
图像处理单元703，用于将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；
在本申请实施例中，所述图像处理单元703对所述全景图像进行图像分割之前，可以首先对所述投影环境进行识别分析，通过根据所述投影环境中不同物体的种类形状的不同形成多个不同的分割区域。其中，在很多情况下所述图像处理单元703分割出来的分割区域包括若干占据大部分面积的大区域以及零散地落在大区域中的小区域，例如，一面白墙上有几个面积不大黑点。
进一步地，由于小区域的面积一般很小，并不会对整体投影效果产生影响，因此，在本实施例中，所述图像处理单元703可以采用就近合并的原则，将所 述小区域就近合并到与所述小区域近邻的大区域中，从而形成备选投影区域。例如：某一墙面上具有一些挂画或者窗户等小区域，可以按照一定的图像处理算法，将这些挂画或者窗户等小区域与墙面这一大区域进行合并，并对合并后的区域进行归一化处理，从而得到一个备选投影区域。如果有不止一个分割区域相连，那么可以定义一个相似度的规则(比如，将平均像素作为相似度参考，平均像素差越小越相似)，将相邻且最相似的区域合并。或者，对所述图像进行滤波处理，比如，选取一个合适的结构元素，对图像进行腐蚀操作，附近大区域颜色就可以把一些小的区域覆盖。
图像评估单元704，用于对所述多个备选投影区域进行分值评估；
在本申请实施例中，所述图像评估单元704根据所述备选投影区域的面积、轮廓、角度、颜色等区域要素对所述多个备选投影区域进行分值评估。例如：所述备选投影区域的面积越大，表明该区域一致性越好，越方便调整投影角度，从而评估的分值越高；所述备选投影区域的轮廓线越多，表明该区域内可能存在边边角角或者人、摆件等障碍物，从而评估的分值越低；所述备选投影区域的投影角度调整越小评估的分值越高；所述备选投影区域的颜色越暗，在该区域进行投影显示的效果越清晰明显，图像对比度越高，从而评估的分值越高。
请参照图3，根据上述所示评估标准，所述图像评估单元704通过对所述第一备选投影区域301、第二备选投影区域302以及第三备选投影区域303进行标记(标记方式图中未示出)，根据标记区分所述备选投影区域的选取优先级。
信息记录单元705，用于记录保存所述多个备选投影区域分别对应的特征信息；
在本申请实施例中，所述特征信息包括所述备选投影区域的面积、位置、颜色、角度、分值等区域信息。所述信息记录单元705具体用于：记录多个备选投影区域的分值，根据分值的不同将所述多个备选投影区域进行划分，例如：可以通过在所述多个备选投影区域添加标记对分值的高低进行优先级的区分，优先级越高的备选投影区域被选为投影区域的可能性越大。
计算分析单元706，用于根据用户的投影意向以及所述多个备选投影区域对 应的特征信息，选择最适合的投影区域，计算投影角度；
在本申请实施例中，所述“投影意向”用于表征用户的视线所在的方向，其可以通过对用户的视线进行追踪识别来确定。当获取到用户的投影意向时，计算分析单元706可以首先确定该投影意向在全景图像中对应的位置(即，用户意向投影的方向角度的位置信息)，然后基于该位置，从所述多个备选投影区域中寻找出一个最合适的投影区域；最后根据该最合适的投影区域计算投影角度。
其中，由于信息记录单元705已经记录保存有所有备选投影区域的特征信息，并且，该特征信息中包括面积、位置、颜色角度、分值等区域信息；因此，在本实施例中，为了无需用户重新调整观看角度，保证用户可以一直有正视投影画面的视觉感受，计算分析单元706可以首先以用户的投影意向在全景图像中对应的位置为中心，选择出位于该中心位置附近的一个或者多个备选投影区域；然后再根据面积、颜色、分值等特征信息中的一种或者多种，对选择出的所述一个或者多个备选投影区域进行优先级排列；进而选择出一个优先级较高的备选投影区域作为最合适的投影区域；最后根据该最合适的投影区域所在的位置重新计算投影角度，以使投影画面落入该最合适的投影区域中。
举例来说，如图4所示，假设用户的投影意向在图3所示的全景图像中对应的位置为区域401，此时，若直接根据用户的投影意向进行投影，其投影画面会落到不同的备选投影区域上(比如，落在不同的墙面上)，容易造成投影不清晰、投影画面产生畸变等情况，影响用户的观看体验。因此，在本实施例中，以区域401为中心，可以寻找到其附近的备选投影区域包括：第一备选投影区域301和第二备选投影区域302；通过根据两者的特征信息(比如，颜色)进行优先级排列(比如，假设投影内容的色调与第一备选投影区域301的色调更为接近，则为了能够提高对比度，第二备选投影区域302的优先级高于第一备选投影区域301)，可以确定第二备选投影区域302为最合适的投影区域；最后，如图5所示，根据该最合适的投影区域的位置信息计算投影角度，以使投影画面402落入第二备选投影区域302。
进一步地，考虑到在实际应用场景中，有可能会存在人员或者其他可移动物体在某些备选投影区域中走动，不利于提升用户的观看体验，在一些实施例中，所述动向投影装置装置70还包括动态检测单元，用于动态检测所述多个备选投影区域中是否存在活动物体，如果存在，则舍弃存在所述活动物体的备选投影区域。比如，如图6所示，若此时动态检测单元检测到第二备选投影区域302中存在活动物体405，则，为了避开活动物体对用户视线的遮挡，可以舍弃第二备选投影区域302，从而，计算分析单元706可以将第一备选投影区域301作为最合适的投影区域，进而基于第一备选投影区域301的位置信息重新计算投影角度，以使投影画面403落入第一备选投影区域301中。
投影单元707，用于根据所述投影角度进行投影；
请结合图10，图10是本申请实施例提供的一种投影区域自适应的动向投影装置的投影单元的结构示意图；
所述投影单元707包括：
第二方向控制模块1001，用于根据所述投影角度进行投影；
投影校正模块1002，用于投影图像的校正。
在本申请实施例中，在确定了投影角度后，可以通过第二方向控制模块1001将投影镜头转动所述投影角度进行投影。其中，所述根据所述投影角度进行投影时，还可以通过投影校正模块1002进行投影画面的校正；其中所述投影画面的校正包括对投影内容进行外形和/或亮度的校正。
在本申请实施例中，所述触发启动单元701启动所述全景图像采集单元702后，所述全景图像采集单元702对周围投影环境以不同的角度进行图像采集并合并成全景图像，所述图像处理单元703将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；图像评估单元704对所述多个备选投影区域进行分值评估，所述信息记录单元705记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值，所述计算分析单元706根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；所述投影单元 707根据所述投影角度进行投影。
通过上述技术方案可知，本申请实施例的有益效果是：区别于现有技术的情况下，本申请公开了一种投影区域自适应的动向投影装置，所述装置包括：全景图像采集单元、图像处理单元、图像评估单元、信息记录单元、计算分析单元以及投影单元。通过上述装置，可以避开在墙角或者有其他障碍物等容易引起图像畸形显示不清晰的区域进行投影显示，在保证用户一直有正视投影画面的视觉享受的同时，提高了用户观看投影画面的舒适感，增强了用户的观看体验。
需要说明的是，在本申请实施例中，所述动向投影装置70可执行本申请实施例所提供的动向投影方法，具备执行方法相应的功能模块和有益效果。未在动向投影装置70的实施例中详尽描述的技术细节，可参见本申请实施例所提供的动向投影方法。
图11是本申请实施例提供的一种电子设备的硬件结构示意图，该电子设备具体可以为投影仪或者能够控制投影镜头的相关设备。
具体地，如图11所示，该电子设备110包括：
一个或多个处理器1101以及存储器1102，图11中以一个处理器1101为例。
处理器1101和存储器1102可以通过总线或者其他方式连接，图1101中以通过总线连接为例。
存储器1102作为一种非易失性计算机可读存储介质，可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块，如本申请实施例中的动向投影方法对应的程序指令/单元(例如，附图7所示的触发启动单元701、全景图像采集单元702、图像处理单元703、图像评估单元704、信息记录单元705、计算分析单元706以及投影单元707)。处理器1101通过运行存储在存储器1102中的非易失性软件程序、指令以及单元，从而执行电子设备110的各种功能应用以及数据处理，即实现所述方法实施例的动向投影方法。
存储器1102可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储根据动向投影 装置70的使用所创建的数据等。此外，存储器1102可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中，存储器1102可选包括相对于处理器1101远程设置的存储器，这些远程存储器可以通过网络连接至电子设备110。所述网络的实施例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。
所述一个或者多个单元存储在所述存储器1102中，当被所述一个或者多个处理器1101执行时，执行如上所述的动向投影的方法，例如，执行以上描述的图1中的方法步骤101至步骤106，实现图7中的单元701-707的功能。
电子设备110可执行本申请所提供的动向投影方法，具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节，可参见本申请提供的动向投影方法。
本申请实施例提供了一种非易失性计算机可读存储介质，所述非易失性计算机可读存储介质存储有计算机可执行指令，该计算机可执行指令被一个或多个处理器执行，可执行以上描述的图1中的方法步骤101至步骤106，实现图7中的单元701-707的功能。
需要说明的是，以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。
通过以上的实施例的描述，本领域普通技术人员可以清楚地了解到各实施例可借助软件加通用硬件平台的方式来实现，当然也可以通过硬件。本领域普通技术人员可以理解实现所述实施例方法中的全部或部分流程是可以通过计算机程序产品中的计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一计算机可读取存储介质中，该计算机程序在执行时，可包括如所述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体 (Read-Only Memory,ROM)或随机存储记忆体(RandomAccessMemory,RAM)等。
最后应说明的是：以上实施例仅用以说明本申请的技术方案，而非对其限制；在本申请的思路下，以上实施例或者不同实施例中的技术特征之间也可以进行组合，步骤可以以任意顺序实现，并存在如上所述的本申请的不同方面的许多其它变化，为了简明，它们没有在细节中提供；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (13)

  1. 一种投影区域自适应的动向投影方法，其特征在于，所述方法包括：
    采集投影环境的全景图像；
    将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；
    对所述多个备选投影区域进行分值评估；
    记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；
    根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；
    根据所述投影角度进行投影。
  2. 根据权利要求1所述的动向投影方法，其特征在于，所述采集投影环境的全景图像包括：通过改变图像的采集方向，对投影环境的图像进行不同角度的图像采集，得到多个图像，并根据所述多个图像合成全景图像。
  3. 根据权利要求1所述的动向投影方法，其特征在于，所述对所述多个备选投影区域进行分值评估包括：根据所述备选投影区域的区域要素对所述多个备选投影区域进行分值评估，所述区域要素包括面积、轮廓、角度以及颜色中的一种或者多种。
  4. 根据权利要求1所述的动向投影方法，其特征在于，所述特征信息还包括：所述备选投影区域的面积、位置以及角度。
  5. 根据权利要求1所述的动向投影方法，其特征在于，所述根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度的步骤之前还包括：
    动态检测所述多个备选投影区域中是否存在活动物体；
    如果存在，则舍弃存在所述活动物体的备选投影区域。
  6. 一种投影区域自适应的动向投影装置，其特征在于，所述装置包括：
    全景图像采集单元，用于采集投影环境的全景图像；
    图像处理单元，用于将所述全景图像分割为多个分割区域，并基于所述多个分割区域形成多个备选投影区域；
    图像评估单元，用于对所述多个备选投影区域进行分值评估；
    信息记录单元，用于记录保存所述多个备选投影区域分别对应的特征信息，其中，所述特征信息包括所述备选投影区域的分值；
    计算分析单元，用于根据用户的投影意向以及所述多个备选投影区域分别对应的特征信息，选择最适合的投影区域，计算投影角度；
    投影单元，用于根据所述投影角度进行投影。
  7. 根据权利要求6所述的动向投影装置，其特征在于，所述装置还包括：触发启动单元，所述触发启动单元用于启动待机状态的动向投影装置。
  8. 根据权利要求6所述动向投影装置，其特征在于，所述触发启动单元包括：
    遥控模块，用于通过用户控制随身携带的微型按钮装置，启动待机状态的动向投影装置；和/或
    语音模块，用于根据相应的语音指令，启动待机状态的动向投影装置；和/或
    动作识别模块，用于接受图像采集单元采集的手势等肢体语言触发，启动待机状态的动向投影装置。
  9. 根据权利要求6所述的动向投影装置，其特征在于，所述全景图像采集单元包括：
    图像采集模块，用于采集投影环境的图像；
    第一方向控制模块，用于改变图像的采集方向，以使所述图像采集模块对投影环境的图像进行不同角度的图像采集，得到多个图像；
    图像合成模块，用于根据所述多个图像合成全景图像。
  10. 根据权利要求6所述的动向投影装置，其特征在于，所述投影单元包括：
    第二方向控制模块，用于根据所述投影角度进行投影；
    投影校正模块，用于对投影图像的校正。
  11. 一种电子设备，其特征在于，包括：
    至少一个处理器；以及，
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行权利要求1-5的任一项所述的方法。
  12. 一种非易失性计算机可读存储介质，其特征在于，所述非易失性计算机可读存储介质存储有计算机可执行指令，所述计算机可执行指令用于使电子设备能够执行权利要求1-5的任一项所述的方法。
  13. 一种计算机程序产品，其特征在于，所述计算机程序产品包括存储在计算机可读存储介质上的计算机程序，所述计算机程序包括程序指令，当所述程序指令被电子设备执行时，使所述电子设备执行如权利要求1-5任一项所述的方法。
PCT/CN2018/089304 2017-12-31 2018-05-31 一种投影区域自适应的动向投影方法、装置及电子设备 WO2019128101A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711494846.5 2017-12-31
CN201711494846.5A CN109996051B (zh) 2017-12-31 2017-12-31 一种投影区域自适应的动向投影方法、装置及系统

Publications (1)

Publication Number Publication Date
WO2019128101A1 true WO2019128101A1 (zh) 2019-07-04

Family

ID=67062985

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/089304 WO2019128101A1 (zh) 2017-12-31 2018-05-31 一种投影区域自适应的动向投影方法、装置及电子设备

Country Status (2)

Country Link
CN (1) CN109996051B (zh)
WO (1) WO2019128101A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031298B (zh) 2019-11-12 2021-12-10 广景视睿科技（深圳）有限公司 控制投影模块投影的方法、装置和投影系统
CN111182212B (zh) * 2019-12-31 2021-08-24 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质以及电子设备
CN114071094A (zh) * 2020-07-30 2022-02-18 奥图码科技股份有限公司 投影设备以及投影方法
CN114520895B (zh) * 2020-11-18 2022-11-15 成都极米科技股份有限公司 投影控制方法、装置、投影光机及可读存储介质
US11942008B2 (en) 2020-12-29 2024-03-26 Iview Displays (Shenzhen) Company Ltd. Smart tracking-based projection method and system
CN112702587A (zh) * 2020-12-29 2021-04-23 广景视睿科技（深圳）有限公司 一种智能跟踪投影方法及系统
CN113473095B (zh) * 2021-05-27 2022-10-21 广景视睿科技（深圳）有限公司 一种避障动向投影的方法和设备
CN113840126A (zh) * 2021-09-16 2021-12-24 广景视睿科技（深圳）有限公司 一种控制投影设备的方法、装置及投影设备
CN114245091B (zh) * 2022-01-27 2023-02-17 美的集团(上海)有限公司 投影位置修正方法、投影定位方法及控制装置、机器人
CN114740681B (zh) * 2022-04-19 2023-10-03 深圳市和天创科技有限公司 一种配置旋转镜头的单片液晶投影仪的智能测距调节系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1460918A (zh) * 2002-05-20 2003-12-10 精工爱普生株式会社 投影式图像显示系统、投影仪、信息存储介质和投影方法
CN103873800A (zh) * 2012-12-18 2014-06-18 联想(北京)有限公司 一种投影显示图像调节方法及电子设备
CN105262968A (zh) * 2015-10-22 2016-01-20 神画科技（深圳）有限公司 自动调整投影画面位置的投影系统及其投影方法
CN105739096A (zh) * 2016-03-08 2016-07-06 苏州佳世达电通有限公司 一种智能眼镜及智能投影显示方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4009850B2 (ja) * 2002-05-20 2007-11-21 セイコーエプソン株式会社 投写型画像表示システム、プロジェクタ、プログラム、情報記憶媒体および画像投写方法
CN104754262A (zh) * 2013-12-30 2015-07-01 光宝科技股份有限公司 投影显示装置及其相关显示方法
JP6711284B2 (ja) * 2015-02-03 2020-06-17 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
CN106797455A (zh) * 2016-12-23 2017-05-31 深圳前海达闼云端智能科技有限公司 一种投影方法、装置及机器人
CN107027014A (zh) * 2017-03-23 2017-08-08 广景视睿科技（深圳）有限公司 一种动向智能投影系统及其方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1460918A (zh) * 2002-05-20 2003-12-10 精工爱普生株式会社 投影式图像显示系统、投影仪、信息存储介质和投影方法
CN103873800A (zh) * 2012-12-18 2014-06-18 联想(北京)有限公司 一种投影显示图像调节方法及电子设备
CN105262968A (zh) * 2015-10-22 2016-01-20 神画科技（深圳）有限公司 自动调整投影画面位置的投影系统及其投影方法
CN105739096A (zh) * 2016-03-08 2016-07-06 苏州佳世达电通有限公司 一种智能眼镜及智能投影显示方法

Also Published As

Publication number Publication date
CN109996051B (zh) 2021-01-05
CN109996051A (zh) 2019-07-09

Similar Documents

Publication Publication Date Title
WO2019128101A1 (zh) 一种投影区域自适应的动向投影方法、装置及电子设备
US11194388B2 (en) Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device
US9516214B2 (en) Information processing device and information processing method
US11562471B2 (en) Arrangement for generating head related transfer function filters
KR101660576B1 (ko) 시각 장애 사용자들에 의한 이미지 캡처 및 이미지 검토의 촉진
KR20140076632A (ko) 얼굴 검출을 이용한 이미지 재구성
CN109274891B (zh) 一种图像处理方法、装置及其存储介质
JP2005311888A (ja) 拡大表示装置及び拡大画像制御装置
US20090251557A1 (en) Image pickup control method and apparatus for camera
JP5949030B2 (ja) 画像生成装置、画像生成方法及びプログラム
JP6892524B2 (ja) 対象追跡に基づくスローモーションビデオキャプチャ
JP2017199289A (ja) 情報処理装置、その制御方法、プログラム、及び記憶媒体
US10964046B2 (en) Information processing apparatus and non-transitory computer readable medium storing information processing program for estimating face orientation by using an omni-directional camera
US20210005024A1 (en) Image display control apparatus and image display control program
KR102159767B1 (ko) 시선 추적을 이용한 시인성 개선 방법, 저장 매체 및 전자 장치
JP2014006604A (ja) 画像生成装置、画像生成方法及びプログラム
KR20200111144A (ko) 시선 추적을 이용한 시인성 개선 방법, 저장 매체 및 전자 장치
JP6460510B2 (ja) 画像処理装置、画像処理方法及びプログラム
US10783853B2 (en) Image provision device, method and program that adjusts eye settings based on user orientation
JP7270052B2 (ja) 表示方法、及び、映像処理方法
US20230291998A1 (en) Electronic apparatus, method for controlling the same, and computer-readable storage medium storing program
JP7110657B2 (ja) 画像処理装置、画像処理方法およびプログラム
JP5398359B2 (ja) 情報処理装置、撮像装置及び制御方法
JP2014048767A (ja) 画像生成装置、画像生成方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18897458

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13.11.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18897458

Country of ref document: EP

Kind code of ref document: A1