WO2022241714A1 - Aerial imaging interactive system - Google Patents

Aerial imaging interactive system Download PDF

Info

Publication number
WO2022241714A1
WO2022241714A1 PCT/CN2021/094881 CN2021094881W WO2022241714A1 WO 2022241714 A1 WO2022241714 A1 WO 2022241714A1 CN 2021094881 W CN2021094881 W CN 2021094881W WO 2022241714 A1 WO2022241714 A1 WO 2022241714A1
Authority
WO
WIPO (PCT)
Prior art keywords
component
coordinates
tactile feedback
signal
imaging
Prior art date
Application number
PCT/CN2021/094881
Other languages
French (fr)
Chinese (zh)
Inventor
陈永新
曾宏
黄彦钊
Original Assignee
深圳盈天下视觉科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳盈天下视觉科技有限公司 filed Critical 深圳盈天下视觉科技有限公司
Priority to PCT/CN2021/094881 priority Critical patent/WO2022241714A1/en
Priority to CN202180001220.4A priority patent/CN113906372A/en
Publication of WO2022241714A1 publication Critical patent/WO2022241714A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means

Definitions

  • At least one set of infrared touch components connected to the control component for forming an infrared detection network on the surface of the virtual screen, and sending the coordinates of the touch point to the control component when a second preset signal is detected;
  • the tactile feedback component is an ultrasonic tactile device, and correspondingly, the tactile feedback signal is an ultrasonic signal.
  • FIG. 5 is a schematic diagram of the working principle of the tactile feedback component provided by the embodiment of the present application.
  • the first preset signal can be triggered through the control component 11 .
  • the first preset signal is used to instruct the aerial imaging component 12 to form a virtual screen 15 in the air.
  • the infrared receiving unit 132 is used for receiving the above-mentioned infrared rays.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An aerial imaging interactive system (10), comprising: a control component (11), which is used to send a first signal to an aerial imaging component (12) when a first preset signal is detected; the aerial imaging component (12), which is connected to the control component (11) and used to form a virtual screen (15) in the air when receiving the first signal and display a first image on the virtual screen (15); at least one infrared touch component (13), which is connected to the control component (11) and is used to form an infrared detection network on the surface of the virtual screen (15) and send coordinates of a touch point to the control component (11) when a second preset signal is detected, wherein the control component (11) is further used to send the coordinates to a haptic feedback component (14) when the coordinates are received; and the haptic feedback component (14), which is connected to the control component (11) and used to send, when receiving the coordinates, a haptic feedback signal to the touch point on the basis of the coordinates. The aerial imaging interactive system (10) can realize a haptic feedback effect when a user touch event occurs.

Description

一种空中成像交互系统An aerial imaging interactive system 技术领域technical field
本申请涉及空中交互技术领域,具体涉及一种空中成像交互系统。The present application relates to the technical field of aerial interaction, in particular to an aerial imaging interactive system.
背景技术Background technique
空中成像技术是一种无需使用介质作为屏幕,也无需专门的眼镜才能观看,即可将影像显示在空中,且用户伸手可穿透性的触摸到影像的技术。Aerial imaging technology is a technology that can display images in the air without using a medium as a screen or special glasses to watch, and the user can reach out and touch the image penetratingly.
现有的空中成像交互系统通常是通过红外触摸传感器在空气成像区域内形成手势检测区域,并在手势检测区域检测到相应手势时,在空气成像区域内反馈与该手势相对应的显示内容。Existing aerial imaging interaction systems usually use infrared touch sensors to form a gesture detection area in the air imaging area, and when a corresponding gesture is detected in the gesture detection area, the display content corresponding to the gesture is fed back in the air imaging area.
技术问题technical problem
本申请实施例的目的之一在于:提供一种空中成像交互系统。One of the objectives of the embodiments of the present application is to provide an aerial imaging interaction system.
技术解决方案technical solution
本申请实施例采用的技术方案是:The technical scheme that the embodiment of the present application adopts is:
第一方面,提供了一种空中成像交互系统,包括:In the first aspect, an aerial imaging interactive system is provided, including:
控制组件,用于在检测到第一预设信号时,向空气成像组件发送第一信号;a control component, configured to send a first signal to the air imaging component when a first preset signal is detected;
所述空气成像组件,与所述控制组件连接,用于在接收到所述第一信号时,在空气中形成虚拟屏幕,并在所述虚拟屏幕上显示第一图像;The air imaging component is connected with the control component, and is used to form a virtual screen in the air when receiving the first signal, and display a first image on the virtual screen;
至少一组红外触摸组件,与所述控制组件连接,用于在所述虚拟屏幕的表面形成红外探测网,并在检测到第二预设信号时,向所述控制组件发送触摸点的坐标;At least one set of infrared touch components connected to the control component for forming an infrared detection network on the surface of the virtual screen, and sending the coordinates of the touch point to the control component when a second preset signal is detected;
所述控制组件还用于在接收到所述坐标时,向触觉反馈组件发送所述坐标;The control component is further configured to send the coordinates to the tactile feedback component when the coordinates are received;
所述触觉反馈组件,与所述控制组件连接,用于在接收到所述坐标时,基于所述坐标向所述触摸点发送触觉反馈信号。The tactile feedback component is connected with the control component and configured to send a tactile feedback signal to the touch point based on the coordinates when the coordinates are received.
在一个实施例中,所述控制组件还用于在接收到所述坐标时,基于预先存储的预设坐标和预设图像之间的对应关系,向所述空气成像组件发送第三信号;In one embodiment, the control component is further configured to send a third signal to the air imaging component based on the pre-stored correspondence between preset coordinates and preset images when receiving the coordinates;
相应的,所述空气成像组件还用于在接收到所述第三信号后,将所述虚拟屏幕上显示的第一图像更换至与所述坐标相对应的目标图像。Correspondingly, the air imaging component is further configured to replace the first image displayed on the virtual screen with a target image corresponding to the coordinates after receiving the third signal.
在一个实施例中,所述空气成像组件包括:显示单元和空气成像板;In one embodiment, the air imaging assembly includes: a display unit and an air imaging plate;
所述显示单元,用于向所述空气成像板发射预设光线,并显示需要投影的投影图像;The display unit is configured to emit preset light to the air imaging plate and display a projection image to be projected;
所述空气成像板,用于将所述显示单元发射的预设光线折射至空气中形成虚拟屏幕,并将所述投影图像产生的光线折射至所述虚拟屏幕,以在所述虚拟屏幕上显示与所述投影图像相对应的所述第一图像。The air imaging plate is used to refract the preset light emitted by the display unit into the air to form a virtual screen, and refract the light generated by the projected image to the virtual screen for display on the virtual screen The first image corresponds to the projected image.
在一个实施例中,所述显示单元与所述触觉反馈组件平行,所述空气成像板设置于所述触觉反馈组件与所述显示单元之间,且分别与所述触觉反馈组件、所述显示单元形成预设角度;In one embodiment, the display unit is parallel to the tactile feedback component, the air imaging plate is arranged between the tactile feedback component and the display unit, and is connected to the tactile feedback component and the display unit respectively. The unit forms a preset angle;
相应的,所述触觉反馈组件还用于:在接收到所述坐标时,确定在所述显示单元中,以所述空气成像板所在平面为对称平面,与所述坐标相对称的对称坐标。Correspondingly, the tactile feedback component is further configured to: when receiving the coordinates, determine symmetrical coordinates in the display unit that are symmetrical to the coordinates, taking the plane where the air imaging plate is located as a symmetric plane.
在一个实施例中,所述触觉反馈组件还用于:向所述对称坐标发送所述触觉反馈信号;In one embodiment, the tactile feedback component is further configured to: send the tactile feedback signal to the symmetrical coordinates;
相应的,所述空气成像板还用于将所述触觉反馈信号反射至所述触摸点所在的坐标处。Correspondingly, the air imaging board is also used to reflect the tactile feedback signal to the coordinates of the touch point.
在一个实施例中,所述红外触摸组件还用于:在检测到所述第二预设信号,且所述触摸点的面积大于第一预设面积阈值,且小于第二预设面积阈值时,向所述控制组件发送所述触摸点的坐标。In one embodiment, the infrared touch component is further configured to: when the second preset signal is detected, and the area of the touch point is larger than the first preset area threshold and smaller than the second preset area threshold , sending the coordinates of the touch point to the control component.
在一个实施例中,所述红外触摸组件具体包括:红外发射单元和红外接收单元;In one embodiment, the infrared touch component specifically includes: an infrared emitting unit and an infrared receiving unit;
所述红外发射单元,用于发射红外线;The infrared emitting unit is used to emit infrared rays;
所述红外接收单元,用于接收所述红外线。The infrared receiving unit is used for receiving the infrared rays.
在一个实施例中,所述触觉反馈组件为超声波触觉装置,相应的,所述触觉反馈信号为超声波信号。In one embodiment, the tactile feedback component is an ultrasonic tactile device, and correspondingly, the tactile feedback signal is an ultrasonic signal.
在一个实施例中,所述空中成像交互系统还包括信息存储组件;所述信息存储组件分别与所述控制组件、所述空气成像组件连接;In one embodiment, the aerial imaging interaction system further includes an information storage component; the information storage component is connected to the control component and the air imaging component respectively;
所述信息存储组件,用于存储所述预设坐标和所述预设图像之间的对应关系。The information storage component is used to store the correspondence between the preset coordinates and the preset image.
在一个实施例中,所述控制组件还用于在接收到所述坐标时,向所述信息存储组件发送第四信号;In one embodiment, the control component is further configured to send a fourth signal to the information storage component when the coordinates are received;
所述信息存储组件还用于在接收到所述第四信号时,向所述空气成像组件发送与所述坐标相对应的目标图像;The information storage component is further configured to send a target image corresponding to the coordinates to the air imaging component when the fourth signal is received;
所述空气成像组件还用于在接收到所述目标图像时,将所述虚拟屏幕上显示的第一图像更换至所述目标图像。The air imaging component is further configured to replace the first image displayed on the virtual screen with the target image when receiving the target image.
有益效果Beneficial effect
在通过控制组件和空气成像组件在空气中形成虚拟图像后,红外触摸组件可以在虚拟图像的表面形成红外探测网,并在检测到第一触摸信号时,向控制组件发送触摸点的坐标,控制组件再将该坐标发送至触觉反馈组件,触觉反馈组件可以基于该坐标向触摸点发送触觉反馈信号,此时,形成触摸点的触摸物可以感受到上述触觉反馈信号。After the virtual image is formed in the air by the control component and the air imaging component, the infrared touch component can form an infrared detection network on the surface of the virtual image, and when the first touch signal is detected, send the coordinates of the touch point to the control component, control The component then sends the coordinates to the tactile feedback component, and the tactile feedback component can send a tactile feedback signal to the touch point based on the coordinates. At this time, the touch object forming the touch point can feel the tactile feedback signal.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或示范性技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings that need to be used in the embodiments or exemplary technical descriptions. Obviously, the accompanying drawings in the following descriptions are only for this application. For some embodiments, those skilled in the art can also obtain other drawings based on these drawings without creative efforts.
图1为本申请实施例提供的一种空中成像交互系统的结构示意图;FIG. 1 is a schematic structural diagram of an aerial imaging interactive system provided by an embodiment of the present application;
图2为本申请实施例提供的一种空中成像交互系统的应用场景示意图;FIG. 2 is a schematic diagram of an application scenario of an aerial imaging interaction system provided by an embodiment of the present application;
图3为本申请另一实施例提供的一种空中成像交互系统的结构示意图;FIG. 3 is a schematic structural diagram of an aerial imaging interaction system provided by another embodiment of the present application;
图4为本申请实施例提供的负折射示意图;Figure 4 is a schematic diagram of negative refraction provided by the embodiment of the present application;
图5为本申请实施例提供的触觉反馈组件的工作原理示意图。FIG. 5 is a schematic diagram of the working principle of the tactile feedback component provided by the embodiment of the present application.
本发明的实施方式Embodiments of the present invention
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本发明,并不用于限定本申请。In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present application.
需说明的是,当部件被称为“固定于”或“设置于”另一个部件,它可以直接在另一个部件上或者间接在该另一个部件上。当一个部件被称为是“连接于”另一个部件,它可以是直接或者间接连接至该另一个部件上。术语“上”、“下”、“左”、“右”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。术语“第一”、“第二”仅用于便于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明技术特征的数量。“多个”的含义是两个或两个以上,除非另有明确具体的限定。It should be noted that when a component is referred to as being “fixed on” or “disposed on” another component, it may be directly on the other component or indirectly on the other component. When an element is referred to as being "connected to" another element, it can be directly or indirectly connected to the other element. The orientation or positional relationship indicated by the terms "upper", "lower", "left", "right", etc. are based on the orientation or positional relationship shown in the drawings, and are for convenience of description only, rather than indicating or implying the referred device Or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the application, and those of ordinary skill in the art can understand the specific meanings of the above terms according to specific situations. The terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of technical features. "Plurality" means two or more, unless otherwise clearly and specifically defined.
图1为本申请实施例提供的一种空中成像交互系统的结构示意图,图2是本申请实施例提供的一种空中成像交互系统的应用场景示意图,该空中成像交互系统用于在检测到目标用户触摸空中成像区域时向目标用户反馈触觉效果。其中,空中成像区域指虚拟屏幕所在的区域。Figure 1 is a schematic structural diagram of an aerial imaging interaction system provided in an embodiment of the present application, and Figure 2 is a schematic diagram of an application scene of an aerial imaging interaction system provided in an embodiment of the application, the aerial imaging interaction system is used to detect a target Feedback haptic effects to the target user when the user touches the aerial imaging area. Wherein, the aerial imaging area refers to the area where the virtual screen is located.
如图1所示,该空中成像交互系统10包括:控制组件11、空气成像组件12、至少一组红外触摸组件13(图中仅示出一组)、触觉反馈组件14以及由空气成像组件12形成的虚拟屏幕15。空气成像组件12、红外触摸组件13以及触觉反馈组件14均与控制组件11连接。As shown in Figure 1, the aerial imaging interaction system 10 includes: a control component 11, an air imaging component 12, at least one set of infrared touch components 13 (only one group is shown in the figure), a tactile feedback component 14, and an air imaging component 12. A virtual screen 15 is formed. The air imaging component 12 , the infrared touch component 13 and the tactile feedback component 14 are all connected to the control component 11 .
需要说明的是,本申请实施例中,为了确保目标用户在触碰空气成像组件12形成的虚拟屏幕15的任意位置时,红外触摸组件13均能感应到,因此,红外触摸组件13设置于虚拟屏幕15所在区域的四周,且在虚拟屏幕15的表面形成红外探测网。It should be noted that in the embodiment of the present application, in order to ensure that the target user touches any position of the virtual screen 15 formed by the air imaging component 12, the infrared touch component 13 can sense it. Therefore, the infrared touch component 13 is set on the virtual screen 15. Around the area where the screen 15 is located, an infrared detection network is formed on the surface of the virtual screen 15 .
在实际应用中,当目标用户想要与空中成像交互系统10进行人机交互时,可以通过控制组件11触发第一预设信号。第一预设信号用于指示空中成像组件12在空气中形成虚拟屏幕15。In practical applications, when the target user wants to perform human-computer interaction with the aerial imaging interaction system 10 , the first preset signal can be triggered through the control component 11 . The first preset signal is used to instruct the aerial imaging component 12 to form a virtual screen 15 in the air.
在本申请实施例的一种实现方式中,目标用户触发第一预设信号可以是:目标用户对控制组件11的预设控件进行点击,即控制组件11在检测到自身的预设控件被点击时,确定目标用户触发了第一预设信号。其中,预设控件可以根据实际需要确定,此处不作限制。In an implementation of the embodiment of the present application, the triggering of the first preset signal by the target user may be: the target user clicks on the preset control of the control component 11, that is, the control component 11 detects that its own preset control is clicked , it is determined that the target user triggers the first preset signal. Wherein, the preset control can be determined according to actual needs, which is not limited here.
控制组件11用于在检测到第一预设信号时,向空气成像组件12发送第一信号。The control component 11 is configured to send a first signal to the air imaging component 12 when a first preset signal is detected.
在实际应用中,控制组件11可以是控制器。示例性的,控制组件11可以是中央处理器(central processing unit,CPU),也可以是微控制单元(Microcontroller Unit,MCU) 。In practical applications, the control component 11 may be a controller. Exemplarily, the control component 11 may be a central processing unit (central processing unit, CPU), or a micro control unit (Microcontroller Unit, MCU).
基于此,控制组件11发送的任何信号均可以是控制信号。Based on this, any signal sent by the control component 11 may be a control signal.
空气成像组件12用于在接收到第一信号时,在空气中形成虚拟屏幕15,并在虚拟屏幕15上显示第一图像。The air imaging component 12 is used for forming a virtual screen 15 in the air and displaying a first image on the virtual screen 15 when receiving the first signal.
在实际应用中,空气成像组件12包括显示器,基于此,第一图像为显示器上显示的图像。In practical applications, the air imaging component 12 includes a display, and based on this, the first image is an image displayed on the display.
红外触摸组件13用于在虚拟屏幕15的表面形成红外探测网,并在检测到第二预设信号时,向控制组件11发送触摸点的坐标。The infrared touch component 13 is used to form an infrared detection network on the surface of the virtual screen 15, and send the coordinates of the touch point to the control component 11 when a second preset signal is detected.
本申请实施例中,红外触摸组件13检测到第二预设信号可以是:检测到红外探测网中的部分红外线被遮挡,即红外触摸组件13若检测到自身形成的红外探测网中部分红外线被遮挡,则确定检测到第二预设信号。In the embodiment of the present application, the second preset signal detected by the infrared touch component 13 may be: detecting that part of the infrared rays in the infrared detection network is blocked, that is, if the infrared touch component 13 detects that part of the infrared rays in the infrared detection network formed by itself is blocked If blocked, it is determined that the second preset signal is detected.
在实际应用中,当有物体触摸虚拟屏幕15时,虚拟屏幕15表面的红外探测网中的部分红外线会被触摸物遮挡,因此,红外触摸组件13可以根据虚拟屏幕15表面的红外线的遮挡情况来确认触摸点的坐标。In practical applications, when an object touches the virtual screen 15, part of the infrared rays in the infrared detection network on the surface of the virtual screen 15 will be blocked by the touched object, so the infrared touch component 13 can be detected according to the shielding situation of the infrared rays on the surface of the virtual screen 15. Confirm the coordinates of the touched point.
其中,触摸点指触摸物与虚拟屏幕15的接触点。Wherein, the touch point refers to the contact point between the touch object and the virtual screen 15 .
在本申请实施例中,触摸物可以是目标用户的手指。In this embodiment of the present application, the touch object may be a target user's finger.
由于红外触摸组件13还可以根据虚拟屏幕15表面的红外线的遮挡情况来计算触摸点的面积,因此,在本申请的一个实施例中,红外触摸组件13还可以在检测到第二预设信号,且触摸点的面积大于第一预设面积阈值,且小于第二预设面积阈值时,向控制组件11发送该触摸点的坐标。Since the infrared touch component 13 can also calculate the area of the touch point according to the shielding situation of the infrared rays on the surface of the virtual screen 15, therefore, in one embodiment of the present application, the infrared touch component 13 can also detect the second preset signal, And when the area of the touch point is larger than the first preset area threshold and smaller than the second preset area threshold, the coordinates of the touch point are sent to the control component 11 .
示例性的,第一预设面积阈值和第二预设面积阈值可以分别是人们手指与虚拟屏幕形成的触摸点的最小值和最大值。Exemplarily, the first preset area threshold and the second preset area threshold may be a minimum value and a maximum value of touch points formed by people's fingers on the virtual screen, respectively.
基于此,红外触摸组件13还可以在确定触摸物为人的手指时,才向控制组件11发送触摸点的坐标,避免非生命体在触碰虚拟屏幕15时,红外触摸组件13仍然将非生命体与虚拟屏幕15形成的触摸点的坐标发送至控制组件11,提高了红外触摸组件13对目标用户的手指的感应精准度。Based on this, the infrared touch component 13 can also send the coordinates of the touch point to the control component 11 only when it is determined that the touch object is a human finger, so as to prevent the non-living body from touching the virtual screen 15. The coordinates of the touch point formed with the virtual screen 15 are sent to the control component 11, which improves the sensing accuracy of the infrared touch component 13 to the finger of the target user.
在实际应用中,红外触摸组件13可以是红外线传感器。In practical applications, the infrared touch component 13 may be an infrared sensor.
控制组件11还用于在接收到上述坐标时,向触觉反馈组件14发送该坐标。The control component 11 is also configured to send the above-mentioned coordinates to the tactile feedback component 14 when receiving the coordinates.
在本申请的另一个实施例中,控制组件11还用于在接收到上述坐标时,基于预先存储的预设坐标与预设图像之间的对应关系,向空气成像组件13发送第三信号。In another embodiment of the present application, the control component 11 is further configured to send a third signal to the air imaging component 13 based on the pre-stored correspondence between preset coordinates and preset images when receiving the above-mentioned coordinates.
基于此,空气成像组件13在接收到第三信号时,将虚拟屏幕15上显示的第一图像更换至目标图像。其中,目标图像指与上述坐标相对应的预设图像。Based on this, when receiving the third signal, the air imaging component 13 replaces the first image displayed on the virtual screen 15 with the target image. Wherein, the target image refers to a preset image corresponding to the above-mentioned coordinates.
触觉反馈组件14用于在接收到上述坐标时,基于该坐标向触摸点发送触觉反馈信号。The tactile feedback component 14 is configured to send a tactile feedback signal to the touch point based on the above-mentioned coordinates upon receiving the coordinates.
在本申请的一个实施例中,触觉反馈组件14可以是超声波触觉装置,基于此,触觉反馈信号可以是超声波信号。In one embodiment of the present application, the tactile feedback component 14 may be an ultrasonic haptic device, based on this, the tactile feedback signal may be an ultrasonic signal.
在本申请的另一个实施例中,空中成像交互系统10还包括:信息存储组件(图中未示出)。该信息存储组件分别与控制组件11、空气成像组件12连接。In another embodiment of the present application, the aerial imaging interaction system 10 further includes: an information storage component (not shown in the figure). The information storage component is connected with the control component 11 and the air imaging component 12 respectively.
信息存储组件用于存储预设坐标和预设图像之间的对应关系。The information storage component is used for storing the corresponding relationship between preset coordinates and preset images.
基于此,在本申请的一个实施例中,控制组件11还用于在接收到触摸点的坐标时,向信息存储组件发送第四信号;Based on this, in one embodiment of the present application, the control component 11 is further configured to send a fourth signal to the information storage component when receiving the coordinates of the touch point;
信息存储组件还用于在接收到所述第四信号时,向空气成像组件12发送与上述坐标相对应的目标图像;The information storage component is also configured to send the target image corresponding to the above-mentioned coordinates to the air imaging component 12 when the fourth signal is received;
空气成像组件12还用于在接收到上述目标图像时,将虚拟屏幕15上显示的第一图像更换至上述目标图像。The air imaging component 12 is further configured to replace the first image displayed on the virtual screen 15 with the above target image when receiving the above target image.
以上可以看出,本申请实施例提供的空中成像交互系统,在通过控制组件和空气成像组件在空气中形成虚拟屏幕,且在该虚拟屏幕显示第一图像后,红外触摸组件可以在虚拟屏幕的表面形成红外探测网,并在检测到第二预设信号时,向控制组件发送触摸点的坐标,控制组件再将该坐标发送至触觉反馈组件,触觉反馈组件可以基于该坐标向触摸点发送触觉反馈信号,此时,形成触摸点的触摸物可以感受到上述触觉反馈信号,因此,本申请实施例提供的空中成像交互系统对发生用户触碰事件时可以实现触觉反馈效果。It can be seen from the above that in the aerial imaging interaction system provided by the embodiment of the present application, after the virtual screen is formed in the air through the control component and the air imaging component, and the first image is displayed on the virtual screen, the infrared touch component can be displayed on the virtual screen. The surface forms an infrared detection network, and when the second preset signal is detected, it sends the coordinates of the touch point to the control component, and the control component then sends the coordinates to the tactile feedback component, and the tactile feedback component can send a tactile sensation to the touch point based on the coordinates Feedback signal. At this time, the touch object forming the touch point can feel the above-mentioned tactile feedback signal. Therefore, the aerial imaging interaction system provided by the embodiment of the present application can realize the tactile feedback effect when a user touch event occurs.
请参阅图3,图3为本申请另一实施例提供的一种空中成像交互系统的结构示意图。如图3所示,相对于图1对应的实施例,本实施例中的空中成像组件12包括:显示单元121和空气成像板122。显示单元121与控制组件11连接。Please refer to FIG. 3 . FIG. 3 is a schematic structural diagram of an aerial imaging interaction system provided by another embodiment of the present application. As shown in FIG. 3 , compared to the embodiment corresponding to FIG. 1 , the aerial imaging assembly 12 in this embodiment includes: a display unit 121 and an air imaging plate 122 . The display unit 121 is connected with the control component 11 .
需要说明的是,显示单元121与空气成像板122之间的夹角为预设角度。其中,预设角度可以根据实际需要设置,此处不作限制,示例性的,预设角度可以是45度。It should be noted that the included angle between the display unit 121 and the air imaging plate 122 is a preset angle. Wherein, the preset angle can be set according to actual needs, and there is no limitation here. Exemplarily, the preset angle can be 45 degrees.
具体地,显示单元121用于向空气成像板122发射预设光线,并显示需要投影的投影图像;Specifically, the display unit 121 is configured to emit preset light to the air imaging plate 122, and display a projected image to be projected;
在实际应用中,显示单元121可以是显示器。示例性的,显示器可以是液晶显示器、LED显示器、OLED显示器或投影器等。In practical applications, the display unit 121 may be a display. Exemplarily, the display may be a liquid crystal display, an LED display, an OLED display, or a projector.
空气成像板122用于将显示单元121发射的预设光线折射至空气中形成虚拟屏幕15,并将投影图像产生的光线折射至虚拟屏幕15,以在虚拟屏幕15上显示与投影图像相对应的第一图像。The air imaging board 122 is used to refract the preset light emitted by the display unit 121 into the air to form a virtual screen 15, and refract the light generated by the projected image to the virtual screen 15, so as to display on the virtual screen 15 the image corresponding to the projected image. first image.
本实施例中,预设光线可以是:显示单元121在工作时产生的,且以平行光的方式入射到空气成像板122上的光线。In this embodiment, the preset light may be: the light generated by the display unit 121 during operation and incident on the air imaging plate 122 in the form of parallel light.
需要说明的是,平行光指又称为方向光(Directional Light),是一组没有衰减的平行的光线。It should be noted that parallel light, also known as directional light, is a group of parallel light rays without attenuation.
在实际应用中,空气成像板122可以是负折射平板透镜。In practical applications, the air imaging plate 122 may be a negative refraction plate lens.
负折射(Negative refraction)指当光波从具有正折射率的材料入射到具有负折射率材料的界面时,光波的折射与常规折射相反,入射波和折射波处于界面法线方向同一侧。Negative refraction means that when a light wave is incident from a material with a positive refractive index to an interface with a material with a negative refractive index, the refraction of the light wave is opposite to the conventional refraction, and the incident wave and the refracted wave are on the same side of the normal direction of the interface.
示例性的,如图4所示,光线L1指从显示单元121发射的入射光线,光线L2为光线1以空气成像板122为界面的反射光线,光线L3为以空气成像板122为界面的正折射光线,光线L4为以空气成像板122为界面的负折射光线,夹角a为折射(正折射和负折射)夹角,夹角b为入射(反射)夹角,直线L5为以空气成像板122为界面的法线。Exemplarily, as shown in FIG. 4 , the light L1 refers to the incident light emitted from the display unit 121, the light L2 is the reflected light of the light 1 with the air imaging plate 122 as the interface, and the light L3 is the positive light with the air imaging plate 122 as the interface. Refracted light, the light L4 is the negative refracted light with the air imaging plate 122 as the interface, the angle a is the angle of refraction (positive refraction and negative refraction), the angle b is the angle of incidence (reflection), and the straight line L5 is the air imaging Plate 122 is the normal to the interface.
在本申请的一个实施例中,触觉反馈组件14可以平行设置在显示单元121的上方,且与空气成像板122之间的夹角为预设角度。In an embodiment of the present application, the tactile feedback component 14 may be arranged in parallel above the display unit 121 , and the included angle with the air imaging plate 122 is a preset angle.
结合图2,由于触觉反馈组件14发送的触觉反馈信号可以通过空气成像板122反射至虚拟屏幕的任意一处,因此,为了确保触觉反馈组件14发送的触觉反馈信号可以准确到达触摸点所在的坐标处,触觉反馈组件14可以确定与上述坐标相对称的对称坐标。Referring to FIG. 2, since the tactile feedback signal sent by the tactile feedback component 14 can be reflected to any place on the virtual screen through the air imaging plate 122, in order to ensure that the tactile feedback signal sent by the tactile feedback component 14 can accurately reach the coordinates of the touch point , the tactile feedback component 14 may determine symmetrical coordinates that are symmetrical to the above-mentioned coordinates.
具体的,触觉反馈组件14在接收到坐标时,确定在显示单元121中,以空气成像板122所在平面为对称平面,与上述坐标相对称的对称坐标。Specifically, when receiving the coordinates, the tactile feedback component 14 determines symmetrical coordinates in the display unit 121 , taking the plane where the air imaging plate 122 is located as a symmetric plane and symmetrical to the above-mentioned coordinates.
基于此,触觉反馈组件14还用于向上述对称坐标发送触觉反馈信号。Based on this, the tactile feedback component 14 is also configured to send a tactile feedback signal to the above-mentioned symmetrical coordinates.
空气成像板122还用于将上述触觉反馈信号反射至触摸点所在的坐标处。The air imaging plate 122 is also used to reflect the above-mentioned tactile feedback signal to the coordinates of the touch point.
因此,上述坐标的触摸点可以对触摸物产生触觉反馈效果。Therefore, the touch point with the above coordinates can generate a tactile feedback effect on the touch object.
请继续参阅图3,在本申请的一个实施例中,一组红外触摸组件13具体可以包括:红外发射单元131和红外接收单元132。其中,红外发射单元131和红外接收单元均设置在虚拟屏幕的四周,且红外发射单元131与红外接收单元132所在方向相互垂直。Please continue to refer to FIG. 3 , in an embodiment of the present application, a group of infrared touch components 13 may specifically include: an infrared emitting unit 131 and an infrared receiving unit 132 . Wherein, the infrared emitting unit 131 and the infrared receiving unit are arranged around the virtual screen, and the directions where the infrared emitting unit 131 and the infrared receiving unit 132 are located are perpendicular to each other.
具体地,红外发射单元131用于发射红外线。Specifically, the infrared emitting unit 131 is used for emitting infrared rays.
红外接收单元132用于接收上述红外线。The infrared receiving unit 132 is used for receiving the above-mentioned infrared rays.
在实际应用中,红外发射单元131可以是红外线发射器,红外接收单元132可以是红外线接收器。In practical applications, the infrared emitting unit 131 may be an infrared transmitter, and the infrared receiving unit 132 may be an infrared receiver.
以上可以看出,本申请实施例提供的空中成像交互系统,由于显示单元与触觉反馈组件平行,且空气成像板设置在显示单元、触觉反馈组件之间,且空气成像板与显示单元、触觉反馈组件之间的角度均为预设角度,使得触觉反馈组件发出的触觉反馈信号可以通过空气成像板准确到达目标用户与虚拟图像之间的接触点,使得目标用户可以通过触摸点准确感受到触觉反馈信号,提高了在发生用户触碰事件时,对触觉反馈效果的模拟的真实度。As can be seen from the above, in the aerial imaging interactive system provided by the embodiment of the present application, since the display unit is parallel to the tactile feedback component, and the air imaging board is arranged between the display unit and the tactile feedback component, and the air imaging board, the display unit, and the tactile feedback The angles between the components are all preset angles, so that the tactile feedback signal sent by the tactile feedback component can accurately reach the contact point between the target user and the virtual image through the air imaging plate, so that the target user can accurately feel the tactile feedback through the touch point Signals that improve the fidelity of the simulation of haptic feedback effects when a user touch event occurs.
以下结合图2和图3对本申请实施例提供的空中成像交互系统10的具体工作原理进行详细说明:The specific working principle of the aerial imaging interaction system 10 provided by the embodiment of the present application will be described in detail below in conjunction with FIG. 2 and FIG. 3 :
如图2和图3所示,空中成像交互系统10的实现触觉反馈效果的过程如下:As shown in FIG. 2 and FIG. 3 , the process of realizing the tactile feedback effect of the aerial imaging interaction system 10 is as follows:
控制组件11在检测到第一预设信号时,向空气成像组件12发送第一信号,空气成像组件12中的显示单元121在接收到第一信号时,显示单元121开始工作,此时,显示单元121发出的预设光线以平行光的方式入射到空气成像组件12中的空气成像板122上,空气成像板122将显示单元121发出的预设光线折射至空气中并形成虚拟屏幕15,显示单元121在开始工作后,立即显示需要进行投影的投影图像,而空气成像板122也继续将投影图像产生的光线折射至虚拟屏幕15,从而在虚拟屏幕15上显示出与上述投影图像相对应的第一图像。When the control assembly 11 detects the first preset signal, it sends the first signal to the air imaging assembly 12. When the display unit 121 in the air imaging assembly 12 receives the first signal, the display unit 121 starts to work. At this time, the display The preset light emitted by the unit 121 is incident on the air imaging plate 122 in the air imaging assembly 12 in the form of parallel light, and the air imaging plate 122 refracts the preset light emitted by the display unit 121 into the air and forms a virtual screen 15, displaying After the unit 121 starts working, it immediately displays the projected image that needs to be projected, and the air imaging plate 122 also continues to refract the light generated by the projected image to the virtual screen 15, thereby displaying on the virtual screen 15 the image corresponding to the above-mentioned projected image. first image.
之后,在虚拟屏幕15的表面覆盖了红外探测网的红外触摸组件13可以实时检测是否发生用户触碰事件,红外触摸组件13在检测到第二预设信号时,说明发生用户触碰事件,此时,红外触摸组件13向控制组件11发生触摸点的坐标,控制组件11在接收到上述坐标后,将该坐标发送至触觉反馈组件14,触觉反馈组件14在接收到该坐标时,可以在与触觉反馈组件14相对平行的显示单元121所在的平面上,确定一个以空气成像板122所在平面为对称平面,与该坐标相对称的对称坐标。示例性的,结合图5,假设目标用户的手指与虚拟屏幕15之间的触摸点为点p,则与该点p在显示单元121所在的平面上,以空气成像板122为对称平面的对称点为点p',基于此,触觉反馈组件14可以向点p'发送触觉反馈信号的发送范围为阴影区域141,直线L6即为触觉反馈组件14发送触觉反馈信号的一条发送路径,直线L7为与其相对应的反射路径;直线L8为触觉反馈组件14发送触觉反馈信号的另一条发送路径,直线L9为与其相对应的反射路径。Afterwards, the infrared touch assembly 13 covered with the infrared detection net on the surface of the virtual screen 15 can detect in real time whether a user touch event occurs, and when the infrared touch assembly 13 detects a second preset signal, it indicates that a user touch event occurs, and this , the infrared touch component 13 sends the coordinates of the touch point to the control component 11, and the control component 11 sends the coordinates to the tactile feedback component 14 after receiving the above-mentioned coordinates. When the tactile feedback component 14 receives the coordinates, it can communicate with The tactile feedback component 14 is relatively parallel to the plane where the display unit 121 is located, and determines a symmetrical coordinate that takes the plane where the air imaging plate 122 is located as a symmetric plane and is symmetrical to this coordinate. Exemplarily, referring to FIG. 5 , assuming that the touch point between the target user's finger and the virtual screen 15 is point p, then the point p is symmetrical with the air imaging plate 122 on the plane where the display unit 121 is located, and the plane of symmetry The point is point p'. Based on this, the range where the tactile feedback component 14 can send the tactile feedback signal to the point p' is the shaded area 141, the straight line L6 is a sending path for the tactile feedback component 14 to send the tactile feedback signal, and the straight line L7 is The corresponding reflection path; the straight line L8 is another transmission path for the tactile feedback signal sent by the tactile feedback component 14 , and the straight line L9 is the corresponding reflection path.
之后触觉反馈组件14向上述对称坐标发送触觉反馈信号,触觉反馈信号在到达空气成像板122后,会被空气成像板122反射至触摸点所在的坐标处,从而,目标用户的手指可以通过该触觉反馈信号实际感受到触觉反馈效果。Then the tactile feedback component 14 sends a tactile feedback signal to the above-mentioned symmetrical coordinates. After the tactile feedback signal reaches the air imaging plate 122, it will be reflected by the air imaging plate 122 to the coordinates where the touch point is located, so that the finger of the target user can pass through the tactile feedback signal. The feedback signal actually feels the haptic feedback effect.
示例性的,以空中作画为例,目标用户可以在虚拟屏幕15上呈现的虚拟画布上通过手指滑动的轨迹来绘制图形。目标用户可以通过空中成像交互系统10反馈的触觉反馈效果确定图形是否绘制成功。需要说明的是,此时,手指滑动的触觉反馈效果是以摩擦力的形式提供的触觉反馈信号来实现的。Exemplarily, taking drawing in the air as an example, the target user may draw a figure by sliding a finger on a virtual canvas presented on the virtual screen 15 . The target user can determine whether the graphics are drawn successfully through the tactile feedback effect fed back by the aerial imaging interaction system 10 . It should be noted that, at this time, the tactile feedback effect of finger sliding is realized by a tactile feedback signal provided in the form of friction.
示例性的,以银行取款机为例,目标用户可以通过虚拟屏幕15上呈现的虚拟键盘进行密码的输入,同时通过触觉反馈组件14发送的触觉反馈信号确定密码的成功输入,不仅有效避免了目标用户通过实体键盘输入密码时感染病毒,还避免留下指纹,造成指纹被盗用的可能。Exemplarily, taking a bank teller machine as an example, the target user can input the password through the virtual keyboard presented on the virtual screen 15, and at the same time confirm the successful input of the password through the tactile feedback signal sent by the tactile feedback component 14, which not only effectively avoids the target When the user enters the password through the physical keyboard, the virus is infected, and the fingerprint is also avoided, which may cause the possibility of the fingerprint being stolen.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参照其它实施例的相关描述。In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts that are not detailed or recorded in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still implement the foregoing embodiments Modifications to the technical solutions described in the examples, or equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application, and should be included in the Within the protection scope of this application.

Claims (10)

  1. 一种空中成像交互系统,其特征在于,包括: An aerial imaging interactive system is characterized in that it comprises:
    控制组件,用于在检测到第一预设信号时,向空气成像组件发送第一信号;a control component, configured to send a first signal to the air imaging component when a first preset signal is detected;
    所述空气成像组件,与所述控制组件连接,用于在接收到所述第一信号时,在空气中形成虚拟屏幕,并在所述虚拟屏幕上显示第一图像;The air imaging component is connected with the control component, and is used to form a virtual screen in the air when receiving the first signal, and display a first image on the virtual screen;
    至少一组红外触摸组件,与所述控制组件连接,用于在所述虚拟屏幕的表面形成红外探测网,并在检测到第二预设信号时,向所述控制组件发送触摸点的坐标;At least one set of infrared touch components connected to the control component for forming an infrared detection network on the surface of the virtual screen, and sending the coordinates of the touch point to the control component when a second preset signal is detected;
    所述控制组件还用于在接收到所述坐标时,向触觉反馈组件发送所述坐标;The control component is further configured to send the coordinates to the tactile feedback component when the coordinates are received;
    所述触觉反馈组件,与所述控制组件连接,用于在接收到所述坐标时,基于所述坐标向所述触摸点发送触觉反馈信号。The tactile feedback component is connected with the control component and configured to send a tactile feedback signal to the touch point based on the coordinates when the coordinates are received.
  2. 根据权利要求1所述的空中成像交互系统,其特征在于,所述控制组件还用于在接收到所述坐标时,基于预先存储的预设坐标和预设图像之间的对应关系,向所述空气成像组件发送第三信号; The aerial imaging interaction system according to claim 1, wherein the control component is further configured to, when receiving the coordinates, send an image to the The air imaging component sends a third signal;
    相应的,所述空气成像组件还用于在接收到所述第三信号后,将所述虚拟屏幕上显示的第一图像更换至与所述坐标相对应的目标图像。Correspondingly, the air imaging component is further configured to replace the first image displayed on the virtual screen with a target image corresponding to the coordinates after receiving the third signal.
  3. 根据权利要求1所述的空中成像交互系统,其特征在于,所述空气成像组件包括:显示单元和空气成像板; The aerial imaging interaction system according to claim 1, wherein the air imaging component comprises: a display unit and an air imaging board;
    所述显示单元,用于向所述空气成像板发射预设光线,并显示需要投影的投影图像;The display unit is configured to emit preset light to the air imaging plate and display a projection image to be projected;
    所述空气成像板,用于将所述显示单元发射的预设光线折射至空气中形成虚拟屏幕,并将所述投影图像产生的光线折射至所述虚拟屏幕,以在所述虚拟屏幕上显示与所述投影图像相对应的所述第一图像。The air imaging plate is used to refract the preset light emitted by the display unit into the air to form a virtual screen, and refract the light generated by the projected image to the virtual screen for display on the virtual screen The first image corresponds to the projected image.
  4. 根据权利要求3所述的空中成像交互系统,其特征在于,所述显示单元与所述触觉反馈组件平行,所述空气成像板设置于所述触觉反馈组件与所述显示单元之间,且分别与所述触觉反馈组件、所述显示单元形成预设角度; The aerial imaging interaction system according to claim 3, wherein the display unit is parallel to the tactile feedback component, the air imaging board is arranged between the tactile feedback component and the display unit, and respectively forming a preset angle with the tactile feedback component and the display unit;
    相应的,所述触觉反馈组件还用于:在接收到所述坐标时,确定在所述显示单元中,以所述空气成像板所在平面为对称平面,与所述坐标相对称的对称坐标。Correspondingly, the tactile feedback component is further configured to: when receiving the coordinates, determine symmetrical coordinates in the display unit that are symmetrical to the coordinates, taking the plane where the air imaging plate is located as a symmetric plane.
  5. 根据权利要求4所述的空中成像交互系统,其特征在于,所述触觉反馈组件还用于:向所述对称坐标发送所述触觉反馈信号; The aerial imaging interaction system according to claim 4, wherein the tactile feedback component is further configured to: send the tactile feedback signal to the symmetrical coordinates;
    相应的,所述空气成像板还用于将所述触觉反馈信号反射至所述触摸点所在的坐标处。Correspondingly, the air imaging board is also used to reflect the tactile feedback signal to the coordinates of the touch point.
  6. 根据权利要求1所述的空中成像交互系统,其特征在于,所述红外触摸组件还用于:在检测到所述第二预设信号,且所述触摸点的面积大于第一预设面积阈值,且小于第二预设面积阈值时,向所述控制组件发送所述触摸点的坐标。 The aerial imaging interaction system according to claim 1, wherein the infrared touch component is further used for: when the second preset signal is detected, and the area of the touch point is larger than the first preset area threshold , and is smaller than a second preset area threshold, sending the coordinates of the touch point to the control component.
  7. 根据权利要求1所述的空中成像交互系统,其特征在于,所述红外触摸组件具体包括:红外发射单元和红外接收单元; The aerial imaging interaction system according to claim 1, wherein the infrared touch component specifically comprises: an infrared emitting unit and an infrared receiving unit;
    所述红外发射单元,用于发射红外线;The infrared emitting unit is used to emit infrared rays;
    所述红外接收单元,用于接收所述红外线。The infrared receiving unit is used for receiving the infrared rays.
  8. 根据权利要求1所述的空中成像交互系统,其特征在于,所述触觉反馈组件为超声波触觉装置,相应的,所述触觉反馈信号为超声波信号。 The aerial imaging interaction system according to claim 1, wherein the tactile feedback component is an ultrasonic tactile device, and correspondingly, the tactile feedback signal is an ultrasonic signal.
  9. 根据权利要求1所述的空中成像交互系统,其特征在于,所述空中成像交互系统还包括信息存储组件;所述信息存储组件分别与所述控制组件、所述空气成像组件连接; The aerial imaging interaction system according to claim 1, wherein the aerial imaging interaction system further comprises an information storage component; the information storage component is connected to the control component and the air imaging component respectively;
    所述信息存储组件,用于存储所述预设坐标和所述预设图像之间的对应关系。The information storage component is used to store the correspondence between the preset coordinates and the preset image.
  10. 根据权利要求9所述的空中成像交互系统,其特征在于,所述控制组件还用于在接收到所述坐标时,向所述信息存储组件发送第四信号; The aerial imaging interaction system according to claim 9, wherein the control component is further configured to send a fourth signal to the information storage component when receiving the coordinates;
    所述信息存储组件还用于在接收到所述第四信号时,向所述空气成像组件发送与所述坐标相对应的目标图像;The information storage component is further configured to send a target image corresponding to the coordinates to the air imaging component when the fourth signal is received;
    所述空气成像组件还用于在接收到所述目标图像时,将所述虚拟屏幕上显示的第一图像更换至所述目标图像。The air imaging component is further configured to replace the first image displayed on the virtual screen with the target image when receiving the target image.
PCT/CN2021/094881 2021-05-20 2021-05-20 Aerial imaging interactive system WO2022241714A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2021/094881 WO2022241714A1 (en) 2021-05-20 2021-05-20 Aerial imaging interactive system
CN202180001220.4A CN113906372A (en) 2021-05-20 2021-05-20 Aerial imaging interaction system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/094881 WO2022241714A1 (en) 2021-05-20 2021-05-20 Aerial imaging interactive system

Publications (1)

Publication Number Publication Date
WO2022241714A1 true WO2022241714A1 (en) 2022-11-24

Family

ID=79026316

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/094881 WO2022241714A1 (en) 2021-05-20 2021-05-20 Aerial imaging interactive system

Country Status (2)

Country Link
CN (1) CN113906372A (en)
WO (1) WO2022241714A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114838473A (en) * 2022-03-30 2022-08-02 海尔(深圳)研发有限责任公司 Method and system for controlling air conditioner, device, air conditioner, wheelchair and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104486604A (en) * 2014-12-30 2015-04-01 湖南巨手科技发展有限公司 Touch screen projection display device
CN108196681A (en) * 2018-01-27 2018-06-22 像航(上海)科技有限公司 The real-time touch-control system of air-borne imagery is realized according to recognition of face and laser image
KR20180122811A (en) * 2017-05-04 2018-11-14 임성현 Touch-enabled projector
CN109947302A (en) * 2019-03-29 2019-06-28 京东方科技集团股份有限公司 A kind of aerial display device and its control method
CN110928472A (en) * 2018-09-19 2020-03-27 阿里巴巴集团控股有限公司 Article processing method and device and electronic equipment
CN111722769A (en) * 2020-07-16 2020-09-29 腾讯科技(深圳)有限公司 Interaction method, interaction device, display equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102331872A (en) * 2011-05-30 2012-01-25 广州视睿电子科技有限公司 Method and device for achieving effect of middle mouse button on touch screen
CN215895436U (en) * 2021-05-20 2022-02-22 深圳盈天下视觉科技有限公司 Aerial imaging interaction system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104486604A (en) * 2014-12-30 2015-04-01 湖南巨手科技发展有限公司 Touch screen projection display device
KR20180122811A (en) * 2017-05-04 2018-11-14 임성현 Touch-enabled projector
CN108196681A (en) * 2018-01-27 2018-06-22 像航(上海)科技有限公司 The real-time touch-control system of air-borne imagery is realized according to recognition of face and laser image
CN110928472A (en) * 2018-09-19 2020-03-27 阿里巴巴集团控股有限公司 Article processing method and device and electronic equipment
CN109947302A (en) * 2019-03-29 2019-06-28 京东方科技集团股份有限公司 A kind of aerial display device and its control method
CN111722769A (en) * 2020-07-16 2020-09-29 腾讯科技(深圳)有限公司 Interaction method, interaction device, display equipment and storage medium

Also Published As

Publication number Publication date
CN113906372A (en) 2022-01-07

Similar Documents

Publication Publication Date Title
US10534436B2 (en) Multi-modal gesture based interactive system and method using one single sensing system
TWI387914B (en) Projective capacitive touch apparatus, and method for identifying multi-touched positions
TW201040850A (en) Gesture recognition method and interactive input system employing same
US20100302211A1 (en) Touch Screen Detecting Method and Apparatus
US8378995B2 (en) Touch display system with optical touch detector
TW201135558A (en) Projecting system with touch controllable projecting picture
TWI461975B (en) Electronic device and method for correcting touch position
EP2457143A1 (en) Display to determine gestures
JP2016071836A (en) Interactive display method, control method, and system for achieving hologram display
US20120249599A1 (en) Method of identifying a multi-touch scaling gesture and device using the same
US20120249487A1 (en) Method of identifying a multi-touch shifting gesture and device using the same
JP5608295B2 (en) Infrared touch screen device using an array of infrared elements facing two sides
Christou et al. 3D touch surface for interactive pseudo‐holographic displays
KR20130111910A (en) Touch input device panel using refractive device of infrared light
WO2022241714A1 (en) Aerial imaging interactive system
US20180267671A1 (en) Touch screen system and method for driving the same
CN215895436U (en) Aerial imaging interaction system
US20140111478A1 (en) Optical Touch Control Apparatus
KR101018397B1 (en) Infrared rays touch screen apparatus for removing false image generated in multi touch
KR20100066671A (en) Touch display apparatus
Izadi et al. Thinsight: a thin form-factor interactive surface technology
TWI498787B (en) Optical touch system, method of touch sensing, and computer program product
KR20100116267A (en) Touch panel and touch display apparatus having the same
TWM399375U (en) Display touch screen system
JP2018116346A (en) Input control device, display device, and input control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21940169

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE