WO2023179383A1 - 终端控制方法、装置、设备及存储介质 - Google Patents

终端控制方法、装置、设备及存储介质 Download PDF

Info

Publication number
WO2023179383A1
WO2023179383A1 PCT/CN2023/080931 CN2023080931W WO2023179383A1 WO 2023179383 A1 WO2023179383 A1 WO 2023179383A1 CN 2023080931 W CN2023080931 W CN 2023080931W WO 2023179383 A1 WO2023179383 A1 WO 2023179383A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
preset
dimensional
terminal device
information
Prior art date
Application number
PCT/CN2023/080931
Other languages
English (en)
French (fr)
Inventor
傅强
丁彬
Original Assignee
北京罗克维尔斯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京罗克维尔斯科技有限公司 filed Critical 北京罗克维尔斯科技有限公司
Publication of WO2023179383A1 publication Critical patent/WO2023179383A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

  • the present disclosure relates to the field of information technology, and in particular to terminal control methods, devices, equipment and storage media.
  • the present disclosure provides a terminal control method, device, equipment and storage medium.
  • the present disclosure provides a terminal control method, which method is applied to a vehicle and includes:
  • the present disclosure provides another terminal control method, which method is applied to a terminal device and includes:
  • the present disclosure provides a terminal control device, which is applied to a vehicle and includes:
  • a first sending module configured to respond to a three-dimensional information acquisition instruction sent by a preset terminal device in the vehicle, and send a depth image shooting instruction to a preset image sensor in the vehicle;
  • a processing module configured to receive the depth image data of the person in the vehicle obtained by the preset image sensor, process the depth image data, and obtain the three-dimensional perception information of the person;
  • the second sending module is configured to send the three-dimensional sensing information to the preset terminal device, and perform somatosensory control on the preset terminal device through the three-dimensional sensing information.
  • the present disclosure provides another terminal control device, which is applied to terminal equipment and includes:
  • the third sending module is used to send three-dimensional information acquisition instructions to the vehicle
  • a matching module configured to receive the three-dimensional perception information sent by the vehicle, match the three-dimensional perception information with the posture template, and determine the target posture of the person in the vehicle based on the matching result;
  • a control module configured to perform somatosensory control on the terminal device according to the target posture.
  • embodiments of the present disclosure also provide a terminal control device, including:
  • Memory used to store executable instructions
  • the processor is configured to read executable instructions from the memory and execute the executable instructions to implement the terminal control method of the first aspect or the second aspect.
  • embodiments of the present disclosure also provide a computer-readable storage medium.
  • the storage medium stores a computer program.
  • the processor implements the terminal control of the first aspect or the second aspect. method.
  • a terminal control method, device, equipment and storage medium in response to a three-dimensional information acquisition instruction sent by a preset terminal device in the vehicle, sends a depth image shooting instruction to a preset image sensor in the vehicle; receives the preset The image sensor acquires the depth image data of the person in the vehicle, processes the depth image data, and obtains the person's three-dimensional perception information; sends the three-dimensional perception information to the preset terminal device, and performs somatosensory control on the preset terminal device through the three-dimensional perception information.
  • three-dimensional sensing information can be sent to the preset terminal equipment, so that the preset terminal equipment can realize somatosensory control, thereby expanding the functions of the preset terminal equipment and improving the control of the preset terminal equipment. Control is easy, timely and fun.
  • Figure 1 is a schematic flowchart of a terminal control method provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic flowchart of another terminal control method provided by an embodiment of the present disclosure.
  • FIG. 3 is a schematic flowchart of another terminal control method provided by an embodiment of the present disclosure.
  • Figure 4 is a schematic structural diagram of a terminal control device provided by an embodiment of the present disclosure.
  • Figure 5 is a schematic structural diagram of another terminal control device provided by an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of the hardware circuit structure of a terminal control device provided by an embodiment of the present disclosure.
  • embodiments of the present disclosure provide a terminal control method, device, equipment and storage medium.
  • Figure 1 is a schematic flow chart of a terminal control method provided by an embodiment of the present disclosure.
  • the method is applied to a vehicle.
  • the method can be executed by a terminal control device.
  • the device can be implemented by software and/or hardware, and can generally be integrated into an electronic device. in the device.
  • the method includes:
  • Step 101 In response to the three-dimensional information acquisition instruction sent by the preset terminal device in the vehicle, send a depth image shooting instruction to the preset image sensor in the vehicle.
  • the image sensor can collect the depth image data of the person in the vehicle and send the depth image data to the vehicle.
  • the vehicle The depth image data is processed to obtain the three-dimensional perception information of the person, and based on the three-dimensional perception information, the preset terminal device is controlled somatosensory, specifically:
  • the preset terminal device can be set according to the application scenario.
  • the default terminal device includes a mobile phone or a tablet computer.
  • the preset terminal device can send a three-dimensional information acquisition instruction to the vehicle.
  • the vehicle In response to the three-dimensional information acquisition instruction, the vehicle first sends a depth image to the preset image sensor in the vehicle.
  • the preset image sensor can be built-in or installed in the vehicle. This embodiment does not limit the type of the preset image sensor.
  • the type of the preset image sensor is not limited in this embodiment and can be determined according to the current configuration of the vehicle.
  • this Image sensors include structured light depth cameras or 3D Time of flight (3DTOF) cameras.
  • a first vehicle-machine connection between the vehicle and the preset mobile device can be established.
  • the first vehicle-machine connection can be established based on a connection protocol between the vehicle and the preset mobile device.
  • the connection protocol can restrict the format and type of files transmitted between the preset terminal device and the vehicle.
  • connection methods for the first car-to-machine connection which are not limited in this embodiment.
  • the first car-to-machine connection can be a wired connection method such as Type-C connection, or a wireless connection method such as Bluetooth connection.
  • a second vehicle-machine connection between the vehicle and the image sensor can also be established.
  • the connection method of the second vehicle-machine connection includes but is not limited to any one of wired connection and wireless connection.
  • Step 102 Receive the depth image data of the person in the vehicle acquired by the preset image sensor, process the depth image data, and obtain the person's three-dimensional perception information.
  • the preset image sensor After sending a depth image capture command to the preset image sensor in the vehicle, the preset image sensor responds to the depth image capture command to capture the person in the vehicle, thereby obtaining the depth image data of the person in the vehicle, and sends it to the vehicle.
  • the vehicle receives the depth image data and uses the computing unit in the vehicle to process the depth image data, thereby obtaining the three-dimensional perception information of the person.
  • the computing unit includes but is not limited to any one of a central processing unit and a graphics processor.
  • the type of three-dimensional perception information obtained after processing by the computing unit can be set according to the requirements of the application scenario. This embodiment is not limited.
  • the three-dimensional perception information can be the movement posture estimation information of the people in the vehicle; in the application scenario of controlling web browsing, the three-dimensional perception information can be the gesture information of the people in the vehicle.
  • neural network calculation processing can be performed on all portrait image data in the depth image data, thereby obtaining three-dimensional perception information of all persons captured by the image sensor.
  • the depth image data can be filtered to determine the target image data of the preset person who is authorized to control the preset terminal device, thereby processing the target image data to obtain the preset Personnel's three-dimensional perception information. This prevents unauthorized personnel from controlling the preset terminal device.
  • Step 103 Send the three-dimensional sensing information to the preset terminal device, and perform somatosensory control on the preset terminal device through the three-dimensional sensing information.
  • the three-dimensional perception information is sent to the preset terminal device.
  • the preset terminal device receives the three-dimensional perception information, it can realize the somatosensory perception of the preset terminal device based on the three-dimensional perception information. control. For example, if the application scenario is a somatosensory game, the posture of the virtual character in the game can be determined based on the three-dimensional perception information; if the application scenario is web browsing control, the control instructions for the web page can be determined based on the three-dimensional perception information.
  • a depth image shooting instruction is sent to the preset image sensor in the vehicle; and the depth image data of the person in the vehicle obtained by the preset image sensor is received. , process the depth image data to obtain the three-dimensional perception information of the person; send the three-dimensional perception information to the preset terminal device, and perform somatosensory control on the preset terminal device through the three-dimensional perception information. Therefore, based on the vehicle and the preset image sensor, three-dimensional sensing information can be sent to the preset terminal equipment, so that the preset terminal equipment can realize somatosensory control, thereby expanding the functions of the preset terminal equipment and improving the control of the preset terminal equipment. Control is easy, timely and fun.
  • FIG. 2 is a schematic flowchart of another terminal control method provided by an embodiment of the present disclosure. As shown in Figure 2, the method includes the following steps:
  • Step 201 Analyze the three-dimensional information acquisition instructions sent by the preset terminal equipment in the vehicle to determine the device identification corresponding to the preset terminal equipment.
  • the authorization identification is used to determine whether the preset terminal device is authorized to obtain the three-dimensional sensing information of the people in the vehicle, thereby ensuring the information security of the people in the vehicle.
  • the three-dimensional information acquisition instruction sent by the preset terminal device in the vehicle is parsed to determine the device identification of the preset terminal device that requests the acquisition of three-dimensional sensing information.
  • the device identification may be a product serial number or other identification that corresponds one-to-one with the terminal device.
  • Step 202 Determine whether the device identification belongs to the authorized identification. If the device identification belongs to the authorized identification, send a depth image shooting instruction to the preset image sensor.
  • the authorization identification is the equipment identification of the terminal device that is authorized to obtain the three-dimensional sensing information of the person in the vehicle.
  • the authorization identification can be preset When a terminal device requests three-dimensional sensing information for the first time, it determines whether to add the device identifier corresponding to the preset terminal device to the authorization identifier, or determine the authorization identifier through a method preset by the car owner.
  • Step 203 Receive the depth image data of the person in the vehicle acquired by the preset image sensor, and extract the candidate face data in the depth image data.
  • the depth image data captured by the preset image sensor may include multiple people. Some bystanders do not control the preset terminal equipment, but the three-dimensional perception information of these bystanders may also be collected, thereby Causes incorrect control of preset terminal equipment. In order to avoid such miscontrol situations, in this embodiment, the depth image data is filtered by presetting face data. Specifically:
  • Step 204 Match the candidate face data with the preset face data corresponding to the preset person to obtain successfully matched target face data.
  • the preset person is the person who currently controls the preset terminal device.
  • Step 205 Obtain the target image data associated with the target face data in the depth image data.
  • the target image data is image data in the depth image data that is the same as the person to whom the target face data belongs.
  • the target person can be determined based on the target face data, and then the target image data of the target person in the depth image data can be determined.
  • Step 206 Process the target image data to obtain the three-dimensional perception information of the target person.
  • the target person After acquiring the target image data, perform neural network calculation and processing on the target image data to obtain the three-dimensional perception information of the target person.
  • the target person is a person who matches the target face data.
  • Step 207 Send the three-dimensional sensing information to the preset terminal device, and perform somatosensory control on the preset terminal device through the three-dimensional sensing information.
  • the private information of the people in the vehicle is further protected and the information security is improved. And it can identify the target image data of the target person, thereby avoiding misoperation of the preset terminal equipment by other people in the vehicle, and improving the accuracy and practicality of the terminal control method.
  • FIG 3 is a schematic flowchart of another terminal control method provided by an embodiment of the present disclosure. This method is applied to terminal equipment. This method can be executed by a terminal control device. The device can be implemented by software and/or hardware, and can generally be integrated. in electronic devices. As shown in Figure 3, the method includes:
  • Step 301 Send a three-dimensional information acquisition instruction to the vehicle.
  • the terminal device includes but is not limited to mobile devices such as mobile phones and tablet computers. It is limited by factors such as the sensor type on the terminal device.
  • the terminal device needs to To obtain the three-dimensional sensing information through the vehicle, first send a three-dimensional information acquisition instruction to the vehicle.
  • the user of the terminal device may be prompted through prompt information, specifically including:
  • the three-dimensional acquisition prompt information is used to prompt the user that the terminal device will request the vehicle for the three-dimensional perception information of the person in the vehicle.
  • the three-dimensional acquisition prompt information may be a pop-up window prompt information, or the three-dimensional acquisition prompt information may be a drop-down list prompt information.
  • a three-dimensional information acquisition instruction is sent to the vehicle according to the preset connection protocol. If the user confirms the three-dimensional acquisition prompt information, it means that the user authorizes the terminal device to initiate a request for acquiring three-dimensional sensing information to the vehicle, and then sends a three-dimensional information acquisition instruction to the vehicle according to the preset connection protocol.
  • Step 302 Receive the three-dimensional sensing information sent by the vehicle, match the three-dimensional sensing information with the posture template, and determine the target posture of the person in the vehicle based on the matching result.
  • the vehicle After the vehicle receives the three-dimensional information acquisition instruction, it can obtain the depth image data of the person in the vehicle through the preset image sensor in the vehicle, and process the depth image data to obtain the three-dimensional perception information of the person in the vehicle and send the three-dimensional perception
  • the terminal device After receiving the three-dimensional sensing information, the terminal device can match the three-dimensional sensing information with the posture template, and use the successfully matched posture in the posture template as the target posture of the person in the vehicle.
  • the three-dimensional sensing information can be matched with the posture templates, the confidence corresponding to each posture template is determined, and the posture template with the highest confidence is set as the target posture of the person in the vehicle.
  • Step 303 Perform somatosensory control on the terminal device according to the target posture.
  • the control instructions for the terminal equipment can be determined based on the target posture, and the terminal equipment can be manipulated according to the control instructions, thereby realizing somatosensory control of the terminal equipment. Based on this somatosensory control, it can be implemented in the vehicle.
  • the terminal device to play motion sensing games, browsing the web through motion sensing and other functions further expands the functions of the terminal device.
  • the three-dimensional perception information is the gesture information and the gesture template is the gesture template, which includes the following steps:
  • the gesture information is matched with the gesture template, and the target gesture is determined based on the matching confidence corresponding to the gesture template.
  • the gesture template can be set according to the requirements of the application scenario. This embodiment is not limited.
  • the gesture information is matched with the gesture template, the matching confidence corresponding to each gesture template is obtained, and the gesture with the highest matching confidence is obtained.
  • the template is determined as the target gesture.
  • the target operation identifier corresponding to the target gesture is determined.
  • the gesture operation correspondence includes the gesture and its corresponding operation identifier. After determining the target gesture, the gesture operation correspondence can be searched based on the target gesture, thereby determining the target operation identifier corresponding to the target gesture.
  • the gesture template can include waving down, waving up, etc.
  • the operation identifier corresponding to the upward wave is the page-turning symbol
  • the operation identifier corresponding to the down-waving is the page-turning symbol. If The target gesture that successfully matches the gesture information is an upward wave. Then the gesture operation relationship is queried based on the upward wave.
  • the determined target operation identifier is a page up identifier. According to the page up identifier, the web page browsed in the terminal device is flipped up. Page control.
  • a three-dimensional information acquisition instruction is sent to the vehicle; the three-dimensional sensing information sent by the vehicle is received, the three-dimensional sensing information is matched with the posture template, and the target posture of the person in the vehicle is determined based on the matching result; and the terminal device is configured according to the target posture.
  • Perform somatosensory control As a result, the terminal device can obtain the three-dimensional perception information of the person in the vehicle, thereby realizing the somatosensory control of the terminal device by the person in the vehicle, expanding the application scenarios of the terminal device, and improving the convenience of controlling the preset terminal device. Timely and interesting.
  • FIG. 4 shows a schematic structural diagram of a terminal control device provided by an embodiment of the present disclosure.
  • the terminal control device shown in Figure 4 may be executed by an electronic device or a server.
  • the electronic device may include, but is not limited to, a smartphone, a laptop, a personal digital assistant (PDA), a tablet computer (PAD), a portable multimedia player (PMP), a vehicle-mounted terminal (such as a vehicle-mounted navigation terminal), a wearable device, etc.
  • PDA personal digital assistant
  • PAD tablet computer
  • PMP portable multimedia player
  • vehicle-mounted terminal such as a vehicle-mounted navigation terminal
  • wearable device etc.
  • Mobile terminals, as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc.
  • the server can be a server cluster or a cloud server.
  • the terminal control device 400 may include: a first sending module 401, a processing module 402, and a second sending module 403.
  • the first sending module 401 is used to respond to the three-dimensional information acquisition instruction sent by the preset terminal device in the vehicle, and send the information to the vehicle.
  • the default image sensor inside sends depth image shooting instructions;
  • the processing module 402 is used to receive the depth image data of the person in the vehicle obtained by the preset image sensor, process the depth image data, and obtain the three-dimensional perception information of the person;
  • the second sending module 403 is used to send three-dimensional sensing information to the preset terminal device, and perform somatosensory control on the preset terminal device through the three-dimensional sensing information.
  • the first sending module 401 is used for:
  • the processing module 402 is used for:
  • the preset terminal device includes a preset mobile device, and the device further includes:
  • the first connection module is used to establish the first vehicle-machine connection between the vehicle and the preset mobile device;
  • the second connection module is used to establish a second vehicle-machine connection between the vehicle and the image sensor.
  • FIG. 5 shows a schematic structural diagram of another terminal control device provided by an embodiment of the present disclosure.
  • the terminal control device shown in Figure 5 may be executed by an electronic device or a server.
  • the electronic device may include, but is not limited to, a smartphone, a laptop, a personal digital assistant (PDA), a tablet computer (PAD), a portable multimedia player (PMP), a vehicle-mounted terminal (such as a vehicle-mounted navigation terminal), a wearable device, etc.
  • PDA personal digital assistant
  • PAD tablet computer
  • PMP portable multimedia player
  • vehicle-mounted terminal such as a vehicle-mounted navigation terminal
  • wearable device etc.
  • Mobile terminals, as well as fixed terminals such as digital TVs, desktop computers, smart home devices, etc.
  • the server can be a server cluster or a cloud server.
  • the terminal control device 500 may include: a third sending module 501 , a matching module 502 , and a control module 503 .
  • the third sending module 501 is used to send three-dimensional information acquisition instructions to the vehicle;
  • the matching module 502 is used to receive the three-dimensional perception information sent by the vehicle, and match the three-dimensional perception information with the posture template. Match, and determine the target posture of the person in the vehicle based on the matching results;
  • the control module 503 is used to perform somatosensory control on the terminal device according to the target posture.
  • the third sending module 501 is used for:
  • a three-dimensional information acquisition instruction is sent to the vehicle according to the preset connection protocol.
  • the three-dimensional sensing information includes gesture information
  • the matching module 502 is used to:
  • the target operation identifier corresponding to the target gesture is determined.
  • the terminal control device provided by the embodiments of the present disclosure can execute the terminal control method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the method.
  • FIG. 6 shows a schematic diagram of the hardware circuit structure of a terminal control device provided by an embodiment of the present disclosure.
  • the terminal control device 600 may include a controller 601 and a memory 602 storing computer program instructions.
  • controller 601 may include a central processing unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits according to the embodiments of the present application.
  • CPU central processing unit
  • ASIC Application Specific Integrated Circuit
  • Memory 602 may include bulk storage for information or instructions.
  • the memory 602 may include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive or both. A combination of the above.
  • Memory 602 may include removable or non-removable (or fixed) media, where appropriate.
  • Memory 602 may be internal or external to the integrated gateway device, where appropriate.
  • memory 602 is non-volatile solid-state memory.
  • memory 602 includes read-only memory (ROM).
  • the ROM can be a mask-programmed ROM, programmable ROM (Programmable ROM, PROM), erasable PROM (Electrical Programmable ROM, EPROM), electrically erasable PROM (Electrically Erasable Programmable ROM, EEPROM) ), electrically rewritable ROM (Electrically Alterable ROM, EAROM) or flash memory, or a combination of two or more of these.
  • the controller 601 reads and executes the computer program instructions stored in the memory 602 to execute the steps of the terminal control method provided by the embodiment of the present disclosure.
  • the terminal control device 600 may also include a transceiver 603 and a bus 604. Among them, as shown in Figure 6, the controller 601, the memory 602 and the transceiver 603 are connected through the bus 604 and complete communication with each other.
  • Bus 604 includes hardware, software, or both.
  • the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side BUS (FSB), an Ultra Transmission (Hyper Transport, HT) interconnect, Industrial Standard Architecture (ISA) bus, infinite bandwidth interconnect, Low Pin Count (LPC) bus, memory bus, Micro Channel Architecture , MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association part (Video Electronics Standards Association Local Bus (VLB) bus or other suitable bus or a combination of two or more of these.
  • bus 604 may include one or more buses.
  • This computer-readable storage medium belongs to the same inventive concept as the terminal control methods of the above-mentioned embodiments, and is not detailed in the embodiments of the computer-readable storage medium. For description details, reference may be made to the above embodiments of the lane keeping method.
  • This embodiment provides a storage medium containing computer-executable instructions.
  • the computer-executable instructions When executed by a computer processor, the computer-executable instructions are used to execute a terminal control method.
  • the method includes: responding to a three-dimensional command sent by a preset terminal device in the vehicle.
  • Information acquisition instructions send depth image shooting instructions to the preset image sensor in the vehicle; receive the depth image data of the person in the vehicle obtained by the preset image sensor, process the depth image data, and obtain the three-dimensional perception information of the person; send three-dimensional perception information
  • the information is sent to the preset terminal device, and the preset terminal device is controlled through three-dimensional sensing information.
  • the embodiments of the present disclosure provide a storage medium containing computer-executable instructions.
  • the computer-executable instructions are not limited to the above method operations, and can also perform related operations in the terminal control method provided by any embodiment of the present disclosure. .
  • the present disclosure can be implemented with the help of software and necessary general hardware. Of course, it can also be implemented with hardware, but in many cases the former is a better implementation. .
  • the technical solution of the present disclosure is essentially or contributes to the existing technology. It can be embodied in the form of software products.
  • the computer software products can be stored in computer-readable storage media, such as computer floppy disks, read-only memory (ROM), random access memory (Random Access Memory, RAM). ), flash memory (FLASH), hard disk or optical disk, etc., including several instructions to cause a computer cloud platform (which can be a personal computer, server, or network cloud platform, etc.) to execute the terminal control method provided by various embodiments of the present disclosure.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开涉及终端控制方法、装置、设备及存储介质。该方法包括：响应于车辆内预设终端设备发送的三维信息获取指令，向车辆内的预设影像传感器发送深度影像拍摄指令；接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息；发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。

Description

终端控制方法、装置、设备及存储介质
相关申请的交叉引用
本申请基于申请号为202210293293.1、申请日为2022年3月23日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及信息技术领域，尤其涉及终端控制方法、装置、设备及存储介质。
背景技术
随着车辆工程技术的发展，车辆内可以实现的功能愈加丰富。
相关技术中，用户在车辆内使用手机等终端设备玩游戏、查阅资料时，需要通过手指在该终端设备的屏幕进行点击等触控操作，从而实现对终端设备的控制。但是，通过触控操作控制终端设备的便捷性较差，在无法触控到该终端设备的情况下，无法及时对该终端设备进行操控。
发明内容
为了解决上述技术问题，本公开提供了一种终端控制方法、装置、设备及存储介质。
第一方面，本公开提供了一种终端控制方法，所述方法应用于车辆，包括：
响应于所述车辆内预设终端设备发送的三维信息获取指令，向所述车辆内的预设影像传感器发送深度影像拍摄指令；
接收所述预设影像传感器获取的所述车辆内人员的深度影像数据，对所述深度影像数据进行处理，获取所述人员的三维感知信息；
发送所述三维感知信息至所述预设终端设备，通过所述三维感知信息对所述预设终端设备进行体感控制。
第二方面，本公开提供了另一种终端控制方法，所述方法应用于终端设备，包括：
接收所述车辆发送的三维感知信息，将所述三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；
根据所述目标姿态对所述终端设备进行体感控制。
第三方面，本公开提供了一种终端控制装置，所述装置应用于车辆，包括：
第一发送模块，用于响应于所述车辆内预设终端设备发送的三维信息获取指令，向所述车辆内的预设影像传感器发送深度影像拍摄指令；
处理模块，用于接收所述预设影像传感器获取的所述车辆内人员的深度影像数据，对所述深度影像数据进行处理，获取所述人员的三维感知信息；
第二发送模块，用于发送所述三维感知信息至所述预设终端设备，通过所述三维感知信息对所述预设终端设备进行体感控制。
第四方面，本公开提供了另一种终端控制装置，所述装置应用于终端设备，包括：
第三发送模块，用于向车辆发送三维信息获取指令；
匹配模块，用于接收所述车辆发送的三维感知信息，将所述三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；
控制模块，用于根据所述目标姿态对所述终端设备进行体感控制。
第五方面，本公开实施例还提供了一种终端控制设备，包括：
处理器；
存储器，用于存储可执行指令；
其中，处理器用于从存储器中读取可执行指令，并执行可执行指令以实现上述第一方面或第二方面的终端控制方法。
第六方面，本公开实施例还提供了一种计算机可读存储介质，存储介质存储有计算机程序，当计算机程序被处理器执行时，使得处理器实现上述第一方面或第二方面的终端控制方法。
本公开实施例提供的技术方案与现有技术相比具有如下优点：
本公开实施例的一种终端控制方法、装置、设备及存储介质，响应于车辆内预设终端设备发送的三维信息获取指令，向车辆内的预设影像传感器发送深度影像拍摄指令；接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息；发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。由此，基于车辆以及预设影像传感器，能够发送三维感知信息至预设终端设备，使得预设终端设备能够实现体感控制，从而扩展了该预设终端设备的功能，提高了对预设终端设备进行控制的便捷性、及时性以及趣味性。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。
为了更清楚地说明本公开实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本公开实施例提供的一种终端控制方法的流程示意图；
图2为本公开实施例提供的另一种终端控制方法的流程示意图；
图3为本公开实施例提供的又一种终端控制方法的流程示意图；
图4为本公开实施例提供的一种终端控制装置的结构示意图；
图5为本公开实施例提供的另一种终端控制装置的结构示意图；
图6为本公开实施例提供的一种终端控制设备的硬件电路结构示意图。
具体实施方式
为了能够更清楚地理解本公开的上述目的、特征和优点，下面将对本公开的方案进行进一步描述。需要说明的是，在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本公开，但本公开还可以采用其他不同于在此描述的方式来实施；显然，说明书中的实施例只是本公开的一部分实施例，而不是全部的实施例。
为了解决上述问题，本公开实施例提供了一种终端控制方法、装置、设备及存储介质。
图1为本公开实施例提供的一种终端控制方法的流程示意图，该方法应用于车辆，该方法可以由终端控制装置执行，其中该装置可以采用软件和/或硬件实现，一般可集成在电子设备中。如图1所示，该方法包括：
步骤101，响应于车辆内预设终端设备发送的三维信息获取指令，向车辆内的预设影像传感器发送深度影像拍摄指令。
在本实施例中，车辆内存在预设影像传感器，在对预设终端设备进行体感控制的过程中，该影像传感器能够采集车辆内人员的深度影像数据并将该深度影像数据发送给车辆，车辆对该深度影像数据进行处理，获得人员的三维感知信息，基于该三维感知信息对预设终端设备进行体感控制，具体地：
在本实施例中，预设终端设备可以根据应用场景进行设置，本实施例不做限制，例如 该预设终端设备包括手机或平板电脑。在需要通过体感控制操控该预设终端设备的情况下，该预设终端设备可以向车辆发送三维信息获取指令，车辆响应于该三维信息获取指令，首先向车辆内的预设影像传感器发送深度影像拍摄指令。该预设影像传感器可以为车辆自带的，也可以为加装的，本实施例不作限制，该预设影像传感器的种类本实施例也不做限制，可以根据车辆的当前配置确定，例如该影像传感器包括结构光深度相机或三维飞行时间(3D Time of flight，3DTOF)相机。
可选地，在首次使用该终端控制方法等应用场景中，可以建立车辆与预设移动设备之间的第一车机连接。该第一车机连接可以基于车辆与预设移动设备之间的连接协议进行建立，在该连接协议中可以约束预设终端设备与车辆之间传输的文件的格式、文件的类型等。该第一车机连接的连接方式有多种，本实施例不做限制，例如，该第一车机连接可以为Type-C连接等有线连接方式，也可以为蓝牙连接等无线连接方式。
在首次使用该终端控制方法等应用型场景中，还可以建立车辆与影像传感器之间的第二车机连接。该第二车机连接的连接方式包括但不限于有线连接、无线连接中的任一种。
步骤102，接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息。
向所述车辆内的预设影像传感器发送深度影像拍摄指令之后，预设影像传感器响应于该深度影像拍摄指令对车辆内的人员进行拍摄，从而获得车辆内人员的深度影像数据，并向车辆发送该深度影像数据，车辆接收到该深度影像数据，并使用车辆内的计算单元对该深度影像数据进行处理，从而能够获得该人员的三维感知信息。其中，计算单元包括但不限于中央处理器、图形处理器中的任一种，经过该计算单元处理之后获得的三维感知信息的类型可以根据应用场景需求进行设置，本实施例不作限制，例如，在体感游戏应用场景下，该三维感知信息可以为车辆内人员的运动姿态估计信息；在控制网页浏览的应用场景中，该三维感知信息可以为车辆内人员的手势信息。
上述对深度影像数据进行处理，获取人员的三维感知信息的方法有多种，本实施例不做限制，示例说明如下：
一种可选的实施方式中，可以对深度影像数据中的所有人像影像数据进行神经网络计算处理，从而获得影像传感器拍摄到的所有人员的三维感知信息。
另一种可选的实施方式中，可以对深度影像数据进行筛选，确定被授权对预设终端设备进行控制的预设人员的目标影像数据，从而对该目标影像数据进行处理，获得该预设人员的三维感知信息。从而避免了未获得授权的人员控制该预设终端设备。
步骤103，发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。
在对深度影像数据进行处理获得三维感知信息之后，将该三维感知信息发送至预设终端设备，预设终端设备接收该三维感知信息之后，可以基于该三维感知信息实现对预设终端设备的体感控制。例如，若应用场景为体感游戏，可以基于该三维感知信息确定游戏中虚拟人物的姿态；若应用场景为网页浏览控制，可以基于该三维感知信息确定对网页的控制指令。
在本公开实施例中，响应于车辆内预设终端设备发送的三维信息获取指令，向车辆内的预设影像传感器发送深度影像拍摄指令；接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息；发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。由此，基于车辆以及预设影像传感器，能够发送三维感知信息至预设终端设备，使得预设终端设备能够实现体感控制，从而扩展了该预设终端设备的功能，提高了对预设终端设备进行控制的便捷性、及时性以及趣味性。
图2为本公开实施例提供的另一种终端控制方法的流程示意图，如图2所示，该方法包括以下步骤：
步骤201，解析车辆内预设终端设备发送的三维信息获取指令，确定预设终端设备对应的设备标识。
在本实施例中，通过授权标识判断预设终端设备是否被授权获取车辆内人员的三维感知信息，从而保证了车内人员的信息安全。首先，对车辆内预设终端设备发送的三维信息获取指令进行解析，从而确定该请求获取三维感知信息的预设终端设备的设备标识。一种可的实施方式中，该设备标识可以为产品序列号等与终端设备一一对应的标识。
步骤202，判断设备标识是否属于授权标识，若设备标识属于授权标识，发送深度影像拍摄指令至预设影像传感器。
在本实施例中，授权标识为被授权获取车内人员的三维感知信息的终端设备具有的设备标识，该授权标识的确定方法有多种，本实施例不做限制，例如，可以在预设终端设备首次请求获取三维感知信息时，判断是否将该预设终端设备对应的设备标识添加入授权标识中，或者，可以通过车主预先设置的方法确定授权标识。
判断预设终端设备的设备标识是否属于授权标识，若该设备标识属于授权标识，则说 明该预设终端设备被允许获取三维感知信息，进而向预设影像传感器发送深度影像拍摄指令。
步骤203，接收预设影像传感器获取的车辆内人员的深度影像数据，提取深度影像数据中的候选人脸数据。
在一些应用场景中，预设影像传感器拍摄的深度影像数据中可能包括多位人员，其中一些旁观人员不对预设终端设备进行控制，但是这些旁观人员的三维感知信息可能也被采集到，从而对造成对预设终端设备的误控制。为了避免发生此类误控制情况，在本实施例中通过预设人脸数据，实现了对深度影像数据的筛选，具体的：
接收预设影像传感器获取的车辆内人员的深度影像数据，并对该深度影像数据进行人脸数据提取，获得该深度影像数据中包括的候选人脸数据。
步骤204，将候选人脸数据与预设人员对应的预设人脸数据进行匹配，获得匹配成功的目标人脸数据。
在本实施例中，预设人员为当前对预设终端设备进行控制的人员，其中该预设人脸数据的获取方法有多种，可以根据应用场景进行选择，本实施例不作限制，例如可以在对预设终端设备进行体感控制前，预先采集该预设人员的人脸数据新信息作为的预设人脸数据；也可以预先采集多个人员的备选人脸数据，在对预设终端设备进行体感控制前，从多个备选人脸数据中选择确定预设人脸数据。在确定候选人脸数据之后，将候选人脸数据与该预设人脸数据进行匹配，获得匹配成功的目标人脸数据。
步骤205，获取深度影像数据中与目标人脸数据关联的目标影像数据。
在本实施例中，目标影像数据为深度影像数据中与目标人脸数据所属人员相同的影像数据。通过获取与目标人脸数据关联的目标影像数据，能够过滤掉深度影像数据中旁观人员的影像数值。
一种可选的实施方式中，可以根据目标人脸数据确定目标人员，进而确定深度影像数据中该目标人员的目标影像数据。
步骤206，对目标影像数据进行处理，获得目标人员的三维感知信息。
在获取目标影像数据之后，对该目标影像数据进行神经网络计算处理，从而获得目标人员的三维感知信息。其中，目标人员为与目标人脸数据相匹配的人员。
步骤207，发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。
由此，在本公开实施例中，进一步保护了车内人员的隐私信息，提高了信息安全性， 并且能够识别目标人员的目标影像数据，从而避免了车内其他人员对预设终端设备的误操作，提高了该终端控制方法的准确性和实用性。
图3为本公开实施例提供的又一种终端控制方法的流程示意图，该方法应用于终端设备，该方法可以由终端控制装置执行，其中该装置可以采用软件和/或硬件实现，一般可集成在电子设备中。如图3所示，该方法包括：
步骤301，向车辆发送三维信息获取指令。
在本实施例中，该终端设备包括但不限于手机、平板电脑等移动设备，受限于该终端设备上的传感器类型等因素，在需要获取车辆内人员的三维感知信息时，该终端设备需要通过车辆获取该三维感知信息，首先向车辆发送三维信息获取指令。
一种可选的实施方式中，在向车辆发送三维信息获取指令之前，可以通过提示信息向该终端设备的用户进行提示，具体包括：
向用户展示三维获取提示信息。其中，三维获取提示信息用于向用户提示终端设备将向车辆请求车辆内人员的三维感知信息，该三维获取提示信息的类型有多种，可以根据应用场景等进行设置，本实施例不作限制，例如，该三维获取提示信息可以为弹窗提示信息，或者，该三维获取提示信息可以为下拉列表提示信息。
若用户确认三维获取提示信息，根据预设连接协议向车辆发送三维信息获取指令。若用户确认该三维获取提示信息，则说明用户授权该终端设备向车辆发起获取三维感知信息的请求，进而根据预设连接协议向车辆发送三维信息获取指令。
步骤302，接收车辆发送的三维感知信息，将三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态。
车辆接收到该三维信息获取指令后，可以通过车内的预设影像传感器获取车内人员的深度影像数据，并对该深度影像数据进行处理，获得车辆内人员的三维感知信息并发送该三维感知信息，终端设备接收到该三维感知信息之后，可以将三维感知信息和姿态模板进行匹配，将姿态模板中匹配成功的姿态作为车内人员的目标姿态。
一种可选的实施方式中，可以将三维感知信息和姿态模板进行匹配，确定各姿态模板对应的置信度，将其中置信度最高的姿态模板设置为车内人员的目标姿态。
步骤303，根据目标姿态对终端设备进行体感控制。
确定目标姿态之后，可以根据该目标姿态确定对终端设备的控制指令，根据该控制指令操控终端设备，从而实现了对终端设备的体感控制，基于该体感控制能够实现在车辆内 使用终端设备玩体感游戏、通过体感浏览网页等功能，进而扩展了该终端设备的功能。
以通过手势对终端设备进行体感控制为例，说明对该终端设备进行体感控制的过程，在该应用场景中，三维感知信息为手势信息、姿态模板为手势模板，包括以下步骤：
首先，将手势信息和手势模板进行匹配，根据手势模板对应的匹配置信度确定目标手势。在本实施例中，手势模板可以根据应用场景需求进行设置，本实施例不作限制，将手势信息与该手势模板进行匹配，获得各手势模板对应的匹配置信度，将其中匹配置信度最高的手势模板确定为目标手势。
进一步的，根据手势操作对应关系，确定目标手势对应的目标操作标识。在手势操作对应关系中，包括手势及其对应的操作标识，在确定目标手势之后，可以根据该目标手势对手势操作对应关系进行查找操作，从而确定该目标手势对应的目标操作标识。
最后，根据目标操作标识对终端设备进行体感控制。
以网页浏览为例，手势模板可以包括下挥手、上挥手等，在手势操作对应关系中，上挥手对应的操作标识为向上翻页标识，下挥手对应的操作标识为向下翻页标识，若与手势信息匹配成功的目标手势为上挥手，则根据上挥手对手势操作关系进行查询，确定的目标操作标识为上翻页标识，根据该上翻页标识对终端设备中浏览的网页进行上翻页控制。
在本公开实施例中，向车辆发送三维信息获取指令；接收车辆发送的三维感知信息，将三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；根据目标姿态对终端设备进行体感控制。由此，终端设备能够获取车内人员的三维感知信息，从而实现车内人员对该终端设备的体感控制，扩展了该终端设备的应用场景，提高了对预设终端设备进行控制的便捷性、及时性以及趣味性。
图4示出了本公开实施例提供的一种终端控制装置的结构示意图。
在本公开一些实施例中，图4所示的终端控制装置可以由电子设备或服务器执行。该电子设备可以包括但不限于诸如智能手机、笔记本电脑、个人数字助理(PDA)、平板电脑(PAD)、便携式多媒体播放器(PMP)、车载终端(例如车载导航终端)、可穿戴设备等的移动终端，以及诸如数字TV、台式计算机、智能家居设备等的固定终端。服务器可以是服务器集群也可以是云服务器。
如图4所示，该终端控制装置400可以包括：第一发送模块401、处理模块402、第二发送模块403。
第一发送模块401，用于响应于车辆内预设终端设备发送的三维信息获取指令，向车辆 内的预设影像传感器发送深度影像拍摄指令；
处理模块402，用于接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息；
第二发送模块403，用于发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。
在本公开一些实施例中，第一发送模块401，用于：
解析车辆内预设终端设备发送的三维信息获取指令，确定预设终端设备对应的设备标识；
判断设备标识是否属于授权标识，若设备标识属于授权标识，发送深度影像拍摄指令至预设影像传感器。
在本公开一些实施例中，处理模块402，用于：
提取深度影像数据中的候选人脸数据；
将候选人脸数据与预设人员对应的预设人脸数据进行匹配，获得匹配成功的目标人脸数据；
获取深度影像数据中与目标人脸数据关联的目标影像数据；
对目标影像数据进行处理，获得预设人员的三维感知信息。
在本公开一些实施例中，预设终端设备包括预设移动设备，装置还包括：
第一连接模块，用于建立车辆与预设移动设备之间的第一车机连接；
第二连接模块，用于建立车辆与影像传感器之间的第二车机连接。
图5示出了本公开实施例提供的另一种终端控制装置的结构示意图。
在本公开一些实施例中，图5所示的终端控制装置可以由电子设备或服务器执行。该电子设备可以包括但不限于诸如智能手机、笔记本电脑、个人数字助理(PDA)、平板电脑(PAD)、便携式多媒体播放器(PMP)、车载终端(例如车载导航终端)、可穿戴设备等的移动终端，以及诸如数字TV、台式计算机、智能家居设备等的固定终端。服务器可以是服务器集群也可以是云服务器。
如图5所示，该终端控制装置500可以包括：第三发送模块501、匹配模块502、控制模块503。
第三发送模块501，用于向车辆发送三维信息获取指令；
匹配模块502，用于接收车辆发送的三维感知信息，将三维感知信息和姿态模板进行匹 配，根据匹配结果确定车内人员的目标姿态；
控制模块503，用于根据目标姿态对终端设备进行体感控制。
在本公开一些实施例中，第三发送模块501，用于：
向用户展示三维获取提示信息；
若用户确认三维获取提示信息，根据预设连接协议向车辆发送三维信息获取指令。
在本公开一些实施例中，三维感知信息包括手势信息，匹配模块502，用于：
将手势信息和手势模板进行匹配，根据手势模板对应的匹配置信度确定目标手势；
控制模块503，用于：
根据手势操作对应关系，确定目标手势对应的目标操作标识。
根据目标操作标识对终端设备进行体感控制。
本公开实施例所提供的终端控制装置可执行本公开任意实施例所提供的终端控制方法，具备执行方法相应的功能模块和有益效果。
图6示出了本公开实施例提供的一种终端控制设备的硬件电路结构示意图。
如图6所示，该终端控制设备600可以包括控制器601以及存储有计算机程序指令的存储器602。
具体地，上述控制器601可以包括中央处理器(CPU)，或者特定集成电路(Application Specific Integrated Circuit，ASIC)，或者可以被配置成实施本申请实施例的一个或多个集成电路。
存储器602可以包括用于信息或指令的大容量存储器。举例来说而非限制，存储器602可以包括硬盘驱动器(Hard Disk Drive，HDD)、软盘驱动器、闪存、光盘、磁光盘、磁带或通用串行总线(Universal Serial Bus，USB)驱动器或者两个及其以上这些的组合。在合适的情况下，存储器602可包括可移除或不可移除(或固定)的介质。在合适的情况下，存储器602可在综合网关设备的内部或外部。在特定实施例中，存储器602是非易失性固态存储器。在特定实施例中，存储器602包括只读存储器(Read-Only Memory，ROM)。在合适的情况下，该ROM可以是掩模编程的ROM、可编程ROM(Programmable ROM，PROM)、可擦除PROM(Electrical Programmable ROM，EPROM)、电可擦除PROM(Electrically Erasable Programmable ROM，EEPROM)、电可改写ROM(Electrically Alterable ROM，EAROM)或闪存，或者两个或及其以上这些的组合。
控制器601通过读取并执行存储器602中存储的计算机程序指令，以执行本公开实施例所提供的终端控制方法的步骤。
在一个示例中，该终端控制设备600还可包括收发器603和总线604。其中，如图6所示，控制器601、存储器602和收发器603通过总线604连接并完成相互间的通信。
总线604包括硬件、软件或两者。举例来说而非限制，总线可包括加速图形端口(Accelerated Graphics Port，AGP)或其他图形总线、增强工业标准架构(Extended Industry Standard Architecture，EISA)总线、前端总线(Front Side BUS，FSB)、超传输(Hyper Transport，HT)互连、工业标准架构(Industrial Standard Architecture，ISA)总线、无限带宽互连、低引脚数(Low Pin Count，LPC)总线、存储器总线、微信道架构(Micro Channel Architecture，MCA)总线、外围控件互连(Peripheral Component Interconnect，PCI)总线、PCI-Express(PCI-X)总线、串行高级技术附件(Serial Advanced Technology Attachment，SATA)总线、视频电子标准协会局部(Video Electronics Standards Association Local Bus，VLB)总线或其他合适的总线或者两个或更多个以上这些的组合。在合适的情况下，总线604可包括一个或多个总线。尽管本申请实施例描述和示出了特定的总线，但本申请考虑任何合适的总线或互连。
以下是本公开实施例提供的计算机可读存储介质的实施例，该计算机可读存储介质与上述各实施例的终端控制方法属于同一个发明构思，在计算机可读存储介质的实施例中未详尽描述的细节内容，可以参考上述车道保持方法的实施例。
本实施例提供一种包含计算机可执行指令的存储介质，计算机可执行指令在由计算机处理器执行时用于执行一种终端控制方法，该方法包括：响应于车辆内预设终端设备发送的三维信息获取指令，向车辆内的预设影像传感器发送深度影像拍摄指令；接收预设影像传感器获取的车辆内人员的深度影像数据，对深度影像数据进行处理，获取人员的三维感知信息；发送三维感知信息至预设终端设备，通过三维感知信息对预设终端设备进行体感控制。或者，向车辆发送三维信息获取指令；接收车辆发送的三维感知信息，将三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；根据目标姿态对终端设备进行体感控制。
当然，本公开实施例所提供的一种包含计算机可执行指令的存储介质，其计算机可执行指令不限于如上的方法操作，还可以执行本公开任意实施例所提供的终端控制方法中的相关操作。
通过以上关于实施方式的描述，所属领域的技术人员可以清楚地了解到，本公开可借助软件及必需的通用硬件来实现，当然也可以通过硬件实现，但很多情况下前者是更佳的实施方式。基于这样的理解，本公开的技术方案本质上或者说对现有技术做出贡献的部分 可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等，包括若干指令用以使得一台计算机云平台(可以是个人计算机，服务器，或者网络云平台等)执行本公开各个实施例所提供的终端控制方法。
注意，上述仅为本公开的较佳实施例及所运用技术原理。本领域技术人员会理解，本公开不限于这里的特定实施例，对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本公开的保护范围。因此，虽然通过以上实施例对本公开进行了较为详细的说明，但是本公开不仅仅限于以上实施例，在不脱离本公开构思的情况下，还可以包括更多其他等效实施例，而本公开的范围由所附的权利要求范围决定。

Claims (11)

  1. 一种终端控制方法，应用于车辆，所述方法包括：
    响应于所述车辆内预设终端设备发送的三维信息获取指令，向所述车辆内的预设影像传感器发送深度影像拍摄指令；
    接收所述预设影像传感器获取的所述车辆内人员的深度影像数据，对所述深度影像数据进行处理，获取所述人员的三维感知信息；
    发送所述三维感知信息至所述预设终端设备，通过所述三维感知信息对所述预设终端设备进行体感控制。
  2. 根据权利要求1所述的方法，其中所述响应于所述车辆内预设终端设备发送的三维信息获取指令，向所述车辆内的预设影像传感器发送深度影像拍摄指令，包括：
    解析所述车辆内预设终端设备发送的所述三维信息获取指令，确定所述预设终端设备对应的设备标识；
    判断所述设备标识是否属于授权标识，若所述设备标识属于所述授权标识，发送所述深度影像拍摄指令至所述预设影像传感器。
  3. 根据权利要求1或2所述的方法，其中所述对所述深度影像数据进行处理，获取所述人员的三维感知信息，包括：
    提取所述深度影像数据中的候选人脸数据；
    将所述候选人脸数据与预设人员对应的预设人脸数据进行匹配，获得匹配成功的目标人脸数据；
    获取所述深度影像数据中与所述目标人脸数据关联的目标影像数据；
    对所述目标影像数据进行处理，获得目标人员的所述三维感知信息。
  4. 根据权利要求1至3中任一项所述的方法，其中所述预设终端设备包括预设移动设备，所述方法还包括：
    建立所述车辆与所述预设移动设备之间的第一车机连接；
    建立所述车辆与所述影像传感器之间的第二车机连接。
  5. 一种终端控制方法，应用于终端设备，所述方法包括：
    向车辆发送三维信息获取指令；
    接收所述车辆发送的三维感知信息，将所述三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；
    根据所述目标姿态对所述终端设备进行体感控制。
  6. 根据权利要求5所述的方法，其中所述向车辆发送三维信息获取指令包括：
    向用户展示三维获取提示信息；
    若用户确认所述三维获取提示信息，根据预设连接协议向所述车辆发送所述三维信息获取指令。
  7. 根据权利要求5或6所述的方法，其中所述三维感知信息包括手势信息，所述将所述三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；根据所述目标姿态对所述终端设备进行体感控制，包括：
    将所述手势信息和手势模板进行匹配，根据所述手势模板对应的匹配置信度确定目标手势；
    根据手势操作对应关系，确定所述目标手势对应的目标操作标识；
    根据所述目标操作标识对所述终端设备进行体感控制。
  8. 一种终端控制装置，应用于车辆，所述终端控制装置包括：
    第一发送模块，用于响应于所述车辆内预设终端设备发送的三维信息获取指令，向所述车辆内的预设影像传感器发送深度影像拍摄指令；
    处理模块，用于接收所述预设影像传感器获取的所述车辆内人员的深度影像数据，对所述深度影像数据进行处理，获取所述人员的三维感知信息；
    第二发送模块，用于发送所述三维感知信息至所述预设终端设备，通过所述三维感知信息对所述预设终端设备进行体感控制。
  9. 一种终端控制装置，应用于终端设备，所述终端控制装置包括：
    第三发送模块，用于向车辆发送三维信息获取指令；
    匹配模块，用于接收所述车辆发送的三维感知信息，将所述三维感知信息和姿态模板进行匹配，根据匹配结果确定车内人员的目标姿态；
    控制模块，用于根据所述目标姿态对所述终端设备进行体感控制。
  10. 一种终端控制设备，包括：
    处理器；
    存储器，用于存储可执行指令；
    其中，所述处理器用于从所述存储器中读取所述可执行指令，并执行所述可执行指令以实现上述权利要求1-4中任一项所述的终端控制方法，或者上述权利要求5-7中任一项所述的终端控制方法。
  11. 一种计算机可读存储介质，其上存储有计算机程序，其中所述存储介质存储有计 算机程序，当所述计算机程序被处理器执行时，使得处理器实现上述权利要求1-4中任一项所述的终端控制方法，或者上述权利要求5-7中任一项所述的终端控制方法。
PCT/CN2023/080931 2022-03-23 2023-03-10 终端控制方法、装置、设备及存储介质 WO2023179383A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210293293.1 2022-03-23
CN202210293293.1A CN116841381A (zh) 2022-03-23 2022-03-23 终端控制方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2023179383A1 true WO2023179383A1 (zh) 2023-09-28

Family

ID=88099864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/080931 WO2023179383A1 (zh) 2022-03-23 2023-03-10 终端控制方法、装置、设备及存储介质

Country Status (2)

Country Link
CN (1) CN116841381A (zh)
WO (1) WO2023179383A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870802A (zh) * 2012-12-18 2014-06-18 现代自动车株式会社 使用指谷操作车辆内的用户界面的系统和方法
US20150116200A1 (en) * 2013-10-25 2015-04-30 Honda Motor Co., Ltd. System and method for gestural control of vehicle systems
CN110554766A (zh) * 2018-05-31 2019-12-10 柯刚铠 交互方法及车载交互装置
CN110816473A (zh) * 2019-11-29 2020-02-21 福尔达车联网（深圳）有限公司 一种车辆控制方法、车辆控制系统及存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870802A (zh) * 2012-12-18 2014-06-18 现代自动车株式会社 使用指谷操作车辆内的用户界面的系统和方法
US20150116200A1 (en) * 2013-10-25 2015-04-30 Honda Motor Co., Ltd. System and method for gestural control of vehicle systems
CN110554766A (zh) * 2018-05-31 2019-12-10 柯刚铠 交互方法及车载交互装置
CN110816473A (zh) * 2019-11-29 2020-02-21 福尔达车联网（深圳）有限公司 一种车辆控制方法、车辆控制系统及存储介质

Also Published As

Publication number Publication date
CN116841381A (zh) 2023-10-03

Similar Documents

Publication Publication Date Title
US9823762B2 (en) Method and apparatus for controlling electronic device using touch input
US20170053109A1 (en) Mobile terminal and method for controlling the same
US8928587B1 (en) Automatic device login based on wearable sensor fusion
EP2769289B1 (en) Method and apparatus for determining the presence of a device for executing operations
EP2897038B1 (en) Method for processing input and electronic device thereof
EP3565377A1 (en) Mobile terminal and method for controlling the same
WO2019105237A1 (zh) 图像处理方法、计算机设备和计算机可读存储介质
WO2018059328A1 (zh) 一种终端控制方法及终端、存储介质
US10904189B2 (en) Terminal and method for displaying previous conversation information while displaying message of current conversation at the terminal
CN105681657B (zh) 一种拍摄对焦的方法及终端设备
CN109039990A (zh) 基于验证码进行行为验证的方法及装置
CN113874828A (zh) 用于通过外部电子装置提供屏幕共享服务的电子装置、方法和计算机可读介质
US20150293670A1 (en) Method for operating message and electronic device therefor
CN113238727A (zh) 屏幕切换方法及装置、计算机可读介质和电子设备
US20150271312A1 (en) Motion to Connect to Kiosk
WO2017096959A1 (zh) 一种终端的图像采集方法及装置
CN107358083B (zh) 一种信息处理方法、终端及计算机可读存储介质
US9959034B2 (en) Mobile terminal and method for controlling the same
CN105491202B (zh) 一种移动终端及移动终端间实现名片交换的方法
WO2015002817A1 (en) Systems and methods for directing information flow using gestures
CN107066864B (zh) 一种应用图标显示方法及其设备
KR102096824B1 (ko) 보안 환경을 제공하는 장치 및 방법
WO2023179383A1 (zh) 终端控制方法、装置、设备及存储介质
CN107479808A (zh) 手指旋转角度值的生成方法及电子设备
KR20190065386A (ko) 애플리케이션 요청을 이용하여 태스크를 완료하기 위해 디바이스들을 페어링하기 위한 방법, 시스템 및 매체

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23773632

Country of ref document: EP

Kind code of ref document: A1