WO2018196184A1 - Plant monitoring method and monitoring system - Google Patents

Plant monitoring method and monitoring system Download PDF

Info

Publication number
WO2018196184A1
WO2018196184A1 PCT/CN2017/094087 CN2017094087W WO2018196184A1 WO 2018196184 A1 WO2018196184 A1 WO 2018196184A1 CN 2017094087 W CN2017094087 W CN 2017094087W WO 2018196184 A1 WO2018196184 A1 WO 2018196184A1
Authority
WO
WIPO (PCT)
Prior art keywords
head
camera
plant
image information
user
Prior art date
Application number
PCT/CN2017/094087
Other languages
French (fr)
Chinese (zh)
Inventor
贾二东
Original Assignee
深圳前海弘稼科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳前海弘稼科技有限公司 filed Critical 深圳前海弘稼科技有限公司
Publication of WO2018196184A1 publication Critical patent/WO2018196184A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals

Definitions

  • the invention relates to the field of information processing, in particular to a monitoring method and a monitoring system for a plant.
  • the existing plant monitoring method is to obtain the image of the plant at a fixed angle through a fixed camera, and display it to the user through a mobile phone or a computer screen. Since the shooting angle of the camera is fixed, the viewing field of the user is limited.
  • the prior art provides an input device to a user, such as a touch screen of a mobile phone or a mouse or a keyboard connected to a computer. The user can input a control command to the camera through the input device, so that the remote control camera changes its shooting angle, thereby widening The user's field of view.
  • the existing plant monitoring method cannot provide the user with an immersive observation experience, which is inconvenient for the user to understand the plant situation and the user experience is poor.
  • the invention provides a monitoring method and a monitoring system for a plant, which are used for solving the problem that the existing plant monitoring method cannot provide the user with an immersive observation experience.
  • An aspect of an embodiment of the invention provides a method for monitoring a plant, comprising:
  • the monitoring system establishes a first communication connection between the virtual reality VR head display and the first camera device;
  • the control information input by the user is detected by the VR head;
  • the first imaging device is controlled according to the control instruction for the first imaging device.
  • control information input by the VR header to detect user input includes:
  • the user's head rotation information, and/or eye information is detected by the VR head.
  • control instruction for the first camera device includes:
  • the method further includes:
  • control information corresponds to a switching instruction of the imaging device
  • the method further includes:
  • Displaying the first image information by using the VR header includes:
  • the first image information with the pest identifier is displayed by the VR head, and the pest identifier points to the target area.
  • a first camera device configured to acquire first image information of the plant
  • a first communication connection module configured to establish a first communication connection between the VR head and the first camera
  • the VR header is used to display the first image information, and is also used to detect control information input by a user;
  • a first control module configured to: when determining that the control information corresponds to a control instruction to the first camera device, control the first camera device according to the control instruction for the first camera device.
  • the VR head display is further configured to detect a user's head rotation information, and/or eye information.
  • control instruction for the first camera device includes:
  • the monitoring system further includes a second control module and a second imaging device, where the second imaging device is configured to acquire second image information of the plant;
  • a second communication connection module configured to establish a second communication connection between the VR head display and the second camera device
  • the second control module is configured to switch the first communication connection to a second communication connection when determining that the control information corresponds to a switching instruction of the camera device.
  • the monitoring system further includes:
  • An identification module configured to identify a target area where the pest is located in the first image information
  • the VR head display is also used to:
  • the first image information with a pest identifier is displayed, the pest identifier pointing to the target area.
  • the monitoring system of the present invention can establish a first communication connection between the virtual reality VR head display and the first camera device, obtain the first image information of the plant through the first camera device, and display the
  • the first image information may further detect, by using the VR head, control information input by the user, and if it is determined that the control information corresponds to a control instruction to the first camera device, according to the pair of the first camera device
  • the control command controls the first camera device
  • the present invention provides an immersive observation experience for the user by using the VR head as an input terminal of the remote control camera device provided to the user and a display device for observing the plant image. It is convenient for users to understand the situation of plants and improve user experience.
  • FIG. 1 is a schematic view showing an embodiment of a monitoring method of a plant of the present invention
  • Figure 2 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention.
  • Figure 3 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention.
  • Figure 4 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention.
  • Figure 5 is a schematic view showing an embodiment of a monitoring system of the plant of the present invention.
  • Figure 6 is a schematic illustration of another embodiment of a monitoring system for a plant of the present invention.
  • Embodiments of the present invention provide a monitoring method and monitoring system for a plant for providing an immersive observation experience for a plant.
  • an embodiment of the method for monitoring a plant in the embodiment of the present invention includes:
  • the monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device.
  • the first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication. After the first communication connection is established, communication can be performed between the VR head display and the first camera.
  • VR head display that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
  • the first image information of the plant can be acquired by the first camera.
  • the first image information may be connected through the first communication connection. Send to the VR head display to display the first image information through the VR head.
  • the user can input control information through the VR head to the monitoring system, and the monitoring system can detect the control information input by the user through the VR head display.
  • the first imaging device is controlled according to a control instruction to the first imaging device.
  • the monitoring system can associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head. After the monitoring device detects the control information input by the user through the VR head, the control command corresponding to the control information may be determined. If the control information is determined to correspond to the control command to the first camera device, the first camera device is determined according to the determined The control command controls the first camera.
  • the monitoring method provided by the embodiment of the present invention can be used as an input end of a remote control camera device provided to the user and a display device for observing the image of the plant through the VR head display, and can provide the user with an immersive observation experience on the plant, and facilitate the user to the plant situation. Learn to improve the user experience.
  • control information input by the user to the VR head may be head rotation information, such as left and right rotation of the head or back and forth rotation
  • control information input by the user to the VR head may also be eye information, such as line of sight focus position information. , blinking information, etc.
  • the control command of the monitoring system to the first camera device may be rotating the first camera device, or translating the first camera device, or adjusting the image distance of the first camera device.
  • the first camera device can be remotely controlled to perform the corresponding rotation, panning, zooming, etc. by rotating the head or blinking, etc., so that the user can display the VR head display.
  • the adjustment of the plant image enhances the user's immersive viewing experience on the plant.
  • the control information input by the user is the head rotation information and the eye information.
  • the user's head rotation information is detected by the VR head display:
  • another embodiment of a method for monitoring a plant in an embodiment of the present invention includes:
  • the monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device.
  • the first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication.
  • the VR head display and the first camera device can be For communication.
  • VR head display that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
  • the monitoring system establishes the first communication connection, it is assumed that the camera of the first camera device faces the first shooting angle at this time, and the first camera device can acquire the first image information of the plant at the first shooting angle.
  • the target area where the pest is located in the first image information may be identified.
  • the image recognition technology has been relatively mature. By pre-establishing the pest model, it is possible to determine whether the pest is included in the image by image recognition, and to determine the region where the pest is located.
  • the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant at the first shooting angle through the VR head display.
  • the monitoring system may add a pest identifier to the first image information, and the pest identifier may point to the target area, for example, circle the target area, and then the monitoring system may display the target through the VR Displays the first image information with the pest identification.
  • the pest identification is performed, and the first image with the pest identifier is displayed by the VR head, which can help the user to observe the pest condition of the plant. It should be noted that the step 203 may not be performed, and the first image information displayed in step 204 does not carry the pest identifier.
  • the user can rotate the head, for example, turn the head to the right.
  • the VR head can detect the user's head rotation information, and determine that the control information input by the user is rightward. Turn the head.
  • the VR head display method for detecting the head rotation information is relatively mature.
  • the VR head display can detect the user's head rotation information through the acceleration sensor. In actual use, the VR head display can also detect the user by other technical means.
  • the head rotation information is not specifically limited herein.
  • the monitoring system may pre-associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head.
  • the control information of "turning the head to the right” can be stored in association with the control command of "turning the camera to the right", and the control information of "turning the head to the left” and “turning to the left”
  • the control unit of the moving camera device is associated and stored.
  • the control command corresponding to the head rotation information can be searched, thereby determining that the control command corresponding to the head rotation information is rotating the first camera.
  • the determined control command is to rotate the first camera device to the right.
  • the first camera device can be controlled to perform corresponding rotation.
  • the first device since the determined control command is to rotate the first camera device to the right, the first device can be controlled. The camera rotates to the right.
  • the imaging angle of the camera orientation of the first imaging device changes, and assuming that the camera of the first imaging device faces the second imaging angle, the first image acquired by the first imaging device
  • the information is the first image information of the plant at the second shooting angle.
  • the first image information of the acquired plant at the second shooting angle may be sent to the VR head display through the first communication connection, so as to display the first image through the VR head.
  • the first image information of the plant under the shooting angle can still identify the target area where the pest is located in the first image information, and display the first image information with the pest identifier under the second shooting angle through the VR head.
  • the first image information includes image information of the plants acquired by the first imaging device at different shooting angles.
  • another embodiment of a method for monitoring a plant in an embodiment of the present invention includes:
  • the monitoring system can establish a first communication connection between the virtual reality VR head display and the first camera device,
  • a communication connection may be a wired communication method or a wireless communication method, and may also include wired communication and wireless communication.
  • communication can be performed between the VR head display and the first camera.
  • VR head display that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
  • the image distance of the first imaging device is the first image distance, and the first imaging device can acquire the first image information of the plant under the first image distance.
  • the target region where the pest is located in the first image information may be identified.
  • the image recognition technology has been relatively mature. By pre-establishing the pest model, it is possible to determine whether the pest is included in the image by image recognition, and to determine the region where the pest is located.
  • the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant under the first image distance through the VR head display.
  • the monitoring system may add a pest identifier to the first image information, and the pest identifier may point to the target area, for example, circle the target area, and then the monitoring system may display the target through the VR The first image information with the pest identifier under the first image distance is displayed.
  • the pest identification is performed, and the first image with the pest identifier is displayed by the VR head, which can help the user to observe the pest condition of the plant. It should be noted that the step 303 may not be performed, and the first image information displayed in step 304 does not carry the pest identifier.
  • the VR head display detects that the user's line of sight focus continuously aligns with the target position in the first image for more than a preset duration
  • the user can look at a certain position in the first image.
  • the corresponding position of the user's line of sight focus in the first image is referred to as the target position.
  • the VR head display can detect that the user's line of sight focus continuously aligns with the target position in the first image for more than the preset time length, and uses the detection result as the control information input by the user.
  • the monitoring system may pre-associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head. It is assumed that the control information that "the line of sight is in focus in a certain position in the image exceeds the preset duration" can be stored in association with the control command "by adjusting the focus corresponding position".
  • the control command corresponding to the control information is determined to be zoomed to enlarge the scene of the target position. For example, optical zoom can be achieved by moving the lens to change the image distance.
  • the first camera device may be controlled to perform corresponding focusing according to the control command, and the target position is enlarged to enable the user to see the scene of the target position, for example, the image distance may be increased.
  • the image distance of the first imaging device is the second image distance
  • the first image information acquired by the first imaging device is the first image information of the plant under the second image distance
  • the first image information of the acquired plant under the second image distance can be sent to the VR head display through the first communication connection, so as to display the first image through the VR head.
  • the first image information of the plant under the second image distance can be sent to the VR head display through the first communication connection, so as to display the first image through the VR head.
  • the first image information includes image information of the plants acquired by the first imaging device under different image distances.
  • the corresponding embodiment of FIG. 2 can cause the monitoring system to simulate the situation of the plant that the user sees by rotating the body at the position of the camera.
  • the corresponding embodiment of FIG. 3 can cause the monitoring system to simulate the plant seen when the user goes to the plant corresponding to the target position.
  • the first camera device can select a camera device that can perform translational motion, such as panning up and down, or panning in a horizontal direction.
  • this method has higher requirements on the camera device and a corresponding increase in cost.
  • a plurality of imaging devices can be provided in the planting space of the plant, and a plurality of imaging devices can be used in combination to expand the range of plants that the user can observe through the VR head.
  • FIG. 4 the monitoring side of the plant in the embodiment of the present invention.
  • Another embodiment of the method includes:
  • the monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device.
  • the first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication. After the first communication connection is established, communication can be performed between the VR head display and the first camera.
  • VR head display that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
  • the first camera device can acquire the first image information of the plant.
  • the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant through the VR head.
  • the user can blink for a plurality of times within a preset time period, for example, the user can blink twice in 1 s.
  • the VR head display can detect the blinking information of the user, and the detection result is used as the control information input by the user.
  • control instruction 405. Determine, according to a correspondence between the pre-stored control information and the control instruction, that the control instruction is a switching camera device.
  • the monitoring system may pre-associate the storage control information and the control command corresponding thereto, and the pre-stored control command includes a control command of the camera device communicatively connected to the VR head and a switching command to the camera device. It is assumed that the control information of "twice eyes in 1 s" can be stored in association with the control command "switching camera". After the monitoring device detects that the user blinks twice in 1 s, the control device can determine that the control command corresponding to the control information is: switching the first communication connection to the second communication connection between the VR head display and the second camera.
  • a second imaging device may be provided in the planting space of the plant. After the monitoring device determines that the control command is to switch the camera device, the first communication may be disconnected according to the control command. Connect and establish a second communication connection between the VR headset and the second camera.
  • the second camera device can acquire the second image information of the plant.
  • the second image information of the acquired plant may be sent to the VR head display through the second communication connection to display the second image information of the plant through the VR head.
  • the first image information refers to image information of the plant acquired by the first imaging device
  • the second image information refers to image information of the plant acquired by the second imaging device. If the planting area of the plant is large, including multiple planting areas, an imaging device can be installed in each planting area, and by switching the camera device connected to the VR head, it is possible to observe the plants in different planting areas.
  • an embodiment of a monitoring system for a plant in an embodiment of the present invention includes:
  • a first camera device 501 configured to acquire first image information of the plant
  • a first communication connection module 502 configured to establish a first communication connection between the VR head display and the first camera device
  • the VR head display 503 is configured to display first image information, and is also used to detect control information input by the user;
  • the first control module 504 is configured to control the first imaging device according to a control instruction to the first imaging device when determining that the control information corresponds to a control instruction to the first imaging device.
  • the first camera device 501 is disposed in a plant growing area, such as in a planting box or in a greenhouse.
  • the first communication connection module 502 can include Bluetooth modules respectively disposed on the first camera 501 and the VR head display 503 to implement a wireless connection between the first camera 501 and the VR headset 503.
  • the first control module may be disposed on the VR head display 503 or may be disposed on the first camera device 501.
  • the VR head display is also used to detect the user's head rotation information, and/or eye information.
  • the monitoring system further comprises an identification module for identifying the pest in the first image information
  • the identification module may be disposed on the VR head display 503, or may be disposed on the first camera unit 501.
  • VR Header 501 is also used to:
  • the first image information with the pest identifier is displayed, and the pest identifier points to the target area.
  • FIG. 6 another embodiment of a monitoring system for a plant in an embodiment of the present invention includes:
  • a first camera device 601 configured to acquire first image information of the plant
  • a first communication connection module 602 configured to establish a first communication connection between the VR head and the first camera
  • the VR head display 603 is configured to display first image information, and is also used to detect control information input by the user;
  • the first control module 604 is configured to: when determining that the control information corresponds to a control instruction to the first camera, control the first camera according to a control instruction to the first camera;
  • a second camera 605, configured to acquire second image information of the plant
  • a second communication connection module 606, configured to establish a second communication connection between the VR head display and the second camera device
  • the second control module 607 is configured to switch the first communication connection to the second communication connection when determining that the control information corresponds to the switching instruction of the camera device;
  • the first camera unit 601 and the second camera unit 605 are both disposed in a plant growing area, such as in a planting box or in a greenhouse.
  • the first control module 604 and the second control module 607 may be disposed on the VR head display 603, or may be disposed on the first imaging device 601 and the second imaging device 605.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of cells is only a logical function division.
  • multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, Mechanical or other form.
  • the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • An integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Abstract

The embodiment of the present invention discloses a plant monitoring method and monitoring system, for solving the problem that the existing plant monitoring methods cannot provide a user with an immersive observation experience. The monitoring method in the embodiment of the present invention comprises: establishing first communication connection between a VR head mounted display and a first camera device; acquiring first image information of plants by means of the first camera device; displaying the first image information by means of the VR head mounted display; detecting by means of the VR head mounted display control information input by a user; if it is determined that the control information corresponds to a control instruction for the first camera device, controlling the first camera device according to the control instruction for the first camera device.

Description

一种植株的监控方法及监控系统Monitoring method and monitoring system of a plant
本申请要求于2017年04月28日提交中国专利局、申请号为201710293358.1、发明名称为“一种植株的监控方法及监控系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to Chinese Patent Application No. 200910293358.1, entitled "Monitoring Method and Monitoring System for One Plant", filed on April 28, 2017, the entire contents of which are incorporated herein by reference. In the application.
技术领域Technical field
本发明涉及信息处理领域,具体涉及一种植株的监控方法及监控系统。The invention relates to the field of information processing, in particular to a monitoring method and a monitoring system for a plant.
背景技术Background technique
无论是出于科普角度或者经济种植角度,人们越来越多的选择在栽培有植株的种植箱或温室中安装摄像头,以方便对植株的生长过程进行监控,从而方便了解植株的生长变化,及时掌握植株的健康状况等。Whether it is from the perspective of science or economic cultivation, people are increasingly choosing to install cameras in planting boxes or greenhouses for planting, so as to facilitate monitoring of the growth process of plants, so as to facilitate understanding of plant growth and changes. Master the health of the plant, etc.
现有的植株监控方法是通过固定的摄像头获取固定角度下的植株图像,并通过手机或者电脑屏幕展示给用户,由于摄像头的拍摄角度是固定的,限制了用户的观察视野。为了解决这个问题,现有技术向用户提供输入设备,比如手机的触摸屏或者与电脑相连的鼠标、键盘等,用户通过输入设备可以输入对摄像头的控制指令,从而遥控摄像头改变其拍摄角度,从而拓宽用户的观察视野。The existing plant monitoring method is to obtain the image of the plant at a fixed angle through a fixed camera, and display it to the user through a mobile phone or a computer screen. Since the shooting angle of the camera is fixed, the viewing field of the user is limited. In order to solve this problem, the prior art provides an input device to a user, such as a touch screen of a mobile phone or a mouse or a keyboard connected to a computer. The user can input a control command to the camera through the input device, so that the remote control camera changes its shooting angle, thereby widening The user's field of view.
但是,现有的植株监控方法无法提供给用户沉浸式的观察体验,不便于用户对植株情况的了解,用户体验差。However, the existing plant monitoring method cannot provide the user with an immersive observation experience, which is inconvenient for the user to understand the plant situation and the user experience is poor.
发明内容Summary of the invention
本发明提供一种植株的监控方法及监控系统,用于解决现有的植株监控方法无法提供给用户沉浸式观察体验的问题。The invention provides a monitoring method and a monitoring system for a plant, which are used for solving the problem that the existing plant monitoring method cannot provide the user with an immersive observation experience.
本发明实施例的一方面提供了一种植株的监控方法,包括:An aspect of an embodiment of the invention provides a method for monitoring a plant, comprising:
监控系统建立虚拟现实VR头显与第一摄像装置的第一通信连接;The monitoring system establishes a first communication connection between the virtual reality VR head display and the first camera device;
通过所述第一摄像装置获取所述植株的第一图像信息;Acquiring first image information of the plant by the first camera device;
通过所述VR头显显示所述第一图像信息;Displaying the first image information by using the VR head;
通过所述VR头显检测用户输入的控制信息;The control information input by the user is detected by the VR head;
若确定所述控制信息对应于对所述第一摄像装置的控制指令,则按照所述对所述第一摄像装置的控制指令对所述第一摄像装置进行控制。 If it is determined that the control information corresponds to a control instruction to the first imaging device, the first imaging device is controlled according to the control instruction for the first imaging device.
可选的,通过所述VR头显检测用户输入的控制信息包括:Optionally, the control information input by the VR header to detect user input includes:
通过所述VR头显检测用户的头部转动信息,和/或眼部信息。The user's head rotation information, and/or eye information is detected by the VR head.
可选的,所述对所述第一摄像装置的控制指令包括:Optionally, the control instruction for the first camera device includes:
转动所述第一摄像装置、或者平移所述第一摄像装置、或者控制所述第一摄像装置变焦。Rotating the first camera, or translating the first camera, or controlling the first camera to zoom.
可选的,在通过所述VR头显检测用户输入的控制信息之后,所述方法还包括:Optionally, after the control information input by the user is detected by using the VR header, the method further includes:
若确定所述控制信息对应于摄像装置的切换指令,则将所述第一通信连接切换为所述VR头显与第二摄像装置的第二通信连接,所述第二摄像装置用于获取所述植株的第二图像信息。If it is determined that the control information corresponds to a switching instruction of the imaging device, switching the first communication connection to a second communication connection between the VR head display and the second imaging device, and the second imaging device is configured to acquire The second image information of the plant.
可选的,在通过所述第一摄像装置获取第一图像信息之后,在通过所述VR头显显示所述第一图像信息之前,所述方法还包括:Optionally, after the first image information is acquired by the first camera, before the displaying the first image information by using the VR head, the method further includes:
识别所述第一图像信息中害虫所在的目标区域;Identifying a target area where the pest is located in the first image information;
通过所述VR头显显示所述第一图像信息包括:Displaying the first image information by using the VR header includes:
通过所述VR头显显示带有害虫标识的所述第一图像信息,所述害虫标识指向所述目标区域。The first image information with the pest identifier is displayed by the VR head, and the pest identifier points to the target area.
本发明实施例的第二方面提供了一种植株的监控系统,包括:A second aspect of an embodiment of the present invention provides a monitoring system for a plant comprising:
第一摄像装置,用于获取所述植株的第一图像信息;a first camera device, configured to acquire first image information of the plant;
第一通信连接模块,用于建立VR头显与所述第一摄像装置的第一通信连接;a first communication connection module, configured to establish a first communication connection between the VR head and the first camera;
所述VR头显用于显示所述第一图像信息,还用于检测用户输入的控制信息;The VR header is used to display the first image information, and is also used to detect control information input by a user;
第一控制模块,用于当确定所述控制信息对应于对所述第一摄像装置的控制指令时,按照所述对所述第一摄像装置的控制指令对所述第一摄像装置进行控制。a first control module, configured to: when determining that the control information corresponds to a control instruction to the first camera device, control the first camera device according to the control instruction for the first camera device.
可选的,所述VR头显还用于检测用户的头部转动信息,和/或眼部信息。Optionally, the VR head display is further configured to detect a user's head rotation information, and/or eye information.
可选的,所述对所述第一摄像装置的控制指令包括:Optionally, the control instruction for the first camera device includes:
转动所述第一摄像装置、或者平移所述第一摄像装置、或者控制所述第一摄像装置变焦。 Rotating the first camera, or translating the first camera, or controlling the first camera to zoom.
可选的,所述监控系统还包括第二控制模块和第二摄像装置,所述第二摄像装置用于获取所述植株的第二图像信息;Optionally, the monitoring system further includes a second control module and a second imaging device, where the second imaging device is configured to acquire second image information of the plant;
第二通信连接模块,用于建立VR头显与所述第二摄像装置的第二通信连接;a second communication connection module, configured to establish a second communication connection between the VR head display and the second camera device;
所述第二控制模块,用于当确定所述控制信息对应于摄像装置的切换指令时,将所述第一通信连接切换为第二通信连接。The second control module is configured to switch the first communication connection to a second communication connection when determining that the control information corresponds to a switching instruction of the camera device.
可选的,所述监控系统还包括:Optionally, the monitoring system further includes:
识别模块,用于识别所述第一图像信息中害虫所在的目标区域;An identification module, configured to identify a target area where the pest is located in the first image information;
所述VR头显还用于:The VR head display is also used to:
显示带有害虫标识的所述第一图像信息,所述害虫标识指向所述目标区域。The first image information with a pest identifier is displayed, the pest identifier pointing to the target area.
从以上技术方案可以看出,本发明实施例具有以下优点:It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:
本发明的监控系统可以建立虚拟现实VR头显与第一摄像装置的第一通信连接,通过所述第一摄像装置获取所述植株的第一图像信息,并通过所述VR头显显示所述第一图像信息,还可以通过所述VR头显检测用户输入的控制信息,若确定所述控制信息对应于对所述第一摄像装置的控制指令,则按照所述对所述第一摄像装置的控制指令对所述第一摄像装置进行控制,本发明通过VR头显来作为提供给用户的遥控摄像装置的输入端以及观察植株图像的显示装置,可以为用户提供对植株的沉浸式观察体验,方便用户对植株情况的了解,提高用户体验。The monitoring system of the present invention can establish a first communication connection between the virtual reality VR head display and the first camera device, obtain the first image information of the plant through the first camera device, and display the The first image information may further detect, by using the VR head, control information input by the user, and if it is determined that the control information corresponds to a control instruction to the first camera device, according to the pair of the first camera device The control command controls the first camera device, and the present invention provides an immersive observation experience for the user by using the VR head as an input terminal of the remote control camera device provided to the user and a display device for observing the plant image. It is convenient for users to understand the situation of plants and improve user experience.
附图说明DRAWINGS
图1是本发明植株的监控方法一个实施例示意图;1 is a schematic view showing an embodiment of a monitoring method of a plant of the present invention;
图2是本发明植株的监控方法另一个实施例示意图;Figure 2 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention;
图3是本发明植株的监控方法另一个实施例示意图;Figure 3 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention;
图4是本发明植株的监控方法另一个实施例示意图;Figure 4 is a schematic view showing another embodiment of the monitoring method of the plant of the present invention;
图5是本发明植株的监控系统一个实施例示意图;Figure 5 is a schematic view showing an embodiment of a monitoring system of the plant of the present invention;
图6是本发明植株的监控系统另一个实施例示意图。 Figure 6 is a schematic illustration of another embodiment of a monitoring system for a plant of the present invention.
具体实施方式detailed description
本发明实施例提供了一种植株的监控方法及监控系统,用于为用户提供对植株的沉浸式观察体验。Embodiments of the present invention provide a monitoring method and monitoring system for a plant for providing an immersive observation experience for a plant.
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.
本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的实施例能够以除了在这里图示或描述的内容以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", "fourth", etc. (if present) in the specification and claims of the present invention and the above figures are used to distinguish similar objects without having to use To describe a specific order or order. It is to be understood that the data so used may be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than what is illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.
为便于理解,下面对本发明实施例中的具体流程进行描述,请参阅图1,本发明实施例中植株的监控方法一个实施例包括:For the sake of understanding, the specific process in the embodiment of the present invention is described below. Referring to FIG. 1, an embodiment of the method for monitoring a plant in the embodiment of the present invention includes:
101、建立虚拟现实VR头显与第一摄像装置的第一通信连接;101. Establish a first communication connection between the virtual reality VR head display and the first camera device.
监控系统可以建立虚拟现实VR头显与第一摄像装置的第一通信连接,第一通信连接可以是有线通信方式,也可以是无线通信方式,还可以同时包括有线通信和无线通信。建立第一通信连接之后,VR头显和第一摄像装置之间可以进行通信。VR头显,即虚拟现实头戴式显示设备,利用头戴式显示设备将人的对外界的视觉、听觉封闭,引导用户产生一种身在虚拟环境中的感觉。The monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device. The first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication. After the first communication connection is established, communication can be performed between the VR head display and the first camera. VR head display, that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
102、通过第一摄像装置获取植株的第一图像信息;102. Acquire first image information of the plant by using the first imaging device.
监控系统建立第一通信连接之后,可以通过第一摄像装置获取植株的第一图像信息。After the monitoring system establishes the first communication connection, the first image information of the plant can be acquired by the first camera.
103、通过VR头显显示第一图像信息;103. Display the first image information by using a VR head;
监控系统获取第一图像信息之后,可以通过第一通信连接将第一图像信息 发送给VR头显,以通过VR头显显示第一图像信息。After the monitoring system acquires the first image information, the first image information may be connected through the first communication connection. Send to the VR head display to display the first image information through the VR head.
104、通过VR头显检测用户输入的控制信息;104. Detecting user input control information through a VR head display;
监控系统通过VR头显显示第一图像之后,用户可以通过VR头显向监控系统输入控制信息,监控系统可以通过VR头显检测用户输入的控制信息。After the monitoring system displays the first image through the VR head, the user can input control information through the VR head to the monitoring system, and the monitoring system can detect the control information input by the user through the VR head display.
105、若确定控制信息对应于对第一摄像装置的控制指令,则按照对第一摄像装置的控制指令对第一摄像装置进行控制。105. If it is determined that the control information corresponds to a control instruction to the first imaging device, the first imaging device is controlled according to a control instruction to the first imaging device.
监控系统可以关联存储控制信息以及与其对应的控制指令,预存的控制指令包括对与VR头显进行通信连接的摄像装置的控制指令。监控装置通过VR头显检测到用户输入的控制信息之后,可以确定该控制信息对应的控制指令,若确定该控制信息对应于对第一摄像装置的控制指令,则按照确定的对第一摄像装置的控制指令对第一摄像装置进行控制。The monitoring system can associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head. After the monitoring device detects the control information input by the user through the VR head, the control command corresponding to the control information may be determined. If the control information is determined to correspond to the control command to the first camera device, the first camera device is determined according to the determined The control command controls the first camera.
本发明实施例提供的监控方法可以通过VR头显来作为提供给用户的遥控摄像装置的输入端以及观察植株图像的显示装置,可以为用户提供对植株的沉浸式观察体验,方便用户对植株情况的了解,提高用户体验。The monitoring method provided by the embodiment of the present invention can be used as an input end of a remote control camera device provided to the user and a display device for observing the image of the plant through the VR head display, and can provide the user with an immersive observation experience on the plant, and facilitate the user to the plant situation. Learn to improve the user experience.
作为举例,用户向VR头显输入的控制信息可以为头部转动信息,比如头部的左右转动或者前后转动,用户向VR头显输入的控制信息还可以为眼部信息,比如视线焦点位置信息、眨眼信息等。而监控系统对第一摄像装置的控制指令可以为转动第一摄像装置、或者平移第一摄像装置、或者调整第一摄像装置的像距等。这样,用户佩戴VR头显观察第一图像信息的过程中,可以通过转头或者眨眼等动作,便可以遥控第一摄像装置进行相应的转动、平移、变焦等,方便用户对VR头显中显示的植株图像的调整,增强用户对植株的沉浸式观察体验。下面分别对用户输入的控制信息为头部转动信息和眼部信息的情况进行举例说明。For example, the control information input by the user to the VR head may be head rotation information, such as left and right rotation of the head or back and forth rotation, and the control information input by the user to the VR head may also be eye information, such as line of sight focus position information. , blinking information, etc. The control command of the monitoring system to the first camera device may be rotating the first camera device, or translating the first camera device, or adjusting the image distance of the first camera device. In this way, during the process of the user wearing the VR head to observe the first image information, the first camera device can be remotely controlled to perform the corresponding rotation, panning, zooming, etc. by rotating the head or blinking, etc., so that the user can display the VR head display. The adjustment of the plant image enhances the user's immersive viewing experience on the plant. The following is an example of the case where the control information input by the user is the head rotation information and the eye information.
一、通过VR头显检测用户的头部转动信息:First, the user's head rotation information is detected by the VR head display:
请参阅图2,本发明实施例中植株的监控方法另一个实施例包括:Referring to FIG. 2, another embodiment of a method for monitoring a plant in an embodiment of the present invention includes:
201、建立虚拟现实VR头显与第一摄像装置的第一通信连接;201. Establish a first communication connection between the virtual reality VR head display and the first camera device.
监控系统可以建立虚拟现实VR头显与第一摄像装置的第一通信连接,第一通信连接可以是有线通信方式,也可以是无线通信方式,还可以同时包括有线通信和无线通信。建立第一通信连接之后,VR头显和第一摄像装置之间可 以进行通信。VR头显,即虚拟现实头戴式显示设备,利用头戴式显示设备将人的对外界的视觉、听觉封闭,引导用户产生一种身在虚拟环境中的感觉。The monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device. The first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication. After establishing the first communication connection, the VR head display and the first camera device can be For communication. VR head display, that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
202、通过第一摄像装置获取第一拍摄角度下植株的第一图像信息;202. Acquire first image information of the plant at the first shooting angle by using the first imaging device.
监控系统建立第一通信连接之后,假设此时第一摄像装置的摄像头朝向第一拍摄角度,此时第一摄像装置可以获取第一拍摄角度下植株的第一图像信息。After the monitoring system establishes the first communication connection, it is assumed that the camera of the first camera device faces the first shooting angle at this time, and the first camera device can acquire the first image information of the plant at the first shooting angle.
203、识别第一图像信息中害虫所在的目标区域;203. Identify a target area where the pest is located in the first image information.
监控系统获取到第一拍摄角度下植株的第一图像信息之后,可以识别第一图像信息中害虫所在的目标区域。图像识别技术已经比较成熟,通过预先建立害虫模型,可以通过图像识别来确定图像中是否包括害虫,并且确定害虫所在的区域。After the monitoring system acquires the first image information of the plant under the first shooting angle, the target area where the pest is located in the first image information may be identified. The image recognition technology has been relatively mature. By pre-establishing the pest model, it is possible to determine whether the pest is included in the image by image recognition, and to determine the region where the pest is located.
204、通过VR头显显示带有害虫标识的第一图像信息;204. Display, by using a VR head, first image information with a pest identifier;
监控系统获取第一拍摄角度下植株的第一图像信息之后,可以通过第一通信连接将第一图像信息发送给VR头显,以通过VR头显显示第一拍摄角度下植株的第一图像信息。由于已经确定第一图像信息中害虫所在的目标区域,因此监控系统可以在第一图像信息中添加害虫标识,该害虫标识可以指向目标区域,比如圈出目标区域,之后监控系统可以通过VR头显显示带有害虫标识的第一图像信息。After the monitoring system acquires the first image information of the plant in the first shooting angle, the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant at the first shooting angle through the VR head display. . Since the target area where the pest is located in the first image information has been determined, the monitoring system may add a pest identifier to the first image information, and the pest identifier may point to the target area, for example, circle the target area, and then the monitoring system may display the target through the VR Displays the first image information with the pest identification.
进行害虫识别,并且通过VR头显显示带有害虫标识的第一图像,能够帮助用户观察到植株的虫害情况。需要说明的是,步骤203也可以不执行,那么步骤204显示的第一图像信息中不带有害虫标识。The pest identification is performed, and the first image with the pest identifier is displayed by the VR head, which can help the user to observe the pest condition of the plant. It should be noted that the step 203 may not be performed, and the first image information displayed in step 204 does not carry the pest identifier.
205、通过VR头显检测用户的头部转动信息;205. Detecting a user's head rotation information through a VR head display;
监控系统通过VR头显显示第一图像之后,用户可以转动头部,比如向右转动头部,此时VR头显能够检测到用户的头部转动信息,确定用户输入的控制信息为向右转动头部。VR头显对头部转动信息的检测方法已经比较成熟,比如VR头显可以通过加速度传感器来检测用户的头部转动信息,在实际使用中,VR头显还可以通过其他技术手段来检测用户的头部转动信息,此处不做具体限定。After the monitoring system displays the first image through the VR head, the user can rotate the head, for example, turn the head to the right. At this time, the VR head can detect the user's head rotation information, and determine that the control information input by the user is rightward. Turn the head. The VR head display method for detecting the head rotation information is relatively mature. For example, the VR head display can detect the user's head rotation information through the acceleration sensor. In actual use, the VR head display can also detect the user by other technical means. The head rotation information is not specifically limited herein.
206、从预存的控制信息与控制指令的对应关系中确定头部转动信息对应 的控制指令为转动第一摄像装置;206. Determine correspondence between head rotation information from a correspondence relationship between pre-stored control information and control commands The control command is to rotate the first camera device;
监控系统可以预先关联存储控制信息以及与其对应的控制指令,预存的控制指令包括对与VR头显进行通信连接的摄像装置的控制指令。假设可以将“向右转动头部”这一控制信息与“向右转动摄像装置”这一控制指令进行关联存储,将“向左转动头部”这一控制信息与“向左转动摄像装置”这一控制指令进行关联存储。监控装置通过VR头显检测到用户的头部转动信息之后,可以查找该头部转动信息对应的控制指令,从而确定头部转动信息对应的控制指令为转动第一摄像头。在本发明实施例中,若检测到用户向右转动头部,则确定的控制指令为向右转动第一摄像装置。The monitoring system may pre-associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head. Suppose that the control information of "turning the head to the right" can be stored in association with the control command of "turning the camera to the right", and the control information of "turning the head to the left" and "turning to the left" The control unit of the moving camera device is associated and stored. After the monitoring device detects the head rotation information of the user through the VR head display, the control command corresponding to the head rotation information can be searched, thereby determining that the control command corresponding to the head rotation information is rotating the first camera. In the embodiment of the present invention, if it is detected that the user turns the head to the right, the determined control command is to rotate the first camera device to the right.
207、控制第一摄像装置进行相应转动;207. Control the first camera to perform corresponding rotation;
监控装置确定控制指令为转动第一摄像装置之后,可以控制第一摄像装置进行相应转动,在本发明实施例中,由于确定的控制指令为向右转动第一摄像装置,因此可以控制第一摄像装置向右转动。After the monitoring device determines that the control command is to rotate the first camera device, the first camera device can be controlled to perform corresponding rotation. In the embodiment of the present invention, since the determined control command is to rotate the first camera device to the right, the first device can be controlled. The camera rotates to the right.
208、通过第一摄像装置获取第二拍摄角度下植株的第一图像信息;208. Acquire first image information of the plant at the second shooting angle by using the first imaging device.
第一摄像装置向右转动后,第一摄像装置的摄像头朝向的拍摄角度会发生变化,假设此时第一摄像装置的摄像头朝向第二拍摄角度,那么第一摄像装置获取到的第一图像信息为第二拍摄角度下植株的第一图像信息。After the first imaging device is rotated to the right, the imaging angle of the camera orientation of the first imaging device changes, and assuming that the camera of the first imaging device faces the second imaging angle, the first image acquired by the first imaging device The information is the first image information of the plant at the second shooting angle.
209、通过VR头显显示第二拍摄角度下带有害虫标识的第一图像信息。209. Display, by using a VR head, first image information with a pest identifier under the second shooting angle.
监控系统获取第二拍摄角度下植株的第一图像信息之后,可以通过第一通信连接将获取到的第二拍摄角度下植株的第一图像信息发送给VR头显,以通过VR头显显示第二拍摄角度下植株的第一图像信息。监控系统仍然可以识别第一图像信息中害虫所在的目标区域,并通过VR头显显示第二拍摄角度下带有害虫标识的第一图像信息。After the monitoring system acquires the first image information of the plant in the second shooting angle, the first image information of the acquired plant at the second shooting angle may be sent to the VR head display through the first communication connection, so as to display the first image through the VR head. The first image information of the plant under the shooting angle. The monitoring system can still identify the target area where the pest is located in the first image information, and display the first image information with the pest identifier under the second shooting angle through the VR head.
需要说明的是,本发明实施例中,第一图像信息包括第一摄像装置在不同拍摄角度下获取到的植株的图像信息。It should be noted that, in the embodiment of the present invention, the first image information includes image information of the plants acquired by the first imaging device at different shooting angles.
二、通过VR头显检测用户的眼部信息:Second, through the VR head display to detect the user's eye information:
请参阅图3,本发明实施例中植株的监控方法另一个实施例包括:Referring to FIG. 3, another embodiment of a method for monitoring a plant in an embodiment of the present invention includes:
301、建立虚拟现实VR头显与第一摄像装置的第一通信连接;301. Establish a first communication connection between the virtual reality VR head display and the first camera device.
监控系统可以建立虚拟现实VR头显与第一摄像装置的第一通信连接,第 一通信连接可以是有线通信方式,也可以是无线通信方式,还可以同时包括有线通信和无线通信。建立第一通信连接之后,VR头显和第一摄像装置之间可以进行通信。VR头显,即虚拟现实头戴式显示设备,利用头戴式显示设备将人的对外界的视觉、听觉封闭,引导用户产生一种身在虚拟环境中的感觉。The monitoring system can establish a first communication connection between the virtual reality VR head display and the first camera device, A communication connection may be a wired communication method or a wireless communication method, and may also include wired communication and wireless communication. After the first communication connection is established, communication can be performed between the VR head display and the first camera. VR head display, that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
302、通过第一摄像装置获取第一像距下植株的第一图像信息;302. Acquire, by using a first imaging device, first image information of a plant under a first image distance;
监控系统建立第一通信连接之后,假设此时第一摄像装置的像距为第一像距,此时第一摄像装置可以获取第一像距下植株的第一图像信息。After the monitoring system establishes the first communication connection, it is assumed that the image distance of the first imaging device is the first image distance, and the first imaging device can acquire the first image information of the plant under the first image distance.
303、识别第一图像信息中害虫所在的目标区域;303. Identify a target area where the pest is located in the first image information.
监控系统获取到第一像距下植株的第一图像信息之后,可以识别第一图像信息中害虫所在的目标区域。图像识别技术已经比较成熟,通过预先建立害虫模型,可以通过图像识别来确定图像中是否包括害虫,并且确定害虫所在的区域。After the monitoring system acquires the first image information of the plant under the first image distance, the target region where the pest is located in the first image information may be identified. The image recognition technology has been relatively mature. By pre-establishing the pest model, it is possible to determine whether the pest is included in the image by image recognition, and to determine the region where the pest is located.
304、通过VR头显显示第一像距下带有害虫标识的第一图像信息;304. Display, by using a VR head, first image information with a pest identifier under the first image distance;
监控系统获取第一像距下植株的第一图像信息之后,可以通过第一通信连接将第一图像信息发送给VR头显,以通过VR头显显示第一像距下植株的第一图像信息。由于已经确定第一图像信息中害虫所在的目标区域,因此监控系统可以在第一图像信息中添加害虫标识,该害虫标识可以指向目标区域,比如圈出目标区域,之后监控系统可以通过VR头显显示第一像距下带有害虫标识的第一图像信息。After the monitoring system acquires the first image information of the plant under the first image distance, the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant under the first image distance through the VR head display. . Since the target area where the pest is located in the first image information has been determined, the monitoring system may add a pest identifier to the first image information, and the pest identifier may point to the target area, for example, circle the target area, and then the monitoring system may display the target through the VR The first image information with the pest identifier under the first image distance is displayed.
进行害虫识别,并且通过VR头显显示带有害虫标识的第一图像,能够帮助用户观察到植株的虫害情况。需要说明的是,步骤303也可以不执行,那么步骤304显示的第一图像信息中不带有害虫标识。The pest identification is performed, and the first image with the pest identifier is displayed by the VR head, which can help the user to observe the pest condition of the plant. It should be noted that the step 303 may not be performed, and the first image information displayed in step 304 does not carry the pest identifier.
305、通过VR头显检测用户的视线焦点持续对准第一图像中的目标位置超过预设时长;305. The VR head display detects that the user's line of sight focus continuously aligns with the target position in the first image for more than a preset duration;
监控系统通过VR头显显示第一图像之后,用户可以注视第一图像中某个位置,为了方便描述,将用户视线焦点在第一图像中的对应位置称作目标位置。此时VR头显能够检测到用户的视线焦点持续对准第一图像中的目标位置超过预设时长,并将检测结果作为用户输入的控制信息。After the monitoring system displays the first image through the VR head, the user can look at a certain position in the first image. For convenience of description, the corresponding position of the user's line of sight focus in the first image is referred to as the target position. At this time, the VR head display can detect that the user's line of sight focus continuously aligns with the target position in the first image for more than the preset time length, and uses the detection result as the control information input by the user.
306、从预存的控制信息与控制指令的对应关系中确定控制指令为控制第 一摄像装置调焦,以放大目标位置;306. Determine a control instruction from the corresponding relationship between the pre-stored control information and the control instruction. Focusing on a camera to zoom in on the target position;
监控系统可以预先关联存储控制信息以及与其对应的控制指令,预存的控制指令包括对与VR头显进行通信连接的摄像装置的控制指令。假设可以将“视线焦点对准图像中某位置超过预设时长”这一控制信息与“通过调焦放大对应位置”这一控制指令进行关联存储。监控装置通过VR头显检测用户的视线焦点持续对准第一图像中的目标位置超过预设时长之后,可以确定该控制信息对应的控制指令为调焦以放大目标位置的景物。比如,可以通过移动镜片来改变像距,从而实现光学调焦。The monitoring system may pre-associate the storage control information with a control command corresponding thereto, and the pre-stored control command includes a control command for the camera device communicatively connected to the VR head. It is assumed that the control information that "the line of sight is in focus in a certain position in the image exceeds the preset duration" can be stored in association with the control command "by adjusting the focus corresponding position". After the monitoring device detects that the user's line of sight focus is continuously aligned with the target position in the first image by the VR head, the control command corresponding to the control information is determined to be zoomed to enlarge the scene of the target position. For example, optical zoom can be achieved by moving the lens to change the image distance.
307、控制第一摄像装置调焦,放大目标位置;307, controlling the first camera to focus, and zooming in the target position;
监控装置确定控制指令之后,可以按照控制指令控制第一摄像装置进行相应调焦,放大目标位置,以使得用户看清目标位置的景物,比如可以增大像距。After the monitoring device determines the control command, the first camera device may be controlled to perform corresponding focusing according to the control command, and the target position is enlarged to enable the user to see the scene of the target position, for example, the image distance may be increased.
308、通过第一摄像装置获取第二像距下植株的第一图像信息;308. Acquire, by using the first imaging device, first image information of the plant under the second image distance;
第一摄像装置调焦后,假设此时第一摄像装置的像距为第二像距,那么第一摄像装置获取到的第一图像信息为第二像距下植株的第一图像信息。After the first imaging device is focused, it is assumed that the image distance of the first imaging device is the second image distance, and the first image information acquired by the first imaging device is the first image information of the plant under the second image distance.
309、通过VR头显显示第二像距下植株的第一图像信息。309. Display, by using a VR head, first image information of the plant under the second image distance.
监控系统获取第二像距下植株的第一图像信息之后,可以通过第一通信连接将获取到的第二像距下植株的第一图像信息发送给VR头显,以通过VR头显显示第二像距下植株的第一图像信息。After the monitoring system acquires the first image information of the plant under the second image distance, the first image information of the acquired plant under the second image distance can be sent to the VR head display through the first communication connection, so as to display the first image through the VR head. The first image information of the plant under the second image distance.
需要说明的是,本发明实施例中,第一图像信息包括第一摄像装置在不同像距下获取到的植株的图像信息。It should be noted that, in the embodiment of the present invention, the first image information includes image information of the plants acquired by the first imaging device under different image distances.
图2对应的实施例可以使得监控系统模拟用户在摄像装置所处位置通过转动身体看到的植株情况,图3对应的实施例可以使得监控系统模拟用户走向目标位置对应的植株时看到的植株情况。但是,通过控制摄像头调焦模拟用户移动观察植株情况的能力较小,尤其是植株的种植面积较大时,只通过对单一摄像装置进行调焦是无法模拟这种观察需求的。因此,第一摄像装置可以选用可以平移运动的摄像装置,比如进行上下的平移、或者进行水平方向的平移,但是,这种方法对摄像装置的要求较高,成本也相应增大。为此,可以在植株的种植空间内设置多个摄像装置,并联合使用多个摄像装置来扩展用户通过VR头显能够观察到的植株范围。请参阅图4,本发明实施例中植株的监控方 法另一个实施例包括:The corresponding embodiment of FIG. 2 can cause the monitoring system to simulate the situation of the plant that the user sees by rotating the body at the position of the camera. The corresponding embodiment of FIG. 3 can cause the monitoring system to simulate the plant seen when the user goes to the plant corresponding to the target position. Happening. However, by controlling the camera focus, the ability of the user to observe the movement of the plant is small, especially when the planting area of the plant is large, and it is impossible to simulate this observation requirement only by focusing on a single camera. Therefore, the first camera device can select a camera device that can perform translational motion, such as panning up and down, or panning in a horizontal direction. However, this method has higher requirements on the camera device and a corresponding increase in cost. For this purpose, a plurality of imaging devices can be provided in the planting space of the plant, and a plurality of imaging devices can be used in combination to expand the range of plants that the user can observe through the VR head. Please refer to FIG. 4, the monitoring side of the plant in the embodiment of the present invention. Another embodiment of the method includes:
401、建立虚拟现实VR头显与第一摄像装置的第一通信连接;401. Establish a first communication connection between the virtual reality VR head display and the first camera device.
监控系统可以建立虚拟现实VR头显与第一摄像装置的第一通信连接,第一通信连接可以是有线通信方式,也可以是无线通信方式,还可以同时包括有线通信和无线通信。建立第一通信连接之后,VR头显和第一摄像装置之间可以进行通信。VR头显,即虚拟现实头戴式显示设备,利用头戴式显示设备将人的对外界的视觉、听觉封闭,引导用户产生一种身在虚拟环境中的感觉。The monitoring system may establish a first communication connection between the virtual reality VR head display and the first camera device. The first communication connection may be a wired communication mode or a wireless communication mode, and may also include wired communication and wireless communication. After the first communication connection is established, communication can be performed between the VR head display and the first camera. VR head display, that is, a virtual reality head-mounted display device, uses a head-mounted display device to close a person's visual and auditory sense to the outside world, and guides the user to create a feeling in a virtual environment.
402、通过第一摄像装置获取植株的第一图像信息;402. Acquire first image information of the plant by using the first imaging device.
监控系统建立第一通信连接之后,第一摄像装置可以获取植株的第一图像信息。After the monitoring system establishes the first communication connection, the first camera device can acquire the first image information of the plant.
403、通过VR头显显示第一图像信息;403. Display the first image information by using a VR head;
监控系统获取植株的第一图像信息之后,可以通过第一通信连接将第一图像信息发送给VR头显,以通过VR头显显示植株的第一图像信息。After the monitoring system acquires the first image information of the plant, the first image information may be sent to the VR head display through the first communication connection to display the first image information of the plant through the VR head.
404、通过VR头显检测用户的眨眼信息;404. Detecting the blinking information of the user through the VR head display;
监控系统通过VR头显显示第一图像之后,用户可以在预设时长内多次眨眼,比如用户可以在1s内眨两次眼。此时VR头显能够检测到用户的眨眼信息,并将检测结果作为用户输入的控制信息。After the monitoring system displays the first image through the VR head, the user can blink for a plurality of times within a preset time period, for example, the user can blink twice in 1 s. At this time, the VR head display can detect the blinking information of the user, and the detection result is used as the control information input by the user.
405、从预存的控制信息与控制指令的对应关系中确定控制指令为切换摄像装置;405. Determine, according to a correspondence between the pre-stored control information and the control instruction, that the control instruction is a switching camera device.
监控系统可以预先关联存储控制信息以及与其对应的控制指令,预存的控制指令包括对与VR头显进行通信连接的摄像装置的控制指令以及对摄像装置的切换指令。假设可以将“在1s内眨两次眼”这一控制信息与“切换摄像装置”这一控制指令进行关联存储。监控装置通过VR头显检测用户在1s内眨两次眼之后,可以确定该控制信息对应的控制指令为:将第一通信连接切换为VR头显与第二摄像装置的第二通信连接。The monitoring system may pre-associate the storage control information and the control command corresponding thereto, and the pre-stored control command includes a control command of the camera device communicatively connected to the VR head and a switching command to the camera device. It is assumed that the control information of "twice eyes in 1 s" can be stored in association with the control command "switching camera". After the monitoring device detects that the user blinks twice in 1 s, the control device can determine that the control command corresponding to the control information is: switching the first communication connection to the second communication connection between the VR head display and the second camera.
406、断开第一通信连接,并建立VR头显与第二摄像装置的第二通信连接;406. Disconnect the first communication connection, and establish a second communication connection between the VR head display and the second camera.
植株的种植空间内,除了设置有第一摄像装置,还可以设置第二摄像装置。监控装置确定控制指令为切换摄像装置之后,可以按照控制指令断开第一通信 连接,并建立VR头显与第二摄像装置的第二通信连接。In addition to the first imaging device, a second imaging device may be provided in the planting space of the plant. After the monitoring device determines that the control command is to switch the camera device, the first communication may be disconnected according to the control command. Connect and establish a second communication connection between the VR headset and the second camera.
407、通过第二摄像装置获取植株的第二图像信息;407. Acquire second image information of the plant by using the second imaging device.
建立VR头显与第二摄像装置之间的第二通信连接之后,第二摄像装置可以获取植株的第二图像信息。After the second communication connection between the VR head display and the second camera device is established, the second camera device can acquire the second image information of the plant.
408、通过VR头显显示第二图像信息;408. Display second image information by using a VR head.
监控系统获取植株的第二图像信息之后,可以通过第二通信连接将获取到的植株的第二图像信息发送给VR头显,以通过VR头显显示植株的第二图像信息。After the monitoring system acquires the second image information of the plant, the second image information of the acquired plant may be sent to the VR head display through the second communication connection to display the second image information of the plant through the VR head.
需要说明的是,本发明实施例中,第一图像信息指由第一摄像装置获取到的植株的图像信息,第二图像信息指由第二摄像装置获取到的植株的图像信息。若植株的种植面积较大,包括多个种植区域,则可以在每个种植区域均设置摄像装置,通过切换与VR头显连接的摄像装置,可以观察不同种植区域的植株的情况。It should be noted that, in the embodiment of the present invention, the first image information refers to image information of the plant acquired by the first imaging device, and the second image information refers to image information of the plant acquired by the second imaging device. If the planting area of the plant is large, including multiple planting areas, an imaging device can be installed in each planting area, and by switching the camera device connected to the VR head, it is possible to observe the plants in different planting areas.
上面对本发明实施例中植株的监控方法进行了描述,下面对本发明实施例中植株的监控系统进行描述。The monitoring method of the plant in the embodiment of the present invention has been described above, and the monitoring system of the plant in the embodiment of the present invention will be described below.
请参阅图5,本发明实施例中植株的监控系统一个实施例包括:Referring to FIG. 5, an embodiment of a monitoring system for a plant in an embodiment of the present invention includes:
第一摄像装置501,用于获取植株的第一图像信息;a first camera device 501, configured to acquire first image information of the plant;
第一通信连接模块502,用于建立VR头显与第一摄像装置的第一通信连接;a first communication connection module 502, configured to establish a first communication connection between the VR head display and the first camera device;
VR头显503用于显示第一图像信息,还用于检测用户输入的控制信息;The VR head display 503 is configured to display first image information, and is also used to detect control information input by the user;
第一控制模块504,用于当确定控制信息对应于对第一摄像装置的控制指令时,按照对第一摄像装置的控制指令对第一摄像装置进行控制。The first control module 504 is configured to control the first imaging device according to a control instruction to the first imaging device when determining that the control information corresponds to a control instruction to the first imaging device.
第一摄像装置501设置在植株种植区域,比如设置在种植箱中或者温室中。在实际使用中,第一通信连接模块502可以包括分别设置在第一摄像装置501和VR头显503上的蓝牙模块,以实现第一摄像装置501和VR头显503之间的无线连接。第一控制模块可以设置在VR头显503,也可以设置在第一摄像装置501上。The first camera device 501 is disposed in a plant growing area, such as in a planting box or in a greenhouse. In actual use, the first communication connection module 502 can include Bluetooth modules respectively disposed on the first camera 501 and the VR head display 503 to implement a wireless connection between the first camera 501 and the VR headset 503. The first control module may be disposed on the VR head display 503 or may be disposed on the first camera device 501.
优选的,VR头显还用于检测用户的头部转动信息,和/或眼部信息。Preferably, the VR head display is also used to detect the user's head rotation information, and/or eye information.
优选的,监控系统还包括识别模块,用于识别第一图像信息中害虫所在的 目标区域;识别模块可以设置在VR头显503,也可以设置在第一摄像装置501上。Preferably, the monitoring system further comprises an identification module for identifying the pest in the first image information The target area; the identification module may be disposed on the VR head display 503, or may be disposed on the first camera unit 501.
VR头显501还用于: VR Header 501 is also used to:
显示带有害虫标识的第一图像信息,害虫标识指向目标区域。The first image information with the pest identifier is displayed, and the pest identifier points to the target area.
请参阅图6,本发明实施例中植株的监控系统另一个实施例包括:Referring to FIG. 6, another embodiment of a monitoring system for a plant in an embodiment of the present invention includes:
第一摄像装置601,用于获取植株的第一图像信息;a first camera device 601, configured to acquire first image information of the plant;
第一通信连接模块602,用于建立VR头显与第一摄像装置的第一通信连接;a first communication connection module 602, configured to establish a first communication connection between the VR head and the first camera;
VR头显603用于显示第一图像信息,还用于检测用户输入的控制信息;The VR head display 603 is configured to display first image information, and is also used to detect control information input by the user;
第一控制模块604,用于当确定控制信息对应于对第一摄像装置的控制指令时,按照对第一摄像装置的控制指令对第一摄像装置进行控制;The first control module 604 is configured to: when determining that the control information corresponds to a control instruction to the first camera, control the first camera according to a control instruction to the first camera;
第二摄像装置605,用于获取植株的第二图像信息;a second camera 605, configured to acquire second image information of the plant;
第二通信连接模块606,用于建立VR头显与第二摄像装置的第二通信连接;a second communication connection module 606, configured to establish a second communication connection between the VR head display and the second camera device;
第二控制模块607,用于当确定控制信息对应于摄像装置的切换指令时,将第一通信连接切换为第二通信连接;The second control module 607 is configured to switch the first communication connection to the second communication connection when determining that the control information corresponds to the switching instruction of the camera device;
第一摄像装置601和第二摄像装置605均设置在植株种植区域,比如设置在种植箱中或者温室中。在实际使用中,第一控制模块604和第二控制模块607可以设置在VR头显603,也可以设置在第一摄像装置601和第二摄像装置605上。The first camera unit 601 and the second camera unit 605 are both disposed in a plant growing area, such as in a planting box or in a greenhouse. In actual use, the first control module 604 and the second control module 607 may be disposed on the VR head display 603, or may be disposed on the first imaging device 601 and the second imaging device 605.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
所述的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机 械或其它的形式。In the several embodiments described, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of cells is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, Mechanical or other form.
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。An integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
以上,以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that The technical solutions described in the examples are modified, or equivalent to some of the technical features, and the modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

  1. 一种植株的监控方法,其特征在于,包括:A method for monitoring a plant, characterized in that it comprises:
    建立VR头显与第一摄像装置的第一通信连接;Establishing a first communication connection between the VR head display and the first camera device;
    通过所述第一摄像装置获取所述植株的第一图像信息;Acquiring first image information of the plant by the first camera device;
    通过所述VR头显显示所述第一图像信息;Displaying the first image information by using the VR head;
    通过所述VR头显检测用户输入的控制信息;The control information input by the user is detected by the VR head;
    若确定所述控制信息对应于对所述第一摄像装置的控制指令,则按照所述对所述第一摄像装置的控制指令对所述第一摄像装置进行控制。If it is determined that the control information corresponds to a control instruction to the first imaging device, the first imaging device is controlled according to the control instruction for the first imaging device.
  2. 根据权利要求1所述的植株的监控方法,其特征在于,通过所述VR头显检测用户输入的控制信息包括:The method for monitoring a plant according to claim 1, wherein the detecting information input by the user by the VR head display comprises:
    通过所述VR头显检测用户的头部转动信息,和/或眼部信息。The user's head rotation information, and/or eye information is detected by the VR head.
  3. 根据权利要求2所述的植株的监控方法,其特征在于,所述对所述第一摄像装置的控制指令包括:The method for monitoring a plant according to claim 2, wherein the control instruction for the first camera comprises:
    转动所述第一摄像装置、或者平移所述第一摄像装置、或者控制所述第一摄像装置变焦。Rotating the first camera, or translating the first camera, or controlling the first camera to zoom.
  4. 根据权利要求1至3中任一项所述的植株的监控方法,其特征在于,在通过所述VR头显检测用户输入的控制信息之后,所述方法还包括:The method for monitoring a plant according to any one of claims 1 to 3, wherein after the control information input by the user is detected by the VR head, the method further comprises:
    若确定所述控制信息对应于摄像装置的切换指令,则将所述第一通信连接切换为所述VR头显与第二摄像装置的第二通信连接,所述第二摄像装置用于获取所述植株的第二图像信息。If it is determined that the control information corresponds to a switching instruction of the imaging device, switching the first communication connection to a second communication connection between the VR head display and the second imaging device, and the second imaging device is configured to acquire The second image information of the plant.
  5. 根据权利要求4所述的植株的监控方法,其特征在于,在通过所述第一摄像装置获取第一图像信息之后,在通过所述VR头显显示所述第一图像信息之前,所述方法还包括:The method for monitoring a plant according to claim 4, wherein after the first image information is acquired by the first camera, the method is displayed before the first image information is displayed by the VR head Also includes:
    识别所述第一图像信息中害虫所在的目标区域;Identifying a target area where the pest is located in the first image information;
    通过所述VR头显显示所述第一图像信息包括:Displaying the first image information by using the VR header includes:
    通过所述VR头显显示带有害虫标识的所述第一图像信息,所述害虫标识指向所述目标区域。The first image information with the pest identifier is displayed by the VR head, and the pest identifier points to the target area.
  6. 一种植株的监控系统,其特征在于,包括: A plant monitoring system characterized by comprising:
    第一摄像装置,用于获取所述植株的第一图像信息;a first camera device, configured to acquire first image information of the plant;
    第一通信连接模块,用于建立VR头显与所述第一摄像装置的第一通信连接;a first communication connection module, configured to establish a first communication connection between the VR head and the first camera;
    所述VR头显用于显示所述第一图像信息,还用于检测用户输入的控制信息;The VR header is used to display the first image information, and is also used to detect control information input by a user;
    第一控制模块,用于当确定所述控制信息对应于对所述第一摄像装置的控制指令时,按照所述对所述第一摄像装置的控制指令对所述第一摄像装置进行控制。a first control module, configured to: when determining that the control information corresponds to a control instruction to the first camera device, control the first camera device according to the control instruction for the first camera device.
  7. 根据权利要求6所述的植株的监控系统,其特征在于,所述VR头显还用于检测用户的头部转动信息,和/或眼部信息。The plant monitoring system according to claim 6, wherein the VR head display is further used to detect a user's head rotation information, and/or eye information.
  8. 根据权利要求7所述的植株的监控系统,其特征在于,所述对所述第一摄像装置的控制指令包括:The monitoring system for a plant according to claim 7, wherein the control instruction for the first camera comprises:
    转动所述第一摄像装置、或者平移所述第一摄像装置、或者控制所述第一摄像装置变焦。Rotating the first camera, or translating the first camera, or controlling the first camera to zoom.
  9. 根据权利要求6至8中任一项所述的植株的监控系统,其特征在于,所述监控系统还包括第二控制模块和第二摄像装置,所述第二摄像装置用于获取所述植株的第二图像信息;The monitoring system for a plant according to any one of claims 6 to 8, wherein the monitoring system further comprises a second control module and a second imaging device, wherein the second imaging device is configured to acquire the plant Second image information;
    第二通信连接模块,用于建立VR头显与所述第二摄像装置的第二通信连接;a second communication connection module, configured to establish a second communication connection between the VR head display and the second camera device;
    所述第二控制模块,用于当确定所述控制信息对应于摄像装置的切换指令时,将所述第一通信连接切换为第二通信连接。The second control module is configured to switch the first communication connection to a second communication connection when determining that the control information corresponds to a switching instruction of the camera device.
  10. 根据权利要求9所述的植株的监控系统,其特征在于,所述监控系统还包括:The monitoring system of the plant according to claim 9, wherein the monitoring system further comprises:
    识别模块,用于识别所述第一图像信息中害虫所在的目标区域;An identification module, configured to identify a target area where the pest is located in the first image information;
    所述VR头显还用于:The VR head display is also used to:
    显示带有害虫标识的所述第一图像信息,所述害虫标识指向所述目标区域。 The first image information with a pest identifier is displayed, the pest identifier pointing to the target area.
PCT/CN2017/094087 2017-04-28 2017-07-24 Plant monitoring method and monitoring system WO2018196184A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710293358.1A CN106993167A (en) 2017-04-28 2017-04-28 The monitoring method and monitoring system of one plant
CN201710293358.1 2017-04-28

Publications (1)

Publication Number Publication Date
WO2018196184A1 true WO2018196184A1 (en) 2018-11-01

Family

ID=59418032

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/094087 WO2018196184A1 (en) 2017-04-28 2017-07-24 Plant monitoring method and monitoring system

Country Status (2)

Country Link
CN (1) CN106993167A (en)
WO (1) WO2018196184A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031292A (en) * 2019-12-26 2020-04-17 北京中煤矿山工程有限公司 Coal mine safety production real-time monitoring system based on VR technique

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107295310B (en) * 2017-07-31 2019-01-08 深圳春沐源控股有限公司 planting monitoring method and planting monitoring device
CN110309933A (en) * 2018-03-23 2019-10-08 广州极飞科技有限公司 Plant plants data measuring method, work route method and device for planning, system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016145443A1 (en) * 2015-03-12 2016-09-15 Daniel Kerzner Virtual enhancement of security monitoring
CN106131483A (en) * 2016-06-24 2016-11-16 宇龙计算机通信科技(深圳)有限公司 A kind of method for inspecting based on virtual reality and relevant device, system
CN205726125U (en) * 2016-03-30 2016-11-23 重庆邮电大学 A kind of novel robot Long-Range Surveillance System
CN106383522A (en) * 2016-09-22 2017-02-08 华南农业大学 Virtual reality-based farmland agricultural condition information real-time monitoring system

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160133328A (en) * 2015-05-12 2016-11-22 삼성전자주식회사 Remote control method and device using wearable device
CN105828062A (en) * 2016-03-23 2016-08-03 常州视线电子科技有限公司 Unmanned aerial vehicle 3D virtual reality shooting system
CN106598244A (en) * 2016-12-12 2017-04-26 大连文森特软件科技有限公司 Plant growth monitoring system based on AR virtual reality technology

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016145443A1 (en) * 2015-03-12 2016-09-15 Daniel Kerzner Virtual enhancement of security monitoring
CN205726125U (en) * 2016-03-30 2016-11-23 重庆邮电大学 A kind of novel robot Long-Range Surveillance System
CN106131483A (en) * 2016-06-24 2016-11-16 宇龙计算机通信科技(深圳)有限公司 A kind of method for inspecting based on virtual reality and relevant device, system
CN106383522A (en) * 2016-09-22 2017-02-08 华南农业大学 Virtual reality-based farmland agricultural condition information real-time monitoring system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111031292A (en) * 2019-12-26 2020-04-17 北京中煤矿山工程有限公司 Coal mine safety production real-time monitoring system based on VR technique

Also Published As

Publication number Publication date
CN106993167A (en) 2017-07-28

Similar Documents

Publication Publication Date Title
US9842433B2 (en) Method, apparatus, and smart wearable device for fusing augmented reality and virtual reality
CN104486543B (en) System for controlling pan-tilt camera in touch mode of intelligent terminal
EP3029552B1 (en) Virtual reality system and method for controlling operation modes of virtual reality system
US10349031B2 (en) Augmented reality based user interfacing
JP6610546B2 (en) Information processing apparatus, information processing method, and program
US10171792B2 (en) Device and method for three-dimensional video communication
WO2019067899A1 (en) Controlling external devices using reality interfaces
EP2720464B1 (en) Generating image information
WO2018104869A1 (en) Telepresence system
JP6822410B2 (en) Information processing system and information processing method
JP7081052B2 (en) Displaying device sharing and interactivity in simulated reality (SR)
WO2018196184A1 (en) Plant monitoring method and monitoring system
KR20160091316A (en) Video interaction between physical locations
US11151804B2 (en) Information processing device, information processing method, and program
US10665034B2 (en) Imaging system, display apparatus and method of producing mixed-reality images
AU2017370476A1 (en) Virtual reality-based viewing method, device, and system
JP7239916B2 (en) Remote control system, information processing method, and program
CN106327583A (en) Virtual reality equipment for realizing panoramic image photographing and realization method thereof
WO2019028855A1 (en) Virtual display device, intelligent interaction method, and cloud server
WO2022072901A1 (en) Multi-sensor camera systems, devices and methods for providing image pan, tilt and zoom functionality
US20230215079A1 (en) Method and Device for Tailoring a Synthesized Reality Experience to a Physical Setting
CN114371779B (en) Visual enhancement method for sight depth guidance
WO2019102680A1 (en) Information processing device, information processing method, and program
CN112558761A (en) Remote virtual reality interaction system and method for mobile terminal
JP7242448B2 (en) VIRTUAL REALITY CONTROL DEVICE, VIRTUAL REALITY CONTROL METHOD AND PROGRAM

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17907818

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 26.02.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17907818

Country of ref document: EP

Kind code of ref document: A1