WO2018209877A1 - Position indicating method, operating apparatus, display apparatus, and position indicating apparatus - Google Patents

Position indicating method, operating apparatus, display apparatus, and position indicating apparatus Download PDF

Info

Publication number
WO2018209877A1
WO2018209877A1 PCT/CN2017/104652 CN2017104652W WO2018209877A1 WO 2018209877 A1 WO2018209877 A1 WO 2018209877A1 CN 2017104652 W CN2017104652 W CN 2017104652W WO 2018209877 A1 WO2018209877 A1 WO 2018209877A1
Authority
WO
WIPO (PCT)
Prior art keywords
coordinates
current time
identifier
imaging picture
display
Prior art date
Application number
PCT/CN2017/104652
Other languages
French (fr)
Chinese (zh)
Inventor
魏洋洋
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2018209877A1 publication Critical patent/WO2018209877A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus

Definitions

  • the present invention relates to the field of electronic display technologies, and in particular, to a position indication method, an operation device, a display device, and a position indication device.
  • the presenter typically uses a laser pointer to project a spot of light onto the screen to indicate a particular location on the screen.
  • the laser pointer also known as the laser pen, the star pen, etc., is a pen-type transmitter that is designed to be a portable, hand-friendly, laser module (light-emitting diode).
  • the laser pointer cannot be formed into a light spot due to total reflection of the glass when projected onto the display screen.
  • a laser pointer instead of a laser pointer.
  • a camera module is disposed on the indicator, and a position identifier is disposed on the display screen, and the indicator calculates a coordinate of the position indicated by the indicator on the display screen according to the coordinates of the position identifier in the image capturing screen, so that The display performs display processing on the indicated position.
  • this solution does not have the drawback of the laser pointer, it cannot be used at close range.
  • the camera screen can only capture a part of the display screen, so that the pointer can easily not capture the position marker during the movement, that is, there is a blind spot.
  • the position marker can be captured in the previous frame of the image capture screen, and the position marker cannot be captured in the next frame of the image capture screen due to the movement of the pointer.
  • the principle of this scheme if the position image of the current frame cannot capture the position marker, the coordinates of the position indicated by the pointer on the display screen cannot be calculated. Therefore, the accuracy of this scheme is too low, and it is easy to appear that it cannot be normally indicated.
  • an object of the present invention is to provide a position indication method, an operation device, a display device, and a position indication device, which are applicable to various display devices, and accurately indicate a position that needs to be instructed, thereby avoiding a blind spot that causes an abnormal indication. Case.
  • a first aspect of the present invention provides a location indication method, including:
  • the operating device indicates an arbitrary position on the display screen of the display device from the non-contact position, and photographs the pointed position to obtain an image forming screen; wherein the display device is provided with a position identifier;
  • the operating device identifies the location identifier in an imaging screen at a current time
  • the operation device When the operation device recognizes the position identifier in the imaging screen of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
  • the imaging When the operating device does not recognize the position identifier in the imaging picture at the current time, the imaging according to the position identifier at time X a coordinate in the picture and a motion displacement between the X time and the current time of the operating device, acquiring coordinates of the indicated position on the display screen at the current time; wherein the X time means that the last time the The moment of the location marker;
  • the operating device transmits coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  • the operation device recognizes the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display.
  • the coordinates on the screen including:
  • the operating device acquires coordinates (x1, y1) in the imaging picture of the current time position when the position identifier is recognized in the imaging picture at the current time;
  • the operation device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
  • the operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the location indication method further includes:
  • the operating device When the operating device is restarted or the duration between the X time and the current time exceeds a preset duration threshold, the operating device clears the storage of the coordinates of the position identifier in the imaged image when it is last recognized. data;
  • the operating device does not recognize the position identifier in the imaging picture at the current time, and cannot find an invalid coordinate when the position identifier stores the data of the coordinates in the imaging picture when it is last recognized.
  • the coordinates of the indicated position on the display screen are prompted and the user is prompted to adjust the position of the operating device until the operating device recognizes the position marker again in the imaging screen.
  • the position identifier is an infrared LED lamp.
  • the operating device transmits, by using wireless, the coordinates of the indicated position on the display screen at the current time to the display device, so that the display device performs the indicated position on the display screen. Display processing.
  • a second aspect of the present invention provides an operating device comprising:
  • a photographing module configured to instruct an arbitrary position of a display screen of the display device from a non-contact position, and photograph the indicated position to obtain an image forming screen; wherein the display device is provided with a position identifier;
  • a identifier identifying module configured to identify the location identifier in an imaging picture at a current time
  • a first coordinate acquiring module configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
  • a second coordinate acquiring module configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
  • a coordinate sending module configured to send coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  • the first coordinate acquisition module comprises:
  • a photographing coordinate acquiring unit configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
  • the second coordinate acquisition module comprises:
  • a coordinate displacement acquiring unit configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time
  • a second coordinate calculation unit configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the operating device further comprises:
  • a coordinate data clearing module configured to clear a coordinate of the position identifier in the imaged image when the position identifier is last recognized after the operating device is restarted or when the duration between the X time and the current time exceeds a preset duration threshold Storing data;
  • a third coordinate acquiring module configured to not recognize the position identifier in the imaging picture at the current time, and cannot find the stored data of the coordinates of the position identifier in the imaging picture when the position identifier is last recognized Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time, and prompting the user to adjust the position of the operating device until the operating device recognizes the position identifier again in the imaging screen.
  • the position identifier is an infrared LED lamp.
  • the coordinate sending module is configured to send, by using wireless, coordinates of the indication position on the display screen at a current moment to the display device, so that the display device is configured on the display screen. Indicate the position for display processing.
  • a third aspect of the present invention provides a location indication method, including:
  • the display device acquires an imaging screen transmitted by the operation device; the imaging screen is obtained by the operation device when the operation device indicates an arbitrary position on the display screen of the display device from a non-contact position; wherein the display a position identifier is disposed on the device;
  • the display device identifies the location identifier in an imaging picture at a current time
  • the display device When the display device recognizes the location identifier in the imaging picture of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
  • the display device When the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device Obtaining the current time indication position in the Displaying the coordinates on the screen; wherein the X time refers to the time when the position identifier can be recognized last time;
  • the display device performs display processing on the indication position on the display screen based on the coordinates of the indicated position on the display screen at the current time.
  • the display device recognizes the location identifier in the imaging picture of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display.
  • the coordinates on the screen including:
  • the display device acquires the coordinates (x1, y1) of the position identifier in the imaging picture at the current time when the position identifier is recognized in the imaging picture at the current time;
  • the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
  • the display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the position identifier is an infrared LED lamp.
  • a display device comprising:
  • An imaging picture acquiring module configured to acquire an imaging picture sent by the operating device; the imaging picture is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position; Wherein the display device is provided with a position identifier;
  • a identifier identifying module configured to identify the location identifier in an imaging picture at a current time
  • a first coordinate acquiring module configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
  • a second coordinate acquiring module configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
  • a display processing module configured to perform display processing on the indication position on the display screen according to coordinates of the indicated position on the display screen at the current time.
  • the first coordinate acquisition module comprises:
  • a photographing coordinate acquiring unit configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
  • the second coordinate acquisition module includes:
  • a coordinate displacement acquiring unit configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time
  • a second coordinate calculation unit configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the position identifier is an infrared LED lamp.
  • a fifth aspect of the present invention provides a location indication method, including:
  • the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is disposed on the display device;
  • the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
  • the current position indicates the coordinates of the position on the display screen; wherein the X time refers to the time when the position identifier can be recognized last time;
  • the indicated position is displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
  • a position indicating device comprising:
  • An imaging picture acquiring module configured to acquire an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is set On the display device;
  • a identifier identifying module configured to identify the location identifier at the current imaging screen
  • a first coordinate acquiring module configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
  • a second coordinate acquiring module configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
  • a display control module configured to control the indication position to be displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
  • an embodiment of the present invention provides a position indication method, an operation device, a display device, and a position indication device, wherein the position indication method includes the operation device from a non-contact position. Uppointing an arbitrary position on the display screen of the display device, and photographing the pointed position to obtain an imaged image; the operating device identifies the position marker in the imaged image at the current time; the operating device recognizes in the imaged image at the current time When the location identifier is obtained, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time; the imaging drawing of the operation device at the current time When the position identifier is not recognized in the surface, the current time indication is obtained according to the coordinates of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device.
  • the operating device transmits coordinates of the indicated position on the display screen at a current time to the display device, so that the display device pairs the indication on the display screen
  • the position is displayed for processing.
  • the method adopts an operation device with a camera function, instead of a laser pointer, which does not cause damage or harm to the human eye, and can be applied to any display device;
  • the coordinates of the indication position in the display screen can be calculated regardless of whether the position marker is recognized on the imaging picture at the current time, and the defect that cannot be normally indicated due to the shooting blind spot in the prior art is overcome.
  • FIG. 1 is a schematic flow chart of a location indication method according to a first embodiment of the present invention
  • FIG. 2 is a schematic diagram showing states of a current time display screen and an imaging screen
  • FIG. 3 is a structural block diagram of an operating device according to a second embodiment of the present invention.
  • FIG. 4 is a schematic flow chart of a location indication method according to a third embodiment of the present invention.
  • FIG. 5 is a structural block diagram of a display device according to a fourth embodiment of the present invention.
  • FIG. 6 is a schematic flow chart of a location indication method according to a fifth embodiment of the present invention.
  • FIG. 7 is a structural block diagram of a position indicating device according to a sixth embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a location indication method according to a first embodiment of the present invention, including:
  • the operating device instructs an arbitrary position on the display screen of the display device from the non-contact position, and photographs the pointed position to obtain an image forming screen; wherein the display device is provided with a position identifier;
  • the operating device identifies the location identifier in an imaging screen at a current time
  • the operation device When the operation device recognizes the position identifier in the imaging image of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the operation device acquires the current position indication position on the display screen. coordinate;
  • the operating device transmits the coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  • the position identifier is any object that can be recognized by the operating device.
  • the position identifier is an infrared LED.
  • the position identifier may be disposed at any position of the display device, such as a frame or a display screen of the display screen; preferably, the position identifier is disposed at a center point of the display screen.
  • the operating device can be processed into a pen shape.
  • step S11 the operation device specifically performs photographing by a camera provided on the main body of the operation device.
  • the camera can be placed at the front or side of the operating device.
  • step S15 the operating device preferably transmits the coordinates of the indicated position on the display screen at the current time to the display device by wireless, so that the display device performs the indicated position on the display screen.
  • Display processing The display processing performed by the display device may be a display spot or an aperture, which is not limited in this embodiment.
  • FIG. 2 is a schematic diagram showing the state of the current time display screen and the imaging screen.
  • a solid line frame indicates a display screen
  • a broken line frame indicates an image forming screen.
  • A denotes the coordinates of the position marker in the imaged picture
  • B denotes the coordinate indicating the position in the display screen.
  • the ultimate goal of this embodiment is to obtain the specific coordinates of B and display it by the display device to indicate the position indicated by the operating device.
  • step S13 includes:
  • the operating device acquires coordinates (x1, y1) in the imaging picture of the current time position when the position identifier is recognized in the imaging picture at the current time;
  • the L2/L1 and W2/W1 actually convert the coordinate system of the imaging picture into the long coefficient and the wide coefficient of the coordinate system of the display screen. Therefore, the coordinate x2 indicating the position in the x direction of the display screen can be obtained according to the long coefficient and x1. According to the width coefficient and y2, the y-direction coordinate y2 indicating the position on the display screen can be obtained.
  • step S14 includes:
  • the operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • step S13 according to the coordinate (x1', y1') of the position identifier that was acquired last time in the imaging picture and the motion displacement ( ⁇ x, the time from the time when the position identifier was last recognized to the current time. ⁇ y), the virtual coordinates (x1'+ ⁇ x, y1'+ ⁇ y) of the position marker in the imaging picture can be calculated. Converting the coordinate system of the imaged image to the coordinates of the display screen by the same virtual coordinate The method calculates the coordinates (x2, y2) of the current time indication position in the display screen.
  • step S14 even if the position marker does not exist in the image forming screen at the current time, the coordinates of the pointing position in the display screen can be calculated, overcoming the defect that the conventional blind spot cannot be normally indicated due to the shooting blind spot.
  • the location indication method further includes:
  • the operating device When the operating device is restarted or the duration between the X time and the current time exceeds a preset duration threshold, the operating device clears the storage of the coordinates of the position identifier in the imaged image when it is last recognized. data;
  • the operating device does not recognize the position identifier in the imaging picture at the current time, and cannot find an invalid coordinate when the position identifier stores the data of the coordinates in the imaging picture when it is last recognized.
  • the coordinates of the indicated position on the display screen are prompted and the user is prompted to adjust the position of the operating device until the operating device recognizes the position marker again in the imaging screen.
  • the display device receives the coordinates of the indicated position on the display screen at the current time, and if it is a valid coordinate, the display is normally performed, and if it is an invalid coordinate, the display is not performed.
  • the coordinates of the current time indication position in the display screen are calculated only according to the coordinates of the position identifier that was acquired last time in the imaging picture and the motion displacement from the time when the position identifier was last recognized to the current time. Suitable for short-term implementation. If the operating device restarts or the duration between the X time and the current time exceeds the preset duration threshold, a large error may be caused, so it is necessary to calibrate the coordinates of the last acquired position marker in the imaging screen.
  • the display device will not display the indicated position. .
  • the user needs to readjust the operating device so that the operating device recognizes the position marker again in the imaging screen, and the display device can display the indicated position normally.
  • the embodiment of the invention further provides an operation device.
  • FIG. 3 it is a structural block diagram of an operating device according to a second embodiment of the present invention, which includes:
  • the photographing module 11 is configured to instruct an arbitrary position of the display screen of the display device from the non-contact position, and photograph the indicated position to obtain an image forming screen; wherein the display device is provided with a position identifier;
  • the identifier identifying module 12 is configured to identify the location identifier in an imaging screen at a current time
  • the first coordinate acquiring module 13 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
  • the second coordinate acquiring module 14 is configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X a motion displacement between the current moments, obtaining coordinates of the indicated position on the display screen at the current time; wherein the X moment refers to a time at which the position identifier can be recognized last time;
  • the coordinate sending module 15 is configured to send coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  • the first coordinate acquisition module 13 includes:
  • a photographing coordinate acquiring unit configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
  • the second coordinate acquisition module 14 includes:
  • a coordinate displacement acquiring unit configured to acquire coordinates (x1′, y2′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time
  • a second coordinate calculation unit configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the operating device further comprises:
  • a coordinate data clearing module configured to clear a coordinate of the position identifier in the imaged image when the position identifier is last recognized after the operating device is restarted or when the duration between the X time and the current time exceeds a preset duration threshold Storing data;
  • a third coordinate acquiring module configured to not recognize the position identifier in the imaging picture at the current time, and cannot find the stored data of the coordinates of the position identifier in the imaging picture when the position identifier is last recognized Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time, and prompting the user to adjust the position of the operating device until the operating device recognizes the position identifier again in the imaging screen.
  • the position identifier is an infrared LED lamp.
  • the coordinate sending module 15 is configured to send, by using wireless, coordinates of the indicated position on the display screen at a current time to the display device, so that the display device is located on the display screen.
  • the indication position is displayed for display processing.
  • the operation device provided by the embodiment of the present invention is used to perform all the method steps of the position indication method of the first embodiment, and the working principle and the beneficial effects of the two are corresponding to each other, and thus are not described again.
  • FIG. 4 it is a schematic flowchart of a location indication method according to a third embodiment of the present invention, which includes:
  • the display device acquires an imaging screen sent by the operating device.
  • the imaging screen is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position;
  • the display device is provided with a position identifier;
  • the display device identifies the location identifier in an imaging screen at a current time.
  • the display device performs display processing on the indication position on the display screen according to coordinates of the indication position on the display screen at the current time.
  • the position identifier is any object that can be recognized by the operating device.
  • the position identifier is an infrared LED.
  • the position identifier may be disposed at any position of the display device, such as a frame or a display screen of the display screen; preferably, the location The position marker is set at a center point of the display screen.
  • the operating device can be processed into a pen shape.
  • step S31 the operation device specifically performs photographing by a camera provided on the main body of the operation device.
  • the camera can be placed at the front or side of the operating device.
  • the operating device preferably transmits the imaged picture of the current time to the display device by wireless.
  • the display device may perform a display process on the indication position, which may be a display spot or an aperture, which is not limited in this embodiment.
  • the display device recognizes the location identifier in the imaging picture of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display.
  • the coordinates on the screen including:
  • the display device acquires the coordinates (x1, y1) of the position identifier in the imaging picture at the current time when the position identifier is recognized in the imaging picture at the current time;
  • the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
  • the display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the position indication method provided by the third embodiment of the present invention is different from the position indication method provided by the first embodiment of the present invention in that the first embodiment of the present invention is implemented by an operation device, and the third embodiment of the present invention
  • the implementation by the display device is basically the same in the algorithm flow, and the technical problems, the working principle, and the beneficial effects to be achieved are the same, and thus will not be further described in the third embodiment of the present invention.
  • the fourth embodiment of the present invention further provides an operation device.
  • FIG. 5 it is a structural block diagram of an operating device according to a fourth embodiment of the present invention, including:
  • An imaging screen acquiring module 31 configured to acquire an imaging screen sent by the operating device; the imaging screen is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position Wherein the display device is provided with a position identifier;
  • the identifier identifying module 32 is configured to identify the location identifier in an imaging screen at a current time
  • the first coordinate acquiring module 33 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
  • a second coordinate acquiring module 34 configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X The displacement between the current moments, the current moment Describe the coordinates of the position on the display screen; wherein the X time refers to the time when the position identifier can be recognized last time;
  • the display processing module 35 is configured to perform display processing on the indication position on the display screen according to the coordinates of the indicated position on the display screen at the current time.
  • the first coordinate acquisition module 33 includes:
  • a photographing coordinate acquiring unit configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
  • the second coordinate acquisition module 34 includes:
  • a coordinate displacement acquiring unit configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time
  • a second coordinate calculation unit configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement ( ⁇ x, ⁇ y);
  • x2 (x1' + ⁇ x) ⁇ L2 / L1
  • y2 (y1' + ⁇ y) ⁇ W2 / W1.
  • the position identifier is an infrared LED lamp.
  • the display device provided by the fourth embodiment of the present invention is configured to perform all the method steps of the position indication method of the third embodiment, and the working principle and the beneficial effects of the two are in one-to-one correspondence, and thus no further description is provided. .
  • FIG. 6 is a schematic flowchart of a location indication method according to a fifth embodiment of the present invention, including:
  • S51 acquiring an imaging screen; the imaging screen is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is disposed on the display device on;
  • the indicated position is displayed on the display screen according to coordinates of the indication position on the display screen according to the current time.
  • the position indication method provided by the fifth embodiment of the present invention is different from the first embodiment and the third embodiment in that each step of the fifth embodiment of the present invention can be performed by the operation device (equivalent to the first An embodiment), or both may be performed by a display device (equivalent to the third embodiment), or one or more of the preceding steps are performed by the operating device, and one or more of the following steps are performed by the display device.
  • S51 to S53 are executed by the operating device
  • S54 and S55 are executed by the display device. Therefore, the technical problems, the working principle, and the beneficial effects to be achieved by the three embodiments are the same, and thus will not be described again in the fifth embodiment of the present invention.
  • the sixth embodiment of the present invention further provides a position indication device.
  • FIG. 7 is a structural block diagram of a position indicating apparatus according to a sixth embodiment of the present invention, which includes:
  • An imaging picture acquiring module 51 configured to acquire an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier Provided on the display device;
  • the identifier identifying module 52 is configured to identify the location identifier on the imaging screen at the current time
  • the first coordinate acquiring module 53 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
  • the second coordinate acquiring module 54 is configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X a motion displacement between the current moments, obtaining coordinates of the indicated position on the display screen at the current time; wherein the X moment refers to a time at which the position identifier can be recognized last time;
  • the display control module 55 is configured to control the indication position to be displayed on the display screen according to coordinates of the indication position on the display screen at the current time.
  • the position indicating device provided by the sixth embodiment of the present invention is for performing the position indicating method provided by the fifth embodiment.
  • All the modules in the position indicating device may be disposed in the operating device, or are disposed in the display device, or some modules are disposed in the operating device, and some modules are disposed in the display device.
  • the imaging screen acquisition module 51, the marker recognition module 52, and the first coordinate acquisition module 53 are disposed in the operation device, and the second coordinate acquisition module 54 and the display control module 55 are disposed in the display device.
  • an embodiment of the present invention provides a position indication method, an operation device, a display device, and a position indication device, wherein the position indication method includes the operation device from a non-contact position. Uppointing an arbitrary position on the display screen of the display device, and photographing the pointed position to obtain an imaged image; the operating device identifies the position marker in the imaged image at the current time; the operating device recognizes in the imaged image at the current time When the location identifier is obtained, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time; the operation device identifies the image in the current time When the location identifier is not available, according to the coordinates of the location identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device, the current time indication position is obtained.
  • the operating device sets the indicated position at the current time in the display Coordinates on the screen of the display device to transmit, to cause said display means on the display screen of a display process of the indication position.
  • the method adopts an operation device with a camera function, instead of a laser pointer, which does not cause damage or harm to the human eye, and can be applied to any display device;
  • the coordinates of the indication position in the display screen can be calculated regardless of whether the position marker is recognized on the imaging picture at the current time, and the defect that cannot be normally indicated due to the shooting blind spot in the prior art is overcome.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

A position indicating method, an operating apparatus, a display apparatus, and a position indicating apparatus, the method comprising: the operating apparatus indicates any position on a display screen of the display apparatus from a non-contact position, and photographs the indicated position to obtain an imaging picture (S11); the operating apparatus identifies a position identifier in the imaging picture at the current time (S12); when identifying a position identifier in the imaging picture at the current time, on the basis of the coordinates of the position identifier in the imaging picture at the current time, the operating apparatus acquires coordinates of the indicated position on the display screen at the current time (S13); when not identifying the position identifier in the imaging picture at the current time, on the basis of the coordinates of the position identifier in the imaging picture at time X and the movement displacement of the operating apparatus between time X and the current time, the operating apparatus acquires the coordinates of the indicated position on the display screen at the current time (S14); and the operating apparatus sends the coordinates of the indicated position on the display screen at the current time to the display apparatus, such that the display apparatus performs display processing of the indicated position on the display screen (S15). The present method can calculate the coordinates of the indicated position on the display screen regardless of whether the position identifier has been identified on the imaging picture at the current time, overcoming the defect of being unable to perform normal indication due to photographic blind spots.

Description

位置指示方法、操作装置、显示装置与位置指示装置Position indication method, operation device, display device and position indication device 技术领域Technical field
本发明涉及电子显示技术领域,尤其涉及一种位置指示方法、操作装置、显示装置与位置指示装置。The present invention relates to the field of electronic display technologies, and in particular, to a position indication method, an operation device, a display device, and a position indication device.
背景技术Background technique
在会议或者教学场景下,演讲者通常使用激光指示器来投射一个光点到屏幕上,从而指示屏幕上的一个特定位置。激光指示器,又称为激光笔、指星笔等,是把可见激光设计成便携、手易握、激光模组(发光二极管)加工成的笔型发射器。In a meeting or teaching scenario, the presenter typically uses a laser pointer to project a spot of light onto the screen to indicate a particular location on the screen. The laser pointer, also known as the laser pen, the star pen, etc., is a pen-type transmitter that is designed to be a portable, hand-friendly, laser module (light-emitting diode).
采用激光指示器进行位置指示有两个缺陷:There are two drawbacks to using a laser pointer for position indication:
第一,市面上售卖的激光笔和激光手电,不少是属于IIIB级的,功率超过5mW,如果激光直射进眼睛可能会对眼睛造成伤害。一些高功率的激光笔,漫射光也可能对眼睛造成伤害,对焦后更可能燃点易燃品;First, many laser pens and laser flashlights on the market are classified as Class IIIB with a power of more than 5mW. If the laser is directly into the eyes, it may cause eye damage. Some high-power laser pointers, diffused light may also cause damage to the eyes, and it is more likely to ignite flammable products after focusing;
第二,对于采用玻璃作为显示屏的显示设备,激光指示器投射到显示屏时由于玻璃的全反射而无法形成光点。Second, for a display device using glass as a display screen, the laser pointer cannot be formed into a light spot due to total reflection of the glass when projected onto the display screen.
现有技术还有一种方案是不采用激光指示器,而是采用摄像指示器。具体地,在指示器上设置摄像模块,在显示画面上设置位置标识物,指示器根据所述位置标识物在摄像画面中的坐标计算出指示器所指示的位置在显示画面的坐标,以使显示器对指示位置进行显示处理。Another solution in the prior art is to use a laser pointer instead of a laser pointer. Specifically, a camera module is disposed on the indicator, and a position identifier is disposed on the display screen, and the indicator calculates a coordinate of the position indicated by the indicator on the display screen according to the coordinates of the position identifier in the image capturing screen, so that The display performs display processing on the indicated position.
这种方案虽然不存在激光指示器的缺陷,但是无法在近距离使用。当距离太近时,摄像画面只能拍摄到显示画面的一部分区域,使得指示器在移动过程中,很容易拍摄不到位置标识物,即存在拍摄盲区。比如说在上一帧摄像画面中能够拍摄到位置标识物,而在下一帧摄像画面中由于指示器移动了使得不能拍摄到位置标识物。根据这种方案的原理,如果当前帧的摄像画面无法拍摄到位置标识物则无法计算指示器所指示的位置在显示画面的坐标。因此,这种方案的精确度太低,很容易出现无法正常指示的情况。Although this solution does not have the drawback of the laser pointer, it cannot be used at close range. When the distance is too close, the camera screen can only capture a part of the display screen, so that the pointer can easily not capture the position marker during the movement, that is, there is a blind spot. For example, the position marker can be captured in the previous frame of the image capture screen, and the position marker cannot be captured in the next frame of the image capture screen due to the movement of the pointer. According to the principle of this scheme, if the position image of the current frame cannot capture the position marker, the coordinates of the position indicated by the pointer on the display screen cannot be calculated. Therefore, the accuracy of this scheme is too low, and it is easy to appear that it cannot be normally indicated.
发明内容Summary of the invention
针对上述问题,本发明的目的在于提供一种位置指示方法、操作装置、显示装置与位置指示装置,适用于各种显示设备,并且精确地指示需要指示的位置,避免了拍摄盲区导致无法正常指示的情况。In view of the above problems, an object of the present invention is to provide a position indication method, an operation device, a display device, and a position indication device, which are applicable to various display devices, and accurately indicate a position that needs to be instructed, thereby avoiding a blind spot that causes an abnormal indication. Case.
为了实现上述目的,本发明第一方面提供了一种位置指示方法,包括:In order to achieve the above object, a first aspect of the present invention provides a location indication method, including:
操作装置从非接触的位置上指示显示装置的显示画面上的任意位置,并对指示位置拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;The operating device indicates an arbitrary position on the display screen of the display device from the non-contact position, and photographs the pointed position to obtain an image forming screen; wherein the display device is provided with a position identifier;
操作装置在当前时刻的成像画面中对所述位置标识物进行识别;The operating device identifies the location identifier in an imaging screen at a current time;
操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the operation device recognizes the position identifier in the imaging screen of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像 画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the operating device does not recognize the position identifier in the imaging picture at the current time, the imaging according to the position identifier at time X a coordinate in the picture and a motion displacement between the X time and the current time of the operating device, acquiring coordinates of the indicated position on the display screen at the current time; wherein the X time means that the last time the The moment of the location marker;
操作装置将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。The operating device transmits coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
优选地,所述操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the operation device recognizes the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display. The coordinates on the screen, including:
所述操作装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The operating device acquires coordinates (x1, y1) in the imaging picture of the current time position when the position identifier is recognized in the imaging picture at the current time;
所述操作装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
优选地,所述操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the operation device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
所述操作装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the operation device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) of the position identifier in the imaging picture at time X and the operation device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
所述操作装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述位置指示方法还包括:Preferably, the location indication method further includes:
当所述操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,所述操作装置清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;When the operating device is restarted or the duration between the X time and the current time exceeds a preset duration threshold, the operating device clears the storage of the coordinates of the position identifier in the imaged image when it is last recognized. data;
所述操作装置在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。The operating device does not recognize the position identifier in the imaging picture at the current time, and cannot find an invalid coordinate when the position identifier stores the data of the coordinates in the imaging picture when it is last recognized. As the current time, the coordinates of the indicated position on the display screen are prompted and the user is prompted to adjust the position of the operating device until the operating device recognizes the position marker again in the imaging screen.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
优选地,所述操作装置具体通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。Preferably, the operating device transmits, by using wireless, the coordinates of the indicated position on the display screen at the current time to the display device, so that the display device performs the indicated position on the display screen. Display processing.
为了实现相同的目的,本发明第二方面提供了一种操作装置,包括:In order to achieve the same object, a second aspect of the present invention provides an operating device comprising:
拍摄模块,用于从非接触的位置上指示显示装置的显示画面的任意位置,并对指示位置进行拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;a photographing module, configured to instruct an arbitrary position of a display screen of the display device from a non-contact position, and photograph the indicated position to obtain an image forming screen; wherein the display device is provided with a position identifier;
标识物识别模块,用于在当前时刻的成像画面中对所述位置标识物进行识别;a identifier identifying module, configured to identify the location identifier in an imaging picture at a current time;
第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标; a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
坐标发送模块,用于将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。And a coordinate sending module configured to send coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
优选地,所述第一坐标获取模块包括:Preferably, the first coordinate acquisition module comprises:
拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述成像画面的宽。a first coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinate (x1, y1); wherein x2=x1·L2/L1, y2 = y1 · W2 / W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the imaging picture.
优选地,所述第二坐标获取模块包括:Preferably, the second coordinate acquisition module comprises:
坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述操作装置还包括:Preferably, the operating device further comprises:
坐标数据清除模块,用于在操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;a coordinate data clearing module, configured to clear a coordinate of the position identifier in the imaged image when the position identifier is last recognized after the operating device is restarted or when the duration between the X time and the current time exceeds a preset duration threshold Storing data;
第三坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标,并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。a third coordinate acquiring module, configured to not recognize the position identifier in the imaging picture at the current time, and cannot find the stored data of the coordinates of the position identifier in the imaging picture when the position identifier is last recognized Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time, and prompting the user to adjust the position of the operating device until the operating device recognizes the position identifier again in the imaging screen.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
优选地,所述坐标发送模块具体用于通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。Preferably, the coordinate sending module is configured to send, by using wireless, coordinates of the indication position on the display screen at a current moment to the display device, so that the display device is configured on the display screen. Indicate the position for display processing.
为了实现相同的目的,本发明第三方面提供了一种位置指示方法,包括:In order to achieve the same object, a third aspect of the present invention provides a location indication method, including:
显示装置获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;The display device acquires an imaging screen transmitted by the operation device; the imaging screen is obtained by the operation device when the operation device indicates an arbitrary position on the display screen of the display device from a non-contact position; wherein the display a position identifier is disposed on the device;
显示装置在当前时刻的成像画面中对所述位置标识物进行识别;The display device identifies the location identifier in an imaging picture at a current time;
显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the display device recognizes the location identifier in the imaging picture of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述 显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device Obtaining the current time indication position in the Displaying the coordinates on the screen; wherein the X time refers to the time when the position identifier can be recognized last time;
显示装置根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。The display device performs display processing on the indication position on the display screen based on the coordinates of the indicated position on the display screen at the current time.
优选地,所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the display device recognizes the location identifier in the imaging picture of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display. The coordinates on the screen, including:
所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The display device acquires the coordinates (x1, y1) of the position identifier in the imaging picture at the current time when the position identifier is recognized in the imaging picture at the current time;
所述显示装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
优选地,所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the display device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) in the imaging picture of the position identifier at time X and the operating device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
所述显示装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
为了实现相同的目的,本发明第四方面提供了一种显示装置,包括:In order to achieve the same object, a fourth aspect of the present invention provides a display device comprising:
成像画面获取模块,用于获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;An imaging picture acquiring module, configured to acquire an imaging picture sent by the operating device; the imaging picture is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position; Wherein the display device is provided with a position identifier;
标识物识别模块,用于在当前时刻的成像画面中对所述位置标识物进行识别;a identifier identifying module, configured to identify the location identifier in an imaging picture at a current time;
第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
显示处理模块,用于根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。And a display processing module, configured to perform display processing on the indication position on the display screen according to coordinates of the indicated position on the display screen at the current time.
优选地,所述第一坐标获取模块包括:Preferably, the first coordinate acquisition module comprises:
拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标 (x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。a first coordinate calculation unit, configured to calculate, according to coordinates (x1, y1), coordinates of the indicated position on the display screen at the current time (x2, y2); wherein x2=x1·L2/L1, y2=y1·W2/W1; L1 is the length of the imaging picture, L2 is the length of the display picture, and W1 is the width of the imaging picture , W2 is the width of the display screen.
优选地,所述第二坐标获取模块,包括:Preferably, the second coordinate acquisition module includes:
坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
为了实现相同的目的,本发明第五方面提供了一种位置指示方法,包括:In order to achieve the same object, a fifth aspect of the present invention provides a location indication method, including:
获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;Acquiring an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is disposed on the display device;
在当前时刻的成像画面对位置标识物进行识别;Identifying the location marker at the current imaging screen;
在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the location identifier is recognized in the imaging picture at the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the motion displacement of the operating device between the X time and the current time, The current position indicates the coordinates of the position on the display screen; wherein the X time refers to the time when the position identifier can be recognized last time;
根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。The indicated position is displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
为了实现相同的目的,本发明第六方面提供了一种位置指示装置,包括:In order to achieve the same object, a sixth aspect of the present invention provides a position indicating device, comprising:
成像画面获取模块,用于获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;An imaging picture acquiring module, configured to acquire an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is set On the display device;
标识物识别模块,用于在当前时刻的成像画面对位置标识物进行识别;a identifier identifying module, configured to identify the location identifier at the current imaging screen;
第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
显示控制模块,用于根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。And a display control module, configured to control the indication position to be displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
相比于现有技术,本发明实施例的有益效果在于:本发明实施例提供了一种位置指示方法、操作装置、显示装置与位置指示装置,其中位置指示方法包括操作装置从非接触的位置上指示显示装置的显示画面上的任意位置,并对指示位置拍摄以得到成像画面;操作装置在当前时刻的成像画面中对所述位置标识物进行识别;操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;操作装置在当前时刻的成像画 面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;操作装置将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。本方法采用的是具有摄像功能的操作装置,而不是激光指示器,不会对人眼造成损伤或者危害,并且可以适用于任意的显示设备;同时,Compared with the prior art, an embodiment of the present invention provides a position indication method, an operation device, a display device, and a position indication device, wherein the position indication method includes the operation device from a non-contact position. Uppointing an arbitrary position on the display screen of the display device, and photographing the pointed position to obtain an imaged image; the operating device identifies the position marker in the imaged image at the current time; the operating device recognizes in the imaged image at the current time When the location identifier is obtained, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time; the imaging drawing of the operation device at the current time When the position identifier is not recognized in the surface, the current time indication is obtained according to the coordinates of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device. a coordinate positioned on the display screen; the operating device transmits coordinates of the indicated position on the display screen at a current time to the display device, so that the display device pairs the indication on the display screen The position is displayed for processing. The method adopts an operation device with a camera function, instead of a laser pointer, which does not cause damage or harm to the human eye, and can be applied to any display device;
通过本方法,无论在当前时刻的成像画面上是否识别到位置标识物,都可以计算出指示位置在显示画面中的坐标,克服了现有技术中因为拍摄盲区导致无法正常指示的缺陷。With the method, the coordinates of the indication position in the display screen can be calculated regardless of whether the position marker is recognized on the imaging picture at the current time, and the defect that cannot be normally indicated due to the shooting blind spot in the prior art is overcome.
附图说明DRAWINGS
为了更清楚地说明本发明的技术方案,下面将对实施方式中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施方式,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the present invention, the drawings used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention, which are common in the art. For the skilled person, other drawings can be obtained from these drawings without any creative work.
图1是本发明第一实施例提供的一种位置指示方法的流程示意图;1 is a schematic flow chart of a location indication method according to a first embodiment of the present invention;
图2是当前时刻显示画面与成像画面的状态示意图;2 is a schematic diagram showing states of a current time display screen and an imaging screen;
图3是本发明第二实施例提供的一种操作装置的结构框图;3 is a structural block diagram of an operating device according to a second embodiment of the present invention;
图4是本发明第三实施例提供的一种位置指示方法的流程示意图;4 is a schematic flow chart of a location indication method according to a third embodiment of the present invention;
图5是本发明第四实施例提供的一种显示装置的结构框图;FIG. 5 is a structural block diagram of a display device according to a fourth embodiment of the present invention; FIG.
图6是本发明第五实施例提供的一种位置指示方法的流程示意图;6 is a schematic flow chart of a location indication method according to a fifth embodiment of the present invention;
图7是本发明第六实施例提供的一种位置指示装置的结构框图。FIG. 7 is a structural block diagram of a position indicating device according to a sixth embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
请参阅图1,其是本发明第一实施例提供的一种位置指示方法的流程示意图,包括:FIG. 1 is a schematic flowchart of a location indication method according to a first embodiment of the present invention, including:
S11,操作装置从非接触的位置上指示显示装置的显示画面上的任意位置,并对指示位置拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;S11, the operating device instructs an arbitrary position on the display screen of the display device from the non-contact position, and photographs the pointed position to obtain an image forming screen; wherein the display device is provided with a position identifier;
S12,操作装置在当前时刻的成像画面中对所述位置标识物进行识别;S12. The operating device identifies the location identifier in an imaging screen at a current time;
S13,操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;S13. When the operation device recognizes the position identifier in the imaging image of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the operation device acquires the current position indication position on the display screen. coordinate;
S14,操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;S14, when the operation device does not recognize the position identifier in the imaging picture of the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device between the X time and the current time Motion displacement, obtaining coordinates of the indicated position on the display screen at the current time; wherein, the X time refers to the time at which the position identifier can be recognized last time;
S15,操作装置将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。 S15. The operating device transmits the coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
其中,所述位置标识物为任意可以被操作装置能够识别的物体,在本实施例中,所述位置标识物为红外LED。The position identifier is any object that can be recognized by the operating device. In this embodiment, the position identifier is an infrared LED.
所述位置标识物可以设置在显示装置的任一位置,例如显示画面的边框或者显示画面上;优选地,所述位置标识物设置在所述显示画面的中心点。The position identifier may be disposed at any position of the display device, such as a frame or a display screen of the display screen; preferably, the position identifier is disposed at a center point of the display screen.
此外,为了符合用户的使用习惯,所述操作装置可以被加工为笔状。Further, in order to comply with the user's usage habits, the operating device can be processed into a pen shape.
在步骤S11中,操作装置具体是通过设置在操作装置本体上的摄像头来进行拍摄。摄像头可以设置在操作装置的前端或者侧端。In step S11, the operation device specifically performs photographing by a camera provided on the main body of the operation device. The camera can be placed at the front or side of the operating device.
在步骤S15中,操作装置优选通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。所述显示装置进行显示处理可以是显示光点或者光圈,在本实施例中不作限定。In step S15, the operating device preferably transmits the coordinates of the indicated position on the display screen at the current time to the display device by wireless, so that the display device performs the indicated position on the display screen. Display processing. The display processing performed by the display device may be a display spot or an aperture, which is not limited in this embodiment.
为了清楚本实施例的工作原理,请同时参阅图2。其中,图2是当前时刻显示画面与成像画面的状态示意图。在图2中,实线框表示显示画面,虚线框表示成像画面。A表示位置标识物在成像画面中的坐标,B表示指示位置在显示画面中的坐标。本实施例的最终目的是要得到B的具体坐标,并且通过显示装置显示,以指示操作装置所指示的位置。In order to understand the working principle of this embodiment, please refer to FIG. 2 at the same time. 2 is a schematic diagram showing the state of the current time display screen and the imaging screen. In FIG. 2, a solid line frame indicates a display screen, and a broken line frame indicates an image forming screen. A denotes the coordinates of the position marker in the imaged picture, and B denotes the coordinate indicating the position in the display screen. The ultimate goal of this embodiment is to obtain the specific coordinates of B and display it by the display device to indicate the position indicated by the operating device.
在本实施例中,步骤S13包括:In this embodiment, step S13 includes:
所述操作装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The operating device acquires coordinates (x1, y1) in the imaging picture of the current time position when the position identifier is recognized in the imaging picture at the current time;
所述操作装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
L2/L1以及W2/W1实际上是将成像画面的坐标系转变为显示画面的坐标系的长系数以及宽系数,因此根据长系数以及x1即可得到指示位置在显示画面的x方向的坐标x2,根据宽系数以及y2即可得到指示位置在显示画面的y方向坐标y2。L2/L1 and W2/W1 actually convert the coordinate system of the imaging picture into the long coefficient and the wide coefficient of the coordinate system of the display screen. Therefore, the coordinate x2 indicating the position in the x direction of the display screen can be obtained according to the long coefficient and x1. According to the width coefficient and y2, the y-direction coordinate y2 indicating the position on the display screen can be obtained.
通过上述的方式,在当前时刻的成像画面中识别到所述位置标识物时可以计算出当前时刻指示位置在显示画面中的坐标。但是如果在当前时刻的成像画面中识别不到所述位置标识物时,传统的方式无法进行计算,而本实施例采用以下的方式。In the above manner, when the position marker is recognized in the imaging screen at the current time, the coordinates of the current time indication position in the display screen can be calculated. However, if the position marker is not recognized in the image frame of the current time, the conventional method cannot perform calculation, and the embodiment adopts the following manner.
在可选的实施方式中,步骤S14包括:In an optional implementation, step S14 includes:
所述操作装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the operation device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) of the position identifier in the imaging picture at time X and the operation device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
所述操作装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
在步骤S13中,根据最后一次获取到的所述位置标识物在成像画面中的坐标(x1’,y1’)以及最后一次识别到所述位置标识物的时刻到当前时刻的运动位移(Δx,Δy),可以计算出位置标识物在成像画面中的虚拟坐标(x1’+Δx,y1’+Δy)。根据所述虚拟坐标通过同样的将成像画面的坐标系转变为显示画面的坐标 系方法计算得到当前时刻指示位置在显示画面中的坐标(x2,y2)。In step S13, according to the coordinate (x1', y1') of the position identifier that was acquired last time in the imaging picture and the motion displacement (Δx, the time from the time when the position identifier was last recognized to the current time. Δy), the virtual coordinates (x1'+Δx, y1'+Δy) of the position marker in the imaging picture can be calculated. Converting the coordinate system of the imaged image to the coordinates of the display screen by the same virtual coordinate The method calculates the coordinates (x2, y2) of the current time indication position in the display screen.
因此,通过步骤S14,即便当前时刻成像画面中不存在所述位置标识物,也能够计算出指示位置在显示画面中的坐标,克服了现有技术中因为拍摄盲区导致无法正常指示的缺陷。Therefore, in step S14, even if the position marker does not exist in the image forming screen at the current time, the coordinates of the pointing position in the display screen can be calculated, overcoming the defect that the conventional blind spot cannot be normally indicated due to the shooting blind spot.
优选地,所述位置指示方法还包括:Preferably, the location indication method further includes:
当所述操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,所述操作装置清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;When the operating device is restarted or the duration between the X time and the current time exceeds a preset duration threshold, the operating device clears the storage of the coordinates of the position identifier in the imaged image when it is last recognized. data;
所述操作装置在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。The operating device does not recognize the position identifier in the imaging picture at the current time, and cannot find an invalid coordinate when the position identifier stores the data of the coordinates in the imaging picture when it is last recognized. As the current time, the coordinates of the indicated position on the display screen are prompted and the user is prompted to adjust the position of the operating device until the operating device recognizes the position marker again in the imaging screen.
显示装置在接收到当前时刻所述指示位置在所述显示画面上的坐标,如果是有效的坐标,则正常进行显示,如果是无效的坐标,则不进行显示。The display device receives the coordinates of the indicated position on the display screen at the current time, and if it is a valid coordinate, the display is normally performed, and if it is an invalid coordinate, the display is not performed.
因为根据最后一次获取到的所述位置标识物在成像画面中的坐标以及最后一次识别到所述位置标识物的时刻到当前时刻的运动位移,来计算当前时刻指示位置在显示画面中的坐标只适合短时间内实施。如果操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值,可能会引起较大的误差,因此需要校准最后一次获取到的所述位置标识物在成像画面中的坐标。The coordinates of the current time indication position in the display screen are calculated only according to the coordinates of the position identifier that was acquired last time in the imaging picture and the motion displacement from the time when the position identifier was last recognized to the current time. Suitable for short-term implementation. If the operating device restarts or the duration between the X time and the current time exceeds the preset duration threshold, a large error may be caused, so it is necessary to calibrate the coordinates of the last acquired position marker in the imaging screen.
因此,当操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,并且在当前时刻的成像画面中识别不到所述位置标识物,显示装置将不对指示位置进行显示。用户需要重新调整操作装置以使得所述操作装置再次在成像画面中识别到所述位置标识物,显示装置才能正常显示指示位置。Therefore, when the operating device is restarted or the duration between the X time and the current time exceeds the preset duration threshold, and the position identifier is not recognized in the imaging picture at the current time, the display device will not display the indicated position. . The user needs to readjust the operating device so that the operating device recognizes the position marker again in the imaging screen, and the display device can display the indicated position normally.
为了执行上述第一实施例的一种位置指示方法,本发明实施例还提供了一种操作装置。In order to perform the position indication method of the first embodiment, the embodiment of the invention further provides an operation device.
请参阅图3,其是本发明第二实施例提供的一种操作装置的结构框图,其包括:Referring to FIG. 3, it is a structural block diagram of an operating device according to a second embodiment of the present invention, which includes:
拍摄模块11,用于从非接触的位置上指示显示装置的显示画面的任意位置,并对指示位置进行拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;The photographing module 11 is configured to instruct an arbitrary position of the display screen of the display device from the non-contact position, and photograph the indicated position to obtain an image forming screen; wherein the display device is provided with a position identifier;
标识物识别模块12,用于在当前时刻的成像画面中对所述位置标识物进行识别;The identifier identifying module 12 is configured to identify the location identifier in an imaging screen at a current time;
第一坐标获取模块13,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;The first coordinate acquiring module 13 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
第二坐标获取模块14,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;The second coordinate acquiring module 14 is configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X a motion displacement between the current moments, obtaining coordinates of the indicated position on the display screen at the current time; wherein the X moment refers to a time at which the position identifier can be recognized last time;
坐标发送模块15,用于将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。The coordinate sending module 15 is configured to send coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
优选地,所述第一坐标获取模块13包括:Preferably, the first coordinate acquisition module 13 includes:
拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标 (x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述成像画面的宽。a first coordinate calculation unit, configured to calculate, according to coordinates (x1, y1), coordinates of the indicated position on the display screen at the current time (x2, y2); wherein x2=x1·L2/L1, y2=y1·W2/W1; L1 is the length of the imaging picture, L2 is the length of the display picture, and W1 is the width of the imaging picture , W2 is the width of the imaged picture.
优选地,所述第二坐标获取模块14包括:Preferably, the second coordinate acquisition module 14 includes:
坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y2’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y2′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述操作装置还包括:Preferably, the operating device further comprises:
坐标数据清除模块,用于在操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;a coordinate data clearing module, configured to clear a coordinate of the position identifier in the imaged image when the position identifier is last recognized after the operating device is restarted or when the duration between the X time and the current time exceeds a preset duration threshold Storing data;
第三坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标,并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。a third coordinate acquiring module, configured to not recognize the position identifier in the imaging picture at the current time, and cannot find the stored data of the coordinates of the position identifier in the imaging picture when the position identifier is last recognized Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time, and prompting the user to adjust the position of the operating device until the operating device recognizes the position identifier again in the imaging screen.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
优选地,所述坐标发送模块15具体用于通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。Preferably, the coordinate sending module 15 is configured to send, by using wireless, coordinates of the indicated position on the display screen at a current time to the display device, so that the display device is located on the display screen. The indication position is displayed for display processing.
需要说明的是,本发明实施例提供的一种操作装置用于执行上述第一实施例的位置指示方法的所有方法步骤,两者的工作原理和有益效果一一对应,因而不再赘述。It should be noted that the operation device provided by the embodiment of the present invention is used to perform all the method steps of the position indication method of the first embodiment, and the working principle and the beneficial effects of the two are corresponding to each other, and thus are not described again.
请参阅图4,其是本发明第三实施例提供的一种位置指示方法的流程示意图,包括:Referring to FIG. 4, it is a schematic flowchart of a location indication method according to a third embodiment of the present invention, which includes:
S31,显示装置获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;S31. The display device acquires an imaging screen sent by the operating device. The imaging screen is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position; The display device is provided with a position identifier;
S32,显示装置在当前时刻的成像画面中对所述位置标识物进行识别;S32. The display device identifies the location identifier in an imaging screen at a current time.
S33,显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;S33, when the display device recognizes the location identifier in the imaging image of the current time, according to the coordinates of the location identifier in the imaging image of the current time, acquire the current location indication position on the display screen. coordinate;
S34,显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;S34. When the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device between the X time and the current time. Motion displacement, obtaining coordinates of the indicated position on the display screen at the current time; wherein, the X time refers to the time at which the position identifier can be recognized last time;
S35,显示装置根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。S35. The display device performs display processing on the indication position on the display screen according to coordinates of the indication position on the display screen at the current time.
其中,所述位置标识物为任意可以被操作装置能够识别的物体,在本实施例中,所述位置标识物为红外LED。The position identifier is any object that can be recognized by the operating device. In this embodiment, the position identifier is an infrared LED.
所述位置标识物可以设置在显示装置的任一位置,例如显示画面的边框或者显示画面上;优选地,所 述位置标识物设置在所述显示画面的中心点。The position identifier may be disposed at any position of the display device, such as a frame or a display screen of the display screen; preferably, the location The position marker is set at a center point of the display screen.
此外,为了符合用户的使用习惯,所述操作装置可以被加工为笔状。Further, in order to comply with the user's usage habits, the operating device can be processed into a pen shape.
在步骤S31中,操作装置具体是通过设置在操作装置本体上的摄像头来进行拍摄。摄像头可以设置在操作装置的前端或者侧端。操作装置优选通过无线将当前时刻的成像画面发送到所述显示装置。In step S31, the operation device specifically performs photographing by a camera provided on the main body of the operation device. The camera can be placed at the front or side of the operating device. The operating device preferably transmits the imaged picture of the current time to the display device by wireless.
在步骤S35中,所述显示装置对指示位置进行显示处理可以是显示光点或者光圈,在本实施例中不作限定。In the step S35, the display device may perform a display process on the indication position, which may be a display spot or an aperture, which is not limited in this embodiment.
优选地,所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the display device recognizes the location identifier in the imaging picture of the current time, according to the coordinates of the position identifier in the imaging picture at the current time, the current position indication position is obtained in the display. The coordinates on the screen, including:
所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The display device acquires the coordinates (x1, y1) of the position identifier in the imaging picture at the current time when the position identifier is recognized in the imaging picture at the current time;
所述显示装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
优选地,所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:Preferably, when the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at the X time and the current time The motion displacement between the two is obtained, and the coordinates of the indicated position on the display screen at the current time are obtained, including:
所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the display device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) in the imaging picture of the position identifier at time X and the operating device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
所述显示装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
需要说明的是,本发明第三实施例提供的位置指示方法与本发明第一实施例提供的位置指示方法的区别在于,本发明第一实施例由操作装置实施,而本发明第三实施例由显示装置实施,在算法流程上是基本相同的,两者所要解决的技术问题、工作原理以及所要达到的有益效果均是相同的,因而在本发明第三实施例中不再赘述。It should be noted that the position indication method provided by the third embodiment of the present invention is different from the position indication method provided by the first embodiment of the present invention in that the first embodiment of the present invention is implemented by an operation device, and the third embodiment of the present invention The implementation by the display device is basically the same in the algorithm flow, and the technical problems, the working principle, and the beneficial effects to be achieved are the same, and thus will not be further described in the third embodiment of the present invention.
为了执行上述第三实施例的一种位置指示方法,本发明第四实施例还提供了一种操作装置。如图5所示,其是本发明第四实施例提供的操作装置的结构框图,包括:In order to perform a position indication method of the third embodiment described above, the fourth embodiment of the present invention further provides an operation device. As shown in FIG. 5, it is a structural block diagram of an operating device according to a fourth embodiment of the present invention, including:
成像画面获取模块31,用于获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;An imaging screen acquiring module 31, configured to acquire an imaging screen sent by the operating device; the imaging screen is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position Wherein the display device is provided with a position identifier;
标识物识别模块32,用于在当前时刻的成像画面中对所述位置标识物进行识别;The identifier identifying module 32 is configured to identify the location identifier in an imaging screen at a current time;
第一坐标获取模块33,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;The first coordinate acquiring module 33 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
第二坐标获取模块34,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所 述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module 34, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X The displacement between the current moments, the current moment Describe the coordinates of the position on the display screen; wherein the X time refers to the time when the position identifier can be recognized last time;
显示处理模块35,用于根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。The display processing module 35 is configured to perform display processing on the indication position on the display screen according to the coordinates of the indicated position on the display screen at the current time.
优选地,所述第一坐标获取模块33包括:Preferably, the first coordinate acquisition module 33 includes:
拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。a first coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinate (x1, y1); wherein x2=x1·L2/L1, y2 = y1 · W2 / W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
优选地,所述第二坐标获取模块34包括:Preferably, the second coordinate acquisition module 34 includes:
坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
优选地,所述位置标识物为红外LED灯。Preferably, the position identifier is an infrared LED lamp.
需要说明的是,本发明第四实施例提供的一种显示装置用于执行上述第三实施例的位置指示方法的所有方法步骤,两者的工作原理和有益效果一一对应,因而不再赘述。It should be noted that the display device provided by the fourth embodiment of the present invention is configured to perform all the method steps of the position indication method of the third embodiment, and the working principle and the beneficial effects of the two are in one-to-one correspondence, and thus no further description is provided. .
请参阅图6,其是本发明第五实施例提供的一种位置指示方法的流程示意图,包括:FIG. 6 is a schematic flowchart of a location indication method according to a fifth embodiment of the present invention, including:
S51,获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;S51: acquiring an imaging screen; the imaging screen is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is disposed on the display device on;
S52,在当前时刻的成像画面对位置标识物进行识别;S52. Identify the location identifier on the imaging screen at the current time;
S53,在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;S53, when the location identifier is recognized in the imaging picture of the current time, acquire coordinates of the indication position on the display screen at the current time according to the coordinates of the position identifier in the imaging picture at the current time;
S54,在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;S54, when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device Obtaining a coordinate of the indicated position on the display screen at a current time; wherein the X time refers to a time at which the position identifier can be recognized last time;
S55,根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。S55. The indicated position is displayed on the display screen according to coordinates of the indication position on the display screen according to the current time.
需要说明的是,本发明第五实施例提供的位置指示方法与第一实施例以及第三实施例的区别在于,本发明第五实施例的每一步骤可以均由操作装置执行(相当于第一实施例),或者可以均由显示装置执行(相当于第三实施例),或者前面的一个或几个步骤由操作装置执行,后面的一个或几个步骤由显示装置执行。例如,S51~S53由操作装置执行,S54和S55由显示装置执行。因此三个实施例所要解决的技术问题、工作原理以及所要达到的有益效果均是相同的,因而在本发明第五实施例中不再赘述。It should be noted that the position indication method provided by the fifth embodiment of the present invention is different from the first embodiment and the third embodiment in that each step of the fifth embodiment of the present invention can be performed by the operation device (equivalent to the first An embodiment), or both may be performed by a display device (equivalent to the third embodiment), or one or more of the preceding steps are performed by the operating device, and one or more of the following steps are performed by the display device. For example, S51 to S53 are executed by the operating device, and S54 and S55 are executed by the display device. Therefore, the technical problems, the working principle, and the beneficial effects to be achieved by the three embodiments are the same, and thus will not be described again in the fifth embodiment of the present invention.
为了执行上述第五实施例的一种位置指示方法,本发明第六实施例还提供了一种位置指示装置。In order to perform a position indication method of the fifth embodiment described above, the sixth embodiment of the present invention further provides a position indication device.
请参阅图7,其是本发明第六实施例提供的一种位置指示装置的结构框图,其包括: FIG. 7 is a structural block diagram of a position indicating apparatus according to a sixth embodiment of the present invention, which includes:
成像画面获取模块51,用于获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;An imaging picture acquiring module 51, configured to acquire an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier Provided on the display device;
标识物识别模块52,用于在当前时刻的成像画面对位置标识物进行识别;The identifier identifying module 52 is configured to identify the location identifier on the imaging screen at the current time;
第一坐标获取模块53,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;The first coordinate acquiring module 53 is configured to: when the location identifier is recognized in the imaging image of the current time, obtain the current location indication position according to the coordinates of the location identifier in the imaging image of the current time Describe the coordinates on the display screen;
第二坐标获取模块54,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;The second coordinate acquiring module 54 is configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the operation device at time X a motion displacement between the current moments, obtaining coordinates of the indicated position on the display screen at the current time; wherein the X moment refers to a time at which the position identifier can be recognized last time;
显示控制模块55,用于根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。The display control module 55 is configured to control the indication position to be displayed on the display screen according to coordinates of the indication position on the display screen at the current time.
本发明第六实施例提供的位置指示装置用于执行第五实施例提供的位置指示方法。其中,所述位置指示装置中的所有模块可以均配置于操作装置中,或者均配置于显示装置中,或者部分模块配置于操作装置中,部分模块配置于显示装置中。例如,成像画面获取模块51、标识物识别模块52以及第一坐标获取模块53配置在操作装置中,而第二坐标获取模块54以及显示控制模块55则配置在显示装置中。The position indicating device provided by the sixth embodiment of the present invention is for performing the position indicating method provided by the fifth embodiment. All the modules in the position indicating device may be disposed in the operating device, or are disposed in the display device, or some modules are disposed in the operating device, and some modules are disposed in the display device. For example, the imaging screen acquisition module 51, the marker recognition module 52, and the first coordinate acquisition module 53 are disposed in the operation device, and the second coordinate acquisition module 54 and the display control module 55 are disposed in the display device.
相比于现有技术,本发明实施例的有益效果在于:本发明实施例提供了一种位置指示方法、操作装置、显示装置与位置指示装置,其中位置指示方法包括操作装置从非接触的位置上指示显示装置的显示画面上的任意位置,并对指示位置拍摄以得到成像画面;操作装置在当前时刻的成像画面中对所述位置标识物进行识别;操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;操作装置将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。本方法采用的是具有摄像功能的操作装置,而不是激光指示器,不会对人眼造成损伤或者危害,并且可以适用于任意的显示设备;同时,Compared with the prior art, an embodiment of the present invention provides a position indication method, an operation device, a display device, and a position indication device, wherein the position indication method includes the operation device from a non-contact position. Uppointing an arbitrary position on the display screen of the display device, and photographing the pointed position to obtain an imaged image; the operating device identifies the position marker in the imaged image at the current time; the operating device recognizes in the imaged image at the current time When the location identifier is obtained, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time; the operation device identifies the image in the current time When the location identifier is not available, according to the coordinates of the location identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device, the current time indication position is obtained. Describe the coordinates on the screen; the operating device sets the indicated position at the current time in the display Coordinates on the screen of the display device to transmit, to cause said display means on the display screen of a display process of the indication position. The method adopts an operation device with a camera function, instead of a laser pointer, which does not cause damage or harm to the human eye, and can be applied to any display device;
通过本方法,无论在当前时刻的成像画面上是否识别到位置标识物,都可以计算出指示位置在显示画面中的坐标,克服了现有技术中因为拍摄盲区导致无法正常指示的缺陷。With the method, the coordinates of the indication position in the display screen can be calculated regardless of whether the position marker is recognized on the imaging picture at the current time, and the defect that cannot be normally indicated due to the shooting blind spot in the prior art is overcome.
以上所揭露的仅为本发明一种较佳实施例而已,当然不能以此来限定本发明之权利范围,本领域普通技术人员可以理解实现上述实施例的全部或部分流程,并依本发明权利要求所作的等同变化,仍属于发明所涵盖的范围。The above disclosure is only a preferred embodiment of the present invention, and of course, the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the present invention. The equivalent changes required are still within the scope of the invention.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。 One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Claims (22)

  1. 一种位置指示方法,其特征在于,包括:A location indication method, comprising:
    操作装置从非接触的位置上指示显示装置的显示画面上的任意位置,并对指示位置拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;The operating device indicates an arbitrary position on the display screen of the display device from the non-contact position, and photographs the pointed position to obtain an image forming screen; wherein the display device is provided with a position identifier;
    操作装置在当前时刻的成像画面中对所述位置标识物进行识别;The operating device identifies the location identifier in an imaging screen at a current time;
    操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the operation device recognizes the position identifier in the imaging screen of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
    操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the operation device does not recognize the position identifier in the imaging picture at the current time, the coordinates of the position indicator in the imaging picture at time X and the motion displacement between the X time and the current time of the operation device Obtaining a coordinate of the indicated position on the display screen at a current time; wherein the X time refers to a time at which the position identifier can be recognized last time;
    操作装置将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。The operating device transmits coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  2. 如权利要求1所述的位置指示方法,其特征在于,A position indication method according to claim 1, wherein
    所述操作装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:When the operation device recognizes the position identifier in the imaging picture of the current time, the operation position of the position identifier on the current time is obtained according to the coordinates of the position identifier in the imaging picture at the current time. Coordinates, including:
    所述操作装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The operating device acquires coordinates (x1, y1) in the imaging picture of the current time position when the position identifier is recognized in the imaging picture at the current time;
    所述操作装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
  3. 如权利要求2所述的位置指示方法,其特征在于,所述操作装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:The position indicating method according to claim 2, wherein the operating device recognizes the position marker in the imaging picture at the current time, according to the position marker in the imaging picture at time X Coordinates and motion displacements between the X time and the current time of the operating device, and acquiring coordinates of the indicated position on the display screen at the current time, including:
    所述操作装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the operation device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) of the position identifier in the imaging picture at time X and the operation device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
    所述操作装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The operating device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
    其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
  4. 如权利要求1~3所述的位置指示方法,其特征在于,所述位置指示方法还包括:The position indication method according to any one of claims 1 to 3, wherein the position indication method further comprises:
    当所述操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,所述操作装置清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;When the operating device is restarted or the duration between the X time and the current time exceeds a preset duration threshold, the operating device clears the storage of the coordinates of the position identifier in the imaged image when it is last recognized. data;
    所述操作装置在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后 一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。The operating device does not recognize the location identifier in the imaging picture at the current moment, and cannot find the location identifier at the end Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time and prompting the user to adjust the position of the operating device until the operating device is again in the storage data of the coordinates in the imaging screen. The position marker is recognized in the imaged picture.
  5. 如权利要求1所述的位置指示方法,其特征在于,所述位置标识物为红外LED灯。The position indicating method according to claim 1, wherein said position identifier is an infrared LED lamp.
  6. 如权利要求1所述的位置指示方法,其特征在于,所述操作装置具体通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。The position indicating method according to claim 1, wherein the operating device transmits the coordinates of the indication position on the display screen at a current time to the display device by wirelessly, so that the display device Display processing is performed on the indication position on the display screen.
  7. 一种操作装置,其特征在于,包括:An operating device, comprising:
    拍摄模块,用于从非接触的位置上指示显示装置的显示画面的任意位置,并对指示位置进行拍摄以得到成像画面;其中,所述显示装置上设置有位置标识物;a photographing module, configured to instruct an arbitrary position of a display screen of the display device from a non-contact position, and photograph the indicated position to obtain an image forming screen; wherein the display device is provided with a position identifier;
    标识物识别模块,用于在当前时刻的成像画面中对所述位置标识物进行识别;a identifier identifying module, configured to identify the location identifier in an imaging picture at a current time;
    第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
    第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
    坐标发送模块,用于将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。And a coordinate sending module configured to send coordinates of the indication position on the display screen at the current time to the display device, so that the display device performs display processing on the indication position on the display screen.
  8. 如权利要求7所述的操作装置,其特征在于,所述第一坐标获取模块包括:The operating device according to claim 7, wherein the first coordinate acquisition module comprises:
    拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
    第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述成像画面的宽。a first coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinate (x1, y1); wherein x2=x1·L2/L1, y2 = y1 · W2 / W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the imaging picture.
  9. 如权利要求8所述的操作装置,其特征在于,所述第二坐标获取模块包括:The operating device according to claim 8, wherein the second coordinate acquisition module comprises:
    坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
    第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
    其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。 Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
  10. 如权利要求7~9所述的操作装置,其特征在于,所述操作装置还包括:The operating device according to any one of claims 7 to 9, wherein the operating device further comprises:
    坐标数据清除模块,用于在操作装置重启后或者X时刻与当前时刻之间的时长超过预设的时长阈值时,清除所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据;a coordinate data clearing module, configured to clear a coordinate of the position identifier in the imaged image when the position identifier is last recognized after the operating device is restarted or when the duration between the X time and the current time exceeds a preset duration threshold Storing data;
    第三坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物,且不能找到所述位置标识物在最后一次被识别到时在成像画面中的坐标的存储数据时,获取一个无效坐标作为当前时刻所述指示位置在所述显示画面上的坐标,并提示用户调整操作装置的位置直到所述操作装置再次在成像画面中识别到所述位置标识物。a third coordinate acquiring module, configured to not recognize the position identifier in the imaging picture at the current time, and cannot find the stored data of the coordinates of the position identifier in the imaging picture when the position identifier is last recognized Obtaining an invalid coordinate as the coordinate of the indicated position on the display screen at the current time, and prompting the user to adjust the position of the operating device until the operating device recognizes the position identifier again in the imaging screen.
  11. 如权利要求7所述的操作装置,其特征在于,所述位置标识物为红外LED灯。The operating device of claim 7 wherein said position indicator is an infrared LED lamp.
  12. 如权利要求7所述的操作装置,其特征在于,所述坐标发送模块具体用于通过无线将当前时刻所述指示位置在所述显示画面上的坐标发送到所述显示装置,以使所述显示装置在所述显示画面上对所述指示位置进行显示处理。The operating device according to claim 7, wherein the coordinate sending module is configured to send, by wireless, coordinates of the indicated position on the display screen at a current time to the display device, so that the The display device performs display processing on the indication position on the display screen.
  13. 一种位置指示方法,其特征在于,包括:A location indication method, comprising:
    显示装置获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;The display device acquires an imaging screen transmitted by the operation device; the imaging screen is obtained by the operation device when the operation device indicates an arbitrary position on the display screen of the display device from a non-contact position; wherein the display a position identifier is disposed on the device;
    显示装置在当前时刻的成像画面中对所述位置标识物进行识别;The display device identifies the location identifier in an imaging picture at a current time;
    显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the display device recognizes the location identifier in the imaging picture of the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
    显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the display device does not recognize the position identifier in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the motion displacement between the X time and the current time of the operating device Obtaining a coordinate of the indicated position on the display screen at a current time; wherein the X time refers to a time at which the position identifier can be recognized last time;
    显示装置根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。The display device performs display processing on the indication position on the display screen based on the coordinates of the indicated position on the display screen at the current time.
  14. 如权利要求13所述的位置指示方法,其特征在于,A position indication method according to claim 13, wherein
    所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:When the display device recognizes the location identifier in the imaging picture at the current time, according to the coordinates of the location identifier in the imaging picture at the current time, the display position of the current time is obtained on the display screen. Coordinates, including:
    所述显示装置在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);The display device acquires the coordinates (x1, y1) of the position identifier in the imaging picture at the current time when the position identifier is recognized in the imaging picture at the current time;
    所述显示装置根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。 The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1, y1); wherein x2=x1·L2/L1, y2=y1·W2 /W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
  15. 如权利要求14所述的位置指示方法,其特征在于,所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标,包括:The position indication method according to claim 14, wherein the display device does not recognize the position identifier in the imaging picture at the current time, according to the position indicator in the imaging picture at time X Coordinates and motion displacements between the X time and the current time of the operating device, and acquiring coordinates of the indicated position on the display screen at the current time, including:
    所述显示装置在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);When the display device does not recognize the position identifier in the imaging picture at the current time, acquire the coordinates (x1′, y1′) in the imaging picture of the position identifier at time X and the operating device is at the X The motion displacement between the moment and the current moment (Δx, Δy);
    所述显示装置根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);The display device calculates coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
    其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
  16. 如权利要求13所述的位置指示方法,其特征在于,所述位置标识物为红外LED灯。The position indicating method according to claim 13, wherein said position identifier is an infrared LED lamp.
  17. 一种显示装置,其特征在于,包括:A display device, comprising:
    成像画面获取模块,用于获取操作装置发送的成像画面;所述成像画面为所述操作装置在从非接触的位置上指示所述显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述显示装置上设置有位置标识物;An imaging picture acquiring module, configured to acquire an imaging picture sent by the operating device; the imaging picture is obtained by the operating device when the operating device indicates an arbitrary position on the display screen of the display device from a non-contact position; Wherein the display device is provided with a position identifier;
    标识物识别模块,用于在当前时刻的成像画面中对所述位置标识物进行识别;a identifier identifying module, configured to identify the location identifier in an imaging picture at a current time;
    第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
    第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
    显示处理模块,用于根据当前时刻所述指示位置在所述显示画面上的坐标,在所述显示画面上对所述指示位置进行显示处理。And a display processing module, configured to perform display processing on the indication position on the display screen according to coordinates of the indicated position on the display screen at the current time.
  18. 如权利要求17所述的显示装置,其特征在于,A display device according to claim 17, wherein
    所述第一坐标获取模块包括:The first coordinate acquisition module includes:
    拍摄坐标获取单元,用于在当前时刻的成像画面中识别到所述位置标识物时,获取所述位置标识物在当前时刻的成像画面中的坐标(x1,y1);a photographing coordinate acquiring unit, configured to acquire coordinates (x1, y1) of the position identifier in an imaging picture at a current moment when the position identifier is recognized in an imaging picture at a current time;
    第一坐标计算单元,用于根据坐标(x1,y1)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);其中,x2=x1·L2/L1,y2=y1·W2/W1;L1为所述成像画面的长,L2为所述显示画面的长,W1为所述成像画面的宽,W2为所述显示画面的宽。a first coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinate (x1, y1); wherein x2=x1·L2/L1, y2 = y1 · W2 / W1; L1 is the length of the imaging picture, L2 is the length of the display picture, W1 is the width of the imaging picture, and W2 is the width of the display picture.
  19. 如权利要求18所述的位置指示方法,其特征在于,A position indication method according to claim 18, wherein
    所述第二坐标获取模块,包括: The second coordinate acquisition module includes:
    坐标位移获取单元,用于在当前时刻的成像画面中识别不到所述位置标识物时,获取所述位置标识物在X时刻的成像画面中的坐标(x1’,y1’)以及所述操作装置在X时刻与当前时刻之间的运动位移(Δx,Δy);a coordinate displacement acquiring unit, configured to acquire coordinates (x1′, y1′) in the imaging image of the position identifier at time X and the operation when the position identifier is not recognized in the imaging picture at the current time The motion displacement (Δx, Δy) between the X moment and the current moment of the device;
    第二坐标计算单元,用于根据坐标(x1’,y1’)以及运动位移(Δx,Δy)计算出所述当前时刻所述指示位置在所述显示画面上的坐标(x2,y2);a second coordinate calculation unit, configured to calculate coordinates (x2, y2) of the indicated position on the display screen according to the coordinates (x1', y1') and the motion displacement (Δx, Δy);
    其中,x2=(x1’+Δx)·L2/L1,y2=(y1’+Δy)·W2/W1。Here, x2 = (x1' + Δx) · L2 / L1, y2 = (y1' + Δy) · W2 / W1.
  20. 如权利要求17所述的显示装置,其特征在于,所述位置标识物为红外LED灯。A display device according to claim 17, wherein said position marker is an infrared LED lamp.
  21. 一种位置指示方法,其特征在于,包括:A location indication method, comprising:
    获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;Acquiring an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is disposed on the display device;
    在当前时刻的成像画面对位置标识物进行识别;Identifying the location marker at the current imaging screen;
    在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;When the location identifier is recognized in the imaging picture at the current time, the coordinates of the indication position on the display screen at the current time are acquired according to the coordinates of the position identifier in the imaging picture at the current time;
    在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;When the position identifier is not recognized in the imaging picture at the current time, according to the coordinate of the position identifier in the imaging picture at time X and the motion displacement of the operating device between the X time and the current time, The current position indicates the coordinates of the position on the display screen; wherein the X time refers to the time when the position identifier can be recognized last time;
    根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。The indicated position is displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
  22. 一种位置指示装置,其特征在于,包括:A position indicating device, comprising:
    成像画面获取模块,用于获取成像画面;所述成像画面由操作装置在从非接触的位置上指示显示装置的显示画面上的任意位置时对指示位置拍摄得到;其中,所述位置标识物设置在所述显示装置上;An imaging picture acquiring module, configured to acquire an imaging picture; the imaging picture is obtained by the operating device when instructing an arbitrary position on the display screen of the display device from a non-contact position; wherein the position identifier is set On the display device;
    标识物识别模块,用于在当前时刻的成像画面对位置标识物进行识别;a identifier identifying module, configured to identify the location identifier at the current imaging screen;
    第一坐标获取模块,用于在当前时刻的成像画面中识别到所述位置标识物时,根据所述位置标识物在当前时刻的成像画面中的坐标,获取当前时刻所述指示位置在所述显示画面上的坐标;a first coordinate acquiring module, configured to: when the location identifier is recognized in the imaging picture at the current time, acquire the current time indication position according to coordinates of the position identifier in the imaging picture at the current time Display the coordinates on the screen;
    第二坐标获取模块,用于在当前时刻的成像画面中识别不到所述位置标识物时,根据所述位置标识物在X时刻的成像画面中的坐标以及所述操作装置在X时刻与当前时刻之间的运动位移,获取当前时刻所述指示位置在所述显示画面上的坐标;其中,X时刻是指最后一次能够识别到所述位置标识物的时刻;a second coordinate acquiring module, configured to: when the position identifier is not recognized in the imaging picture at the current time, according to the coordinates of the position identifier in the imaging picture at time X and the operation device at time X and current a motion displacement between the moments, obtaining coordinates of the indicated position on the display screen at the current moment; wherein the X moment refers to a time at which the position identifier can be recognized last time;
    显示控制模块,用于根据当前时刻所述指示位置在所述显示画面上的坐标控制所述指示位置在所述显示画面上显示。 And a display control module, configured to control the indication position to be displayed on the display screen according to coordinates of the indicated position on the display screen at the current time.
PCT/CN2017/104652 2017-05-17 2017-09-29 Position indicating method, operating apparatus, display apparatus, and position indicating apparatus WO2018209877A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710350306.3 2017-05-17
CN201710350306.3A CN107329592B (en) 2017-05-17 2017-05-17 Method for indicating position, operating device, display device and position indicator

Publications (1)

Publication Number Publication Date
WO2018209877A1 true WO2018209877A1 (en) 2018-11-22

Family

ID=60192807

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/104652 WO2018209877A1 (en) 2017-05-17 2017-09-29 Position indicating method, operating apparatus, display apparatus, and position indicating apparatus

Country Status (2)

Country Link
CN (1) CN107329592B (en)
WO (1) WO2018209877A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110316771A1 (en) * 2009-03-05 2011-12-29 Sharp Kabushiki Kaisha Display apparatus, television reception apparatus and pointing system
CN102622108A (en) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 Interactive projecting system and implementation method for same
CN103425409A (en) * 2013-07-30 2013-12-04 华为终端有限公司 Control method and device for projection display
CN103995592A (en) * 2014-05-21 2014-08-20 上海华勤通讯技术有限公司 Wearable equipment and terminal information interaction method and terminal
CN106095178A (en) * 2016-06-14 2016-11-09 广州视睿电子科技有限公司 Input equipment recognition methods and system, input instruction identification method and system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100532525B1 (en) * 2002-05-07 2005-11-30 이문기 3 dimensional pointing apparatus using camera
JP2004318823A (en) * 2003-03-28 2004-11-11 Seiko Epson Corp Information display system, information processing apparatus, pointing device and pointer mark displaying method in information display system
JP4404927B2 (en) * 2007-10-10 2010-01-27 シャープ株式会社 Display system and indication position detection method
JP4457144B2 (en) * 2007-12-11 2010-04-28 シャープ株式会社 Display system, liquid crystal display device
CN102231093B (en) * 2011-06-14 2013-07-31 伍斌 Screen locating control method and device
TWI484376B (en) * 2012-08-09 2015-05-11 Pixart Imaging Inc Interacting system and remote controller
CN103823617B (en) * 2012-11-19 2016-08-24 原相科技股份有限公司 Interaction systems and remote control unit
CN104731372B (en) * 2013-12-20 2018-02-23 深圳市巨烽显示科技有限公司 Cursor of mouse points to control method, apparatus and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110316771A1 (en) * 2009-03-05 2011-12-29 Sharp Kabushiki Kaisha Display apparatus, television reception apparatus and pointing system
CN102622108A (en) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 Interactive projecting system and implementation method for same
CN103425409A (en) * 2013-07-30 2013-12-04 华为终端有限公司 Control method and device for projection display
CN103995592A (en) * 2014-05-21 2014-08-20 上海华勤通讯技术有限公司 Wearable equipment and terminal information interaction method and terminal
CN106095178A (en) * 2016-06-14 2016-11-09 广州视睿电子科技有限公司 Input equipment recognition methods and system, input instruction identification method and system

Also Published As

Publication number Publication date
CN107329592A (en) 2017-11-07
CN107329592B (en) 2019-10-25

Similar Documents

Publication Publication Date Title
US9480397B2 (en) Gaze tracking variations using visible lights or dots
US9560327B2 (en) Projection system and projection method
WO2015165209A1 (en) Wearable projection device, and focusing method and projecting method therefor
WO2022126956A1 (en) Laser projection device and prompt method therefor
WO2020259334A1 (en) Adjustment method, adjustment apparatus, terminal and computer-readable storage medium
TWI629617B (en) Projection screen laser pointer detecting and locating system and the method for detecting and locating the same
JP2016031761A5 (en)
JP2017520026A (en) Method and apparatus for controlling projection of wearable device, wearable device
CN105912145A (en) Laser pen mouse system and image positioning method thereof
KR101523046B1 (en) Distance measurement apparatus of an image processing-based
JP2016015649A (en) Projector device, interactive system and interactive control method
WO2018209878A1 (en) Position indication method, operation device for position indication, and display system
WO2015131688A1 (en) Method and apparatus for automatic projector focusing, and projector
WO2018209877A1 (en) Position indicating method, operating apparatus, display apparatus, and position indicating apparatus
WO2018171363A1 (en) Position information determining method, projection device and computer storage medium
TWI737588B (en) System and method of capturing image
CN103888674A (en) Image acquisition device and method
JP2020008750A5 (en) Display device and image processing method
WO2018233099A1 (en) Mobile terminal displaying method, mobile terminal, and storage medium
TWI477880B (en) System and method for adjusting light of a projector
EP3139586A1 (en) Image shooting processing method and device
US11393366B2 (en) Projection calibrations
JP6586891B2 (en) Projector and projector control method
JP6620979B2 (en) Portable terminal, projection system, control method and program for projection system
US11868544B2 (en) Information processing device, information processing method, program, display system, display method, and electronic writing tool

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17910083

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 24.03.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17910083

Country of ref document: EP

Kind code of ref document: A1