CN112875588B - Forklift auxiliary operation method and electronic equipment - Google Patents

Forklift auxiliary operation method and electronic equipment Download PDF

Info

Publication number
CN112875588B
CN112875588B CN201911195706.7A CN201911195706A CN112875588B CN 112875588 B CN112875588 B CN 112875588B CN 201911195706 A CN201911195706 A CN 201911195706A CN 112875588 B CN112875588 B CN 112875588B
Authority
CN
China
Prior art keywords
forklift
boundary
forklift arm
arm
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911195706.7A
Other languages
Chinese (zh)
Other versions
CN112875588A (en
Inventor
张东珉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BMW Brilliance Automotive Ltd
Original Assignee
BMW Brilliance Automotive Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BMW Brilliance Automotive Ltd filed Critical BMW Brilliance Automotive Ltd
Priority to CN201911195706.7A priority Critical patent/CN112875588B/en
Publication of CN112875588A publication Critical patent/CN112875588A/en
Application granted granted Critical
Publication of CN112875588B publication Critical patent/CN112875588B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66FHOISTING, LIFTING, HAULING OR PUSHING, NOT OTHERWISE PROVIDED FOR, e.g. DEVICES WHICH APPLY A LIFTING OR PUSHING FORCE DIRECTLY TO THE SURFACE OF A LOAD
    • B66F9/00Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes
    • B66F9/06Devices for lifting or lowering bulky or heavy goods for loading or unloading purposes movable, with their loads, on wheels or the like, e.g. fork-lift trucks
    • B66F9/075Constructional features or details
    • B66F9/12Platforms; Forks; Other load supporting or gripping members
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/02Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems using reflection of acoustic waves
    • G01S15/06Systems determining the position data of a target
    • G01S15/08Systems for measuring distance only
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00Prospecting or detecting by optical means
    • G01V8/10Detecting, e.g. by using light barriers

Abstract

The disclosure relates to a forklift auxiliary operation method and an electronic device. A method of forklift assisted operation performed by an electronic device, comprising: receiving a measurement of an ultrasonic sensor mounted at a forklift arm end of a forklift and configured to measure a distance of the forklift arm end from an obstacle; and in the first mode, displaying the measurement result of the ultrasonic sensor. The method assists the operator in better positioning the forklift arm to avoid damaging the forklift arm and/or the forked object.

Description

Forklift auxiliary operation method and electronic equipment
Technical Field
The present disclosure relates to fork lift trucks, and more particularly, to fork lift trucks having an auxiliary operating system, auxiliary operating systems for fork lift trucks, and related methods of operation.
Background
When operating a forklift, it is difficult for an operator to accurately operate the forklift arm into a small insertion opening, such as a small gap, so that the forklift arm or an object to be forked is easily damaged due to inaccuracy in operation.
Disclosure of Invention
According to some embodiments of the present disclosure, there is provided a method of forklift assistance operation performed by an electronic device, comprising: receiving a measurement of an ultrasonic sensor mounted at a forklift arm end of a forklift and configured to measure a distance of the forklift arm end from an obstacle; and in the first mode, displaying the measurement result of the ultrasonic sensor.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: receiving a detection result of a photoelectric sensor installed at a forklift arm end of a forklift and configured to detect whether the forklift arm end is blocked by an obstacle; and in a second mode, displaying a safety margin exceeding prompt to assist an operator in determining a safe operation margin of the forklift arm based on the measurement result of the ultrasonic sensor and the detection result of the photoelectric sensor.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: receiving a first user input, and, in response to receiving the first user input: switching from the first mode to a second mode, wherein in the second mode a safety boundary interface element is displayed representing a safe operating range of the forklift arm, and in response to receiving the first user input, determining a distance measured upon receiving the user input as the reference distance.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: determining whether the measurement result of the ultrasonic sensor indicates a distance change from a reference distance; and determining whether the detection result of the photoelectric sensor indicates that the forklift arm is changed from being unobstructed to being obstructed.
According to some embodiments of the present disclosure, the safe operating range is defined by a first boundary, a second boundary, a third boundary, and a fourth boundary.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: displaying a first user operation prompt prompting an operator to move the forklift arm in a first direction to find a first boundary of a safe operation range while maintaining the reference distance between the forklift arm and the obstacle, wherein the forklift arm is initially positioned around an insertion opening in the obstacle and is close to a position of an edge of the insertion opening corresponding to the first boundary in the first direction; if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a first safety margin out prompt is output by changing the state of the first portion of the safety margin interface element to indicate that the forklift arm is beyond the first margin of the safe operating range.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: displaying a second user operation prompt, wherein the second user operation prompt prompts an operator to move the forklift arm in a second direction to search a second boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the second boundary is opposite to the first boundary, and the second direction is opposite to the first direction; if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a second safety margin out prompt is output by changing the state of the second portion of the safety margin interface element to indicate that the forklift arm is beyond the second margin of the safe operating range.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: outputting, via the display, a third user operation prompt prompting an operator to move the forklift arm in a third direction to find a third boundary of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle, wherein the forklift arm is positioned between the first boundary and the second boundary, the third direction being perpendicular to the first direction and the second direction; if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a third safety boundary out prompt is output by changing the state of a third portion of the safety boundary interface element to indicate that the forklift arm is beyond a third boundary of the safe operating range.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: displaying a fourth user operation prompt, the fourth user operation prompt prompting an operator to move the forklift arm in a fourth direction to search for a fourth boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the fourth boundary is opposite to the third boundary, and the fourth direction is opposite to the third direction; and if the measurement result of the ultrasonic sensor indicates the distance change and the detection result of the photoelectric sensor indicates that the forklift arm is changed from being blocked to being blocked, outputting a fourth safety boundary exceeding prompt by changing the state of a fourth part of the safety boundary interface element so as to indicate that the forklift arm exceeds a fourth boundary of the safety operation range.
According to some embodiments of the present disclosure, the method of assisting operation of a forklift further comprises: receiving a second user input; switching from the second mode to a third mode in response to receiving the second user input; in the third mode, when the forklift arm is operated in any of the first to fourth directions, if the distance indicated by the measurement result of the ultrasonic sensor changes and the detection result of the photoelectric sensor indicates that the forklift arm is changed from being occluded to being occluded from being occluded, a fifth safety margin exceeding notice is output by changing the state of a portion of the safety margin interface element corresponding to the direction.
According to some embodiments of the disclosure, the first direction is from bottom to top.
According to some embodiments of the present disclosure, the change in state of the portion of the safety margin interface element includes a change in color or shape of the portion.
According to some embodiments of the present disclosure, the step of determining whether the measurement result of the ultrasonic sensor indicates a distance change from the reference distance further comprises: when the measured distance produces a distance difference relative to the reference distance that exceeds a predetermined percentage of the reference distance, it is determined that the measurement of the ultrasonic sensor indicates a change in distance relative to the reference distance.
According to some embodiments of the present disclosure, there is provided an electronic device including: a memory having computer program instructions stored thereon; a display; and a processor coupled to the memory and the display, wherein the processor, when executing the computer program instructions stored on the memory, causes the electronic device to perform the forklift assist operation method as described above.
According to some embodiments of the present disclosure, there is provided a computer program storage medium having computer program instructions stored thereon, which when executed by a processor of an electronic device, cause the electronic device to perform the method of forklift assisted operation as described above.
According to some embodiments of the present disclosure, there is provided a forklift auxiliary operating device including means for performing the operations of the forklift auxiliary operating method as described above.
Drawings
Fig. 1A is a schematic diagram of a forklift with an auxiliary operating system according to an embodiment of the present disclosure.
Fig. 1B shows a schematic view of a forklift arm with an ultrasonic sensor mounted thereto according to an embodiment of the disclosure.
Fig. 2A is a schematic view of a forklift arm for mounting an ultrasonic sensor in accordance with an embodiment of the disclosure.
Fig. 2B is another schematic view of a forklift arm for mounting an ultrasonic sensor in accordance with an embodiment of the disclosure.
Fig. 2C is a schematic view of a forklift arm with an ultrasonic sensor mounted thereto according to an embodiment of the disclosure.
Fig. 3 shows a schematic block diagram of an auxiliary operating system for a forklift according to an embodiment of the present disclosure.
FIG. 4 shows a schematic diagram of a user interface displaying distances measured by an ultrasonic sensor, according to an embodiment of the present disclosure.
Fig. 5 shows a schematic diagram illustrating a forklift arm with an ultrasonic sensor and a photosensor mounted thereto according to an embodiment of the present disclosure.
Fig. 6 is a schematic block diagram of an auxiliary operating system 600 for a forklift according to an embodiment of the present disclosure.
7A-7F illustrate schematic diagrams of a user interface of a secondary operating system according to embodiments of the present disclosure.
8A-8C illustrate schematic diagrams of a user interface of a secondary operating system in a setup mode according to embodiments of the present disclosure.
Fig. 9 shows a flow chart of a method of forklift assisted operation performed by an electronic device, in accordance with an embodiment of the present disclosure.
Fig. 10 shows a flow diagram of sub-steps involved in a step in a method of forklift assisted operation performed by an electronic device, in accordance with an embodiment of the present disclosure.
FIG. 11 is a schematic diagram illustrating a general hardware environment in which an electronic device according to embodiments of the disclosure may be implemented.
Detailed Description
The following description is presented to enable any person skilled in the art to make and use the embodiments, and is provided in the context of a particular application and its requirements. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the described embodiments. Thus, the described embodiments are not limited to the embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein.
The present disclosure relates to an auxiliary operating system for a forklift, which includes an ultrasonic sensor installed at a distal end of a forklift arm to measure a distance from the distal end of the forklift arm to an obstacle and a display installed in an operating compartment. The display can display the distance between the tail end of the forklift arm and the obstacle measured by the ultrasonic sensor.
The auxiliary operating system can further comprise a photoelectric sensor which is arranged at the tail end of the forklift arm of the forklift and used for detecting whether the tail end of the forklift arm is shielded by an obstacle. When the operator operates the forklift to enter a small gap which is not easy to operate, the forklift arm can be firstly operated to enter the periphery of the small gap and be at a proper distance from the forked object/obstacle by means of the distance between the tail end of the forklift arm and the obstacle displayed by the display. According to a user operation prompt displayed on a user interface of the auxiliary operation system, an operator operates the forklift arm to move up and down and left and right, when the operator operates, the auxiliary operation system measures the distance between the tail end of the forklift arm and an obstacle and whether the tail end of the forklift arm is shielded by the obstacle in real time through the ultrasonic sensor and the photoelectric sensor, and outputs a safety boundary exceeding prompt based on a measurement result of the ultrasonic sensor and a detection result of the photoelectric sensor so as to help the operator to determine a safety operation boundary of the forklift arm, so that the operator is helped to perform accurate positioning. Thereafter, the secondary operating system may also provide a secondary mode to help the operator avoid exceeding safe operating boundaries when performing subsequent operations.
Fig. 1A is a schematic diagram of a fork lift truck 100 having an auxiliary operating system in accordance with an embodiment of the present disclosure.
As shown in fig. 1A, the forklift 100 includes an operator cabin 102 and a forklift arm 104. The forklift 100 also includes an auxiliary operating system including an ultrasonic sensor 106 mounted at the end of the forklift arm 104 and a display 108 mounted within the operator's compartment 102. The ultrasonic sensor 106 may measure the distance of the end of the forklift arm 104 from an obstacle (e.g., a forked object), and the display 108 may display the distance measured by the ultrasonic sensor 106.
The operator can better operate the forklift arm to work according to the distance between the tail end of the forklift arm 104 and the obstacle displayed in real time by the display, and the risk of damaging the forked object is reduced.
The ultrasonic sensor 106 may be any suitable ultrasonic sensor that can be used to measure distance. For example, the ultrasonic sensors 106 may be ultrasonic sensors of different diameters (e.g., 10mm, 12mm, 14mm, 16mm, 18mm, etc.). For example, the ultrasonic sensor 106 may be open or closed.
The forklift arms may be one or more, eachOne or more ultrasonic sensors may be mounted on each of the forklift arms. In the present embodiment, for convenience of description, a forklift has two forklift arms side by side on the left and right, and one ultrasonic sensor is mounted on each forklift arm. FIG. 1B shows an ultrasonic sensor 106 1 And 106 2 Schematic diagrams installed on the left and right forklift arms of a forklift.
In some embodiments, the display 108 may be a display integrated within the forklift. In other embodiments, the display 108 may be a display mounted to an appropriate location within the truck operator compartment.
The display 108 and the ultrasonic sensor 106 may be connected by wire or wirelessly. One or more of the display 108 and the ultrasonic sensor 106 may include an associated signal processing unit (not shown) or be associated with a separate signal processing unit. The signal processing unit processes, for example, an output signal of the ultrasonic sensor 106 into a display signal displayed by the display 108. The signal processing unit may also be an integrated processing unit in the forklift. The signal processing unit may be a device having data processing capability, such as a processor.
Fig. 2A is a schematic view of a forklift arm for mounting an ultrasonic sensor in accordance with an embodiment of the disclosure. Fig. 2A illustrates one of the forklift arms 104. As shown in fig. 2, a cavity 202 is provided inside the end of the forklift arm 104 for housing/mounting the ultrasonic sensor.
The cavity 202 may be closable, i.e. in a closed state when the installation is completed. This protects the intracavity ultrasound sensor from being damaged.
The emitting face of the ultrasonic sensor is mounted as close as possible to the end face of the distal end of the forklift arm 104 so that the measured distance reflects as accurately as possible the distance between the distal end of the forklift arm and the obstacle.
Fig. 2B is another schematic view of a forklift arm for mounting an ultrasonic sensor in accordance with an embodiment of the disclosure.
As shown in fig. 2B, the cavity 202 may not be closed, but rather has an opening 201 at the face at the end of the forklift arm 104. This makes the structure simple and the ultrasonic sensor is easy to install and maintain.
In some embodiments, the cavity 202 is large enough so that the ultrasonic sensor does not extend beyond the opening 201 to avoid damage.
Those skilled in the art will appreciate that the ultrasonic sensor may be mounted/secured within the cavity 202 in various ways, such as via adhesive, screws, snaps, and the like. And will not be described in detail herein.
Although fig. 2A and 2B illustrate the ultrasonic sensor mounted within a cavity inside the distal end of the forklift arm, the ultrasonic sensor 106 may be mounted elsewhere on the distal end of the forklift arm 104, such as at the bottom of the distal end of the forklift arm, as shown in fig. 2C. For example, the ultrasonic sensor 106 may be mounted to the bottom of the end of the forklift arm via various means such as adhesive, screws, snaps, and the like.
In some embodiments, the ultrasonic sensor and the photoelectric sensor are disposed as close together as possible.
Fig. 3 shows a schematic block diagram of an auxiliary operating system 300 for a forklift according to an embodiment of the present disclosure.
As shown in FIG. 3, the secondary operating system 300 includes an ultrasonic sensor 306, a display 308, and one or more processing units 320. The ultrasonic sensor 306, the display 308, and the one or more processing units 320 are similar to the ultrasonic sensor 106, the display 108, and the processing units described above with reference to fig. 1 and will not be described again.
FIG. 4 shows a display interface schematic diagram of a display displaying distances measured by an ultrasonic sensor, according to an embodiment of the present disclosure.
As described above, in the present disclosure, a forklift is described as an example in which two forklift arms are arranged side by side, and it is assumed that one ultrasonic sensor is mounted at the end of each forklift arm.
As shown in fig. 4, the display may simultaneously display the distances from the obstacle measured by the ultrasonic sensors respectively mounted on the left and right forklift arms. The different distances are presented, for example, in long strips of corresponding length, so that the operator can visually observe the measurement results.
In some embodiments, the secondary operating system for a forklift may be provided with an ultrasonic sensor in addition to the end of the forklift arm, and may also be provided with an electro-optical sensor. Fig. 5 is a schematic diagram showing the ultrasonic sensor 106 and the photoelectric sensor 109 simultaneously provided on the left and right arms of the forklift.
The photosensor 109 may be a diffuse reflection type photosensor. In some embodiments, the photosensor 109 can also be a polarization-reflective photosensor. The photosensor 109 can be any type of photosensor capable of performing the measurement functions of the present disclosure.
Similar to the ultrasonic sensor 106, the photoelectric sensor 109 may also be mounted within a cavity formed within the interior of the end of the forklift arm. The photoelectric sensor 109 may be mounted in the same cavity as the ultrasonic sensor 106, or a separate cavity may be formed in the end of the forklift arm for mounting the photoelectric sensor. It should be noted that the cavity in which the photosensor is installed needs to be left with an opening corresponding to the photosensor for the photosensor to emit and receive optical signals.
Fig. 6 is a schematic block diagram of an auxiliary operating system 600 for a forklift according to an embodiment of the present disclosure.
As shown in FIG. 6, the secondary operating system 600 includes ultrasonic sensor(s) 606, a display 608, and one or more processing units 620. The ultrasonic sensor 606, the display 608, and the one or more processing units 620 are similar to the ultrasonic sensors (106, 306), the displays (108, 308), and the processing unit (320) described above with reference to fig. 1 and 3 and will not be described again. The secondary operating system 600 shown in fig. 6 also includes a photosensor 609.
In operation, the secondary operating system 600 initially operates in a first mode in which the processing unit 620 receives the distance of the forklift arm tip from the obstacle as measured by the ultrasonic sensor 606 and displays the measured distance via the display 608. The operator, while operating the forklift arm, initially positions the forklift arm to a suitable position around the insertion opening of the obstacle and at a suitable distance from the obstacle (e.g., 40mm below the insertion opening from the obstacle) with reference to the displayed distance.
After the forklift arm is initially positioned to the appropriate position and the appropriate distance, the secondary operating system enters a second mode, such as a positioning mode, and the operator can move the forklift arm to find each boundary of the safe operating range according to the user operation prompt of the secondary operating system and the safe boundary exceeding prompt, so that the forklift arm can be accurately positioned at the appropriate position within the safe operating range. In other words, with the aid of the auxiliary operating system, the operator can position the forklift arm accurately to a suitable position within a safe operating range, avoiding the forklift arm being damaged when it is inserted into the insertion opening.
An example method of operating the secondary operating system shown in FIG. 6 is described in detail below. 7A-7F show schematic diagrams of a user interface of a secondary operating system according to embodiments of the present disclosure.
The user interface may be an example of one or more graphical User Interfaces (UIs) used to implement various features, processes, or workflows. These GUIs can be presented on a variety of electronic devices including, but not limited to, laptop computers, desktop computers, computer terminals, television systems, tablet computers, e-book readers, and smart phones. One or more of these electronic devices may incorporate a touch-sensitive surface. The touch sensitive surface is capable of processing multiple simultaneous input points, including processing data regarding the pressure, degree, or location of each input point. This process can facilitate gestures using multiple fingers, including furling and swiping.
When the present disclosure refers to "selecting" a user interface element in a GUI, these terms are understood to include clicking or "hovering" over the user interface element using a mouse or other input device, or touching, tapping, or gesturing over the user interface element using one or more fingers or a stylus. The user interface elements may be virtual buttons, menus, selectors, switches, sliders, dismissors, knobs, thumbnails, links, icons, radial buttons, check boxes, and any other mechanism for receiving input from or providing feedback to a user.
For example, first, the operator may cause the secondary operating system to operate in a first mode, e.g., a display mode, by selecting "display mode" on the user interface, as shown in FIG. 7A.
In this mode, the distance of the forklift arm tip from the obstacle measured by the ultrasonic sensor 606 is displayed in the user interface. As shown in fig. 7A, the distance of the left and right forklift arms from the obstacle is displayed. In this mode, the operator can position the truck arm at a suitable distance, for example 40mm, from the obstacle with reference to the distance displayed. And the operator may for example position the forklift arm at a certain position around the insertion opening of the obstacle, for example below the lower edge of the insertion opening of the obstacle.
At this point, the operator may select "locate mode" via the user interface, and the secondary operating system switches from the display mode to a second mode, such as locate mode. In response to this selection action by the operator, the distance of the end of the forklift arm from the obstacle measured at this time, i.e. the distance displayed in the user interface at this time, is saved and used as a reference distance.
In the second mode, the positioning mode, the user interface displays a safety boundary interface element 701 for representing a safe operating range of the forklift arm. The safe operating range may be defined by, for example, a first boundary, a second boundary, a third boundary, and a fourth boundary. The security boundary interface element 701 is, for example, a rectangle, as shown in fig. 7B. The rectangle includes four edges corresponding to a first boundary, a second boundary, a third boundary, and a fourth boundary of the safe operating range, respectively. It is assumed here that the first boundary corresponds to the upper side of the rectangle, the second boundary corresponds to the lower side of the rectangle, the third boundary corresponds to the left side of the rectangle, and the fourth boundary corresponds to the right side of the rectangle.
For convenience of description, hereinafter, it is assumed that the operator has previously positioned the forklift arm at a position directly below the lower edge of the insertion opening in the obstacle, using the distance of the forklift arm from the obstacle displayed via the user interface by the auxiliary operating system in the first mode.
In the second mode, the user interface displays a first user operation prompt 702 that prompts the operator to move the forklift arm in a first direction (e.g., bottom-up) to find a first boundary (e.g., upper boundary) of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle. For example, as shown at 702 in fig. 7B, the first user operation prompt may be "please keep the distance between the forklift arm and the obstacle constant while operating the forklift arm to move upward".
When the operator operates the forklift arm to move from bottom to top in accordance with the first user operation prompt 702, the ultrasonic sensor 606 continuously measures the distance between the forklift arm and the obstacle, and the photoelectric sensor 609 continuously detects whether the forklift arm is occluded (for example, if the forklift arm is aligned with the insertion opening, the detection result is not occluded, and if the forklift arm is aligned with other portions of the obstacle, the detection result is occluded). In some embodiments, the measurement by the ultrasonic sensor 606 and the detection by the photoelectric sensor 609 are performed simultaneously, and the measurement result and the detection result are transmitted to the processing unit 620 in real time.
The processing unit 620 receives the measurement result of the ultrasonic sensor 606 and determines whether the measurement result has a distance change from the reference distance. For example, if the real-time measurement is a predetermined percentage (e.g., greater than 5%) of the reference distance, it may be determined that the measurement of the ultrasonic sensor indicates that a distance change has occurred with respect to the reference distance.
The processing unit 620 also receives the detection result of the photosensor 609, and determines whether it indicates that the forklift arm is changed from being unobstructed to being obstructed based on the detection result. For example, a jump from 0 to 1 occurs in the detection result, and it can be determined that the forklift arm is changed from being unobstructed to being obstructed.
If the measurement of the ultrasonic sensor 606 indicates a change in distance and the detection of the photoelectric sensor 609 indicates that the forklift arm is changing from unobstructed to obstructed, a first safety margin out prompt is output by changing the state of a first portion (e.g., the upper side) of the safety margin interface element 701 to indicate that the forklift arm is beyond the first margin of the safe operating range.
Changing the state of the upper edge of the safety margin interface element 701 may be to represent the upper edge of the safety margin interface element 701 in a different color or shape than the other edges to indicate to the operator the upper edge of the insertion opening for the obstacle that is now being sought. For example, here, assuming that each side of the original rectangle is a solid line, outputting the first safety margin excess hint means that the upper side is changed from the solid line to a broken line. In some embodiments, if the edges of the original rectangle are linear, outputting the first safety margin exceeding indication means that the upper edge is changed from the linear shape to the broken line shape. In some embodiments, the edges of the original rectangle may be blue, and outputting the first safety margin exceeding hint means that the upper edge is changed from blue to red.
The operator may click on "locate confirm" when seeing the first safety margin beyond the prompt.
Next, the user interface outputs a second user operation prompt 703 that prompts the operator to move the forklift arm in a second direction (e.g., from top to bottom) to find a second boundary (e.g., a lower boundary) of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle. For example, as shown at 703 in fig. 7C, the second user operation prompt may be "please keep the distance between the forklift arm and the obstacle constant while operating the forklift arm to move downward".
When the operator operates the forklift arm to move from top to bottom in accordance with the second user operation prompt 703, the ultrasonic sensor 606 continuously measures the distance between the forklift arm and the obstacle, and the photoelectric sensor 609 continuously detects whether the forklift arm is occluded. If the measurement of the ultrasonic sensor 606 indicates a change in distance and the detection of the photoelectric sensor 609 indicates that the forklift arm is changing from unobstructed to obstructed, a second safety margin out prompt is output by changing the state of a second portion (e.g., the lower edge) of the safety margin interface element to indicate that the forklift arm is beyond a second margin of the safe operating range. Similarly, the lower edge of the security boundary interface element 701 changes from a solid line to a dashed line.
At this point, the operator may operate the forklift arm to position it between the first and second boundaries based on the first and second safety boundary out-of-limits prompts.
The operator may click on "locate confirm" when seeing the second safety margin beyond the prompt.
The user interface then outputs a third user operation prompt 705 that prompts the operator to move the forklift arm in a third direction (e.g., from right to left) to find a third boundary (e.g., a left boundary) of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle. For example, as shown at 705 in fig. 7D, the second user operation prompt may be "please keep the distance between the forklift arm and the obstacle constant while operating the forklift arm to move left".
When the operator operates the forklift arm to move from right to left in accordance with the third user operation prompt 705, the ultrasonic sensor 606 continuously measures the distance between the forklift arm and the obstacle, and the photoelectric sensor 609 continuously detects whether the forklift arm is occluded. If the measurement of the ultrasonic sensor 606 indicates a change in distance and the detection of the photoelectric sensor 609 indicates that the truck arm is changing from unobstructed to obstructed, a third safety margin out prompt is output by changing the state of a third portion (e.g., left) of the safety margin interface element 701 to indicate that the truck arm is beyond the third margin of the safe operating range.
Similarly, the left side of the safety boundary interface element 701 changes from a solid line to a dashed line.
The operator may click on "locate confirm" when seeing the third safety margin beyond the prompt.
Next, the user interface outputs a fourth user operation prompt 707 that prompts the operator to move the forklift arm in a fourth direction (e.g., from left to right) to find a fourth boundary (e.g., a right boundary) of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle. For example, as indicated at 707 in fig. 7D, the second user operation prompt may be "please keep the distance between the forklift arm and the obstacle constant while operating the forklift arm to move to the right".
When the operator operates the forklift arm to move from right to left in accordance with the fourth user operation cue 705, the ultrasonic sensor 606 continuously measures the distance between the forklift arm and the obstacle, and the photoelectric sensor 609 continuously detects whether the forklift arm is occluded. If the measurement of the ultrasonic sensor 606 indicates a change in distance and the detection of the photoelectric sensor 609 indicates that the forklift arm is changing from unobstructed to obstructed, a fourth safety margin out prompt is output by changing the state of a fourth portion (e.g., the right side) of the safety margin interface element 701 to indicate that the forklift arm is beyond the fourth margin of the safe operating range. Similarly, the right side of the safety boundary interface element 701 changes from a solid line to a dashed line.
At this point, the operator may operate the forklift arm to position it in the proper location between the third and fourth boundaries based on the third and fourth safety boundary out cues. Thus, the operator can complete the accurate positioning of the forklift arm, so that the forklift arm can be positioned to the center of the insertion opening.
The secondary operating system 600 may also operate in a third mode, a secondary mode, for example, as shown in FIG. 7F. Assuming that the operator continues to operate the forklift arm after the operator has completed positioning of the forklift arm through the first mode and the second mode, when the forklift arm is operated in any of the first to fourth directions, if the distance indicated by the measurement result of the ultrasonic sensor changes and the detection result of the photoelectric sensor indicates that the forklift arm changes from being occluded to being occluded, a fifth safety margin exceeding notice is output by changing the state of the safety margin interface element 701. The fifth safety margin out cue, for example, means that each edge of the safety margin interface element 701 changes from a solid line to a dashed line.
The secondary operating system 600 may also operate in a fourth mode, a setup mode. In this setting mode, the operator may set the granularity of the distance displayed by the user interface. For example, FIG. 8A shows a user interface displaying distances at a granularity of 5 mm. FIG. 8B shows a user interface displaying distances at a granularity of 10 mm. FIG. 8C illustrates a user interface displaying distances at a granularity of 15 mm.
It will be appreciated by those skilled in the art that although the security boundary interface element is represented here as a rectangle, the security boundary interface element may be any shape, such as a circle, an ellipse, etc. In addition, for convenience of description, the first boundary corresponds to the upper side of the rectangle, but it will be understood by those skilled in the art that the correspondence may be adjusted as needed, for example, in some embodiments, the first boundary may correspond to the left side of the rectangle, the second boundary may correspond to the right side of the rectangle, the third boundary may correspond to the upper side of the rectangle, and the fourth boundary may correspond to the lower side of the rectangle. Accordingly, the content of the user operation prompt may be adjusted, for example, assuming that the forklift arm is initially positioned to the left of the insertion opening, the first boundary may be set to correspond to the right of the rectangle, the forklift arm is operated to move from left to right, then the second boundary corresponding to the left is found from right to left, and then the forklift arm is moved up and down to find the third/fourth boundaries corresponding to the upper/lower edges. Eventually, the forklift arm can be positioned at the right position within the safe operation range.
Fig. 9 illustrates a flow chart of a method 900 of forklift assisted operation performed by an electronic device in accordance with an embodiment of the disclosure.
As shown, the method 900 includes a step 901 of receiving a measurement of an ultrasonic sensor mounted at a forklift arm end of a forklift and configured to measure a distance of the forklift arm end from an obstacle; and a step 902 of displaying a measurement result of the ultrasonic sensor in the first mode.
The method 900 further comprises a step 903 of receiving a first user input, and a step 904 of switching from the first mode to the second mode in response to receiving the first user input, determining a measured distance at which the user input is received as the reference distance. As described above, in the second mode, the safety boundary interface element for representing the safe operation range of the forklift arm is displayed.
The method 900 further includes a step 905 of receiving a detection result of a photoelectric sensor installed at a forklift arm end of the forklift and configured to detect whether the forklift arm end is blocked by an obstacle; and a step 906 of displaying a safety margin exceeding prompt to help an operator determine a safety operation margin of the forklift arm based on the measurement result of the ultrasonic sensor and the detection result of the photoelectric sensor in the second mode.
Fig. 10 shows a flow diagram of sub-steps involved in step 906 of a method 900 of forklift assisted operation performed by an electronic device, in accordance with an embodiment of the present disclosure.
Step 906 includes sub-steps 9061: displaying a first user operation prompt prompting an operator to move the forklift arm in a first direction to find a first boundary of a safe operation range while maintaining the reference distance between the forklift arm and the obstacle, wherein the forklift arm is initially positioned around an insertion opening in the obstacle and is close to a position of an edge of the insertion opening corresponding to the first boundary in the first direction; and
substep 9062: outputting a first safety margin exceeding prompt by changing the state of the first portion of the safety margin interface element to indicate that the forklift arm is beyond the first margin of the safe operating range if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed;
substep 9063: displaying a second user operation prompt, wherein the second user operation prompt prompts an operator to move the forklift arm in a second direction to search a second boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the second boundary is opposite to the first boundary, and the second direction is opposite to the first direction;
substep 9064: outputting a second safety margin out prompt by changing the state of the second portion of the safety margin interface element to indicate that the forklift arm is beyond a second margin of the safe operating range if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed;
substep 9065: outputting, via the display, a third user operation prompt prompting the operator to move the forklift arm in a third direction to find a third boundary of the safe operating range while maintaining the reference distance between the forklift arm and the obstacle, wherein the forklift arm is positioned between the first boundary and the second boundary, the third direction being perpendicular to the first direction and the second direction;
substep 9066: outputting a third safety margin exceeding prompt by changing the state of a third portion of the safety margin interface element to indicate that the forklift arm is beyond a third margin of the safe operating range if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed;
substep 9067: displaying a fourth user operation prompt, the fourth user operation prompt prompting an operator to move the forklift arm in a fourth direction to search for a fourth boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the fourth boundary is opposite to the third boundary, and the fourth direction is opposite to the third direction; and
substep 9068: and if the measurement result of the ultrasonic sensor indicates the distance change and the detection result of the photoelectric sensor indicates that the forklift arm is changed from being blocked to being blocked, outputting a fourth safety boundary exceeding prompt by changing the state of a fourth part of the safety boundary interface element so as to indicate that the forklift arm exceeds a fourth boundary of the safety operation range.
FIG. 11 is a schematic diagram illustrating a general hardware environment in which an electronic device 700 according to embodiments of the present disclosure may be implemented.
Referring now to fig. 11, a schematic diagram of an example of an electronic device 700 is shown. Electronic device 700 is only one example of a suitable electronic device and is not intended to suggest any limitation as to the scope of use or functionality of the embodiments described herein. In any event, electronic device 700 is capable of implementing and/or performing any of the functions set forth above.
In the electronic device 700, there is a computer system/server 7012 that is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with computer system/server 7012 include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computer systems, distributed cloud computing environments that include any of the above systems or devices, and the like.
Computer system/server 7012 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer system/server 7012 may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
As shown in fig. 11, the computer system/server 7012 in the electronic device 700 is shown in the form of a general purpose computing device. Components of computer system/server 7012 may include, but are not limited to: one or more processors or processing units 7016, a system memory 7028, and a bus 7018 that couples various system components including the system memory 7028 to the processing unit 7016.
The bus 7018 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, Peripheral Component Interconnect (PCI) bus, peripheral component interconnect express (PCIe), and Advanced Microcontroller Bus Architecture (AMBA).
Computer system/server 7012 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer system/server 7012 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 7028 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 7032. The computer system/server 7012 may also include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, a storage system 7034 may be provided for reading from and writing to non-removable, nonvolatile magnetic media (not shown, and commonly referred to as "hard drives"). Although not shown, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from and writing to a removable, non-volatile optical disk (such as a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each can be connected to the bus 7018 by one or more data media interfaces. As will be further depicted and described below, memory 7028 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the present disclosure.
By way of example, and not limitation, programs/utilities 7040, including a set of (at least one) program modules 7042, as well as an operating system, one or more application programs, other program modules, and program data, may be stored in memory 7028. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a network environment. Program modules 7042 generally perform the functions and/or methods in embodiments as described herein.
The computer system/server 7012 may also communicate with one or more external devices 7014 (such as a keyboard, pointing device, display 7024, etc.), one or more devices that enable a user to interact with the computer system/server 7012, and/or any device (e.g., network card, modem, etc.) that enables the computer system/server 7012 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 22. Also, the computer system/server 7012 may communicate with one or more networks, such as a Local Area Network (LAN), a general Wide Area Network (WAN), and/or a public network (e.g., the internet), via the network adapter 20. As depicted, the network adapter 20 communicates with the other components of the computer system/server 7012 via a bus 7018. It should be appreciated that although not shown, other hardware and/or software components may be used in conjunction with the computer system/server 7012. Examples include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data archive storage systems, and the like.
The present disclosure may be embodied as systems, methods, and/or computer program products. The computer program product may include computer-readable storage medium(s) having computer-readable program instructions thereon for causing a processor to perform aspects of the present disclosure.
The computer-readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device such as a punch card or an in-groove raised structure on which instructions are stored, and any suitable combination of the foregoing. A computer-readable storage medium as used herein is not to be interpreted as a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or an electrical signal transmitted through an electrical wire.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in the respective computing/processing device.
Computer-readable program instructions for carrying out operations of the present disclosure may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry, including, for example, programmable logic circuitry, Field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), may execute the computer-readable program instructions in order to perform aspects of the present disclosure by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry.
Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium having stored thereon the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a process for electronic device execution, such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will also be appreciated by those of skill in the art that various operations illustrated as sequential in the embodiments of the disclosure are not necessarily performed in the illustrated order. The order of operations may be adjusted as desired by those skilled in the art. One skilled in the art may also add more operations or omit some of them as desired.
The description of the various embodiments of the present disclosure has been presented for purposes of illustration but is not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques found in the marketplace, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims (14)

1. A method of forklift assisted operation performed by an electronic device, comprising:
receiving a measurement of an ultrasonic sensor mounted at a forklift arm end of a forklift and configured to measure a distance of the forklift arm end from an obstacle;
receiving a detection result of a photoelectric sensor installed at a forklift arm end of a forklift and configured to detect whether the forklift arm end is blocked by an obstacle;
in the first mode, the measurement result of the ultrasonic sensor is displayed;
receiving a first user input, an
In response to receiving the first user input:
switching from a first mode to a second mode, wherein in the second mode a safety boundary interface element is displayed for representing a safe operating range of the forklift arm, and
in response to receiving the first user input, determining a measured distance at which the user input is received as a reference distance;
in the second mode, a safety margin exceeding prompt is displayed based on the measurement result of the ultrasonic sensor and the detection result of the photoelectric sensor to assist the operator in determining the safety operation margin of the forklift arm.
2. The method of forklift-assisted operation performed by an electronic device according to claim 1, further comprising:
determining whether the measurement result of the ultrasonic sensor indicates a distance change from a reference distance; and is
It is determined whether the detection result of the photoelectric sensor indicates that the forklift arm is changed from being unobstructed to being obstructed.
3. The method of forklift assistance operation performed by an electronic device according to claim 2, wherein the safe operating range is defined by a first boundary, a second boundary, a third boundary, and a fourth boundary.
4. The method of forklift assisted operation performed by an electronic device according to claim 3, further comprising:
displaying a first user operation prompt prompting an operator to move the forklift arm in a first direction while maintaining the reference distance between the forklift arm and the obstacle to find a first boundary of a safe operation range, wherein the forklift arm is initially positioned around an insertion opening in the obstacle and is close to a position of an edge of the insertion opening corresponding to the first boundary in the first direction;
if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a first safety margin out prompt is output by changing the state of the first portion of the safety margin interface element to indicate that the forklift arm is beyond the first margin of the safe operating range.
5. The method of forklift-assisted operation performed by an electronic device according to claim 4, further comprising:
displaying a second user operation prompt, wherein the second user operation prompt prompts an operator to move the forklift arm in a second direction to search a second boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the second boundary is opposite to the first boundary, and the second direction is opposite to the first direction;
if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a second safety margin out prompt is output by changing the state of the second portion of the safety margin interface element to indicate that the forklift arm is beyond the second margin of the safe operating range.
6. The method of forklift assisted operation performed by an electronic device according to claim 5, further comprising:
displaying a third user operation prompt prompting an operator to move the forklift arm in a third direction to find a third boundary of the safe operation range while maintaining the reference distance between the forklift arm and the obstacle, wherein the forklift arm is positioned between the first boundary and the second boundary, and the third direction is perpendicular to the first direction and the second direction;
if the measurement of the ultrasonic sensor indicates a change in distance and the detection of the photoelectric sensor indicates that the forklift arm is changing from unobstructed to obstructed, a third safety margin out prompt is output by changing the state of a third portion of the safety margin interface element to indicate that the forklift arm is beyond a third margin of the safe operating range.
7. The method of forklift assisted operation performed by an electronic device of claim 6 further comprising:
displaying a fourth user operation prompt, the fourth user operation prompt prompting an operator to move the forklift arm in a fourth direction to search for a fourth boundary of the safe operation range while keeping the reference distance between the forklift arm and the obstacle, wherein the fourth boundary is opposite to the third boundary, and the fourth direction is opposite to the third direction;
and if the measurement result of the ultrasonic sensor indicates the distance change and the detection result of the photoelectric sensor indicates that the forklift arm is changed from being blocked to being blocked, outputting a fourth safety boundary exceeding prompt by changing the state of a fourth part of the safety boundary interface element so as to indicate that the forklift arm exceeds a fourth boundary of the safety operation range.
8. The method of forklift-assisted operation performed by an electronic device according to claim 7, further comprising:
receiving a second user input;
switching from the second mode to a third mode in response to receiving the second user input;
in the third mode, when the forklift arm is operated in any of the first to fourth directions, if the distance indicated by the measurement result of the ultrasonic sensor changes and the detection result of the photoelectric sensor indicates that the forklift arm changes from being occluded to being occluded, a fifth safety margin exceeding notice is output by changing the state of the safety margin interface element.
9. The method of forklift assistance operation performed by an electronic device according to any one of claims 4 to 8, wherein the first direction is from bottom to top.
10. The method of forklift assistance operation performed by an electronic device according to claim 1, wherein the change in state of the portion of the safety margin interface element includes a change in color or shape of the portion.
11. The method of forklift-assisted operation performed by an electronic device according to claim 1, wherein the step of determining whether the measurement result of the ultrasonic sensor indicates a distance change from a reference distance further comprises:
when the measured distance produces a distance difference relative to the reference distance that exceeds a predetermined percentage of the reference distance, it is determined that the measurement of the ultrasonic sensor indicates that a distance change relative to the reference distance has occurred.
12. An electronic device, comprising:
a memory having computer program instructions stored thereon;
a display; and
a processor coupled with the memory and the display, wherein the processor, when executing the computer program instructions stored on the memory, causes the electronic device to perform the forklift assistance method of any one of claims 1-11.
13. A computer program storage medium having computer program instructions stored thereon, which when executed by a processor of an electronic device, cause the electronic device to perform the forklift truck auxiliary operation method of any one of claims 1-11.
14. A forklift truck assist operation device comprising means for performing the operation of the forklift truck assist operation method according to any one of claims 1 to 11.
CN201911195706.7A 2019-11-29 2019-11-29 Forklift auxiliary operation method and electronic equipment Active CN112875588B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911195706.7A CN112875588B (en) 2019-11-29 2019-11-29 Forklift auxiliary operation method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911195706.7A CN112875588B (en) 2019-11-29 2019-11-29 Forklift auxiliary operation method and electronic equipment

Publications (2)

Publication Number Publication Date
CN112875588A CN112875588A (en) 2021-06-01
CN112875588B true CN112875588B (en) 2022-08-30

Family

ID=76038272

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911195706.7A Active CN112875588B (en) 2019-11-29 2019-11-29 Forklift auxiliary operation method and electronic equipment

Country Status (1)

Country Link
CN (1) CN112875588B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113582088A (en) * 2021-07-29 2021-11-02 广州敏视数码科技有限公司 Control method and device for forklift forking operation, forklift and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1245888A (en) * 1998-08-07 2000-03-01 株式会社丰田自动织机制作所 Position detecting device for hydraulic cylinder
CN103208042A (en) * 2012-01-17 2013-07-17 株式会社日立工业设备技术 Fork truck and running management system of fork truck

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103318812B (en) * 2013-07-09 2015-04-01 京东方科技集团股份有限公司 Pallet fork assembly for stacker, stacker and method for carrying cartridges
CN103803454B (en) * 2014-01-20 2016-08-17 湖南三一港口设备有限公司 Fork tool box-entering positioning system and telescopic-arm forklift
CN103935365B (en) * 2014-05-14 2016-04-13 袁培江 A kind of novel material carrying automatic guide vehicle intelligent anti-collision system
CN105621319B (en) * 2016-03-02 2018-10-16 上海诺力智能科技有限公司 A kind of safe barrier-avoiding method of pallet fork
CN205973643U (en) * 2016-08-31 2017-02-22 天津峰景光电科技有限公司 Supplementary positioning system that makes a video recording of forklift fork
CN108237997B (en) * 2016-12-27 2020-08-07 比亚迪股份有限公司 Automatic guide carrying forklift and protection system and protection method thereof
CN206735725U (en) * 2017-03-31 2017-12-12 深圳怡丰机器人科技有限公司 Fork truck rear anti-crash component and AGV fork trucks
CN208700510U (en) * 2018-06-01 2019-04-05 上海诺力智能科技有限公司 AGV fork truck automatic access goods control system
CN109502513A (en) * 2018-12-26 2019-03-22 苏州罗伯特木牛流马物流技术有限公司 Fork-lift type AGV pallet fork is apart from automatic regulating apparatus and method
CN110028017B (en) * 2019-04-08 2021-04-20 杭州国辰牵星科技有限公司 Passive visual navigation unmanned forklift system for explosion-proof warehouse and navigation method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1245888A (en) * 1998-08-07 2000-03-01 株式会社丰田自动织机制作所 Position detecting device for hydraulic cylinder
CN103208042A (en) * 2012-01-17 2013-07-17 株式会社日立工业设备技术 Fork truck and running management system of fork truck

Also Published As

Publication number Publication date
CN112875588A (en) 2021-06-01

Similar Documents

Publication Publication Date Title
US8898590B2 (en) Information input device, on-screen arrangement method thereof, and computer-executable program
US20190361593A1 (en) Screen Capturing Method and Apparatus
EP2701052A2 (en) Portable device and guide information provision method thereof
WO2012055714A1 (en) Automated adjustment of input configuration
KR102086799B1 (en) Method for displaying for virtual keypad an electronic device thereof
US20170220222A1 (en) Moving an image displayed on a touchscreen of a device
US10990217B2 (en) Adaptive notification modifications for touchscreen interfaces
US9959039B2 (en) Touchscreen keyboard
US10168895B2 (en) Input control on a touch-sensitive surface
US20140015809A1 (en) Method, system and computer program product for operating a touchscreen
US8631317B2 (en) Manipulating display of document pages on a touchscreen computing device
CN109542323B (en) Interaction control method and device based on virtual scene, storage medium and electronic equipment
EP3605306A1 (en) Unlocking method and mobile terminal
CN112875588B (en) Forklift auxiliary operation method and electronic equipment
CN112875601B (en) Fork truck auxiliary operation system
CN211493853U (en) Forklift with auxiliary operating system
US9910580B2 (en) List display control method and device
CN211545839U (en) Forklift with auxiliary operating system
US20150160776A1 (en) Input device, input disabling method, input disabling program, and computer readable recording medium
US10599261B2 (en) User interface selection through intercept points
US10120555B2 (en) Cursor positioning on display screen
CN106325715B (en) Method and system for displaying picture and intelligent device
BR112017018840B1 (en) DESKTOP AND MOBILE TERMINAL ICON DISPLAY METHOD
JP2009187052A (en) Information processing method and information processor
CN112883754B (en) Auxiliary operation system of forklift

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant