CN116061169A - Script sequence processing method and device, electronic equipment and vehicle - Google Patents

Script sequence processing method and device, electronic equipment and vehicle Download PDF

Info

Publication number
CN116061169A
CN116061169A CN202210766469.0A CN202210766469A CN116061169A CN 116061169 A CN116061169 A CN 116061169A CN 202210766469 A CN202210766469 A CN 202210766469A CN 116061169 A CN116061169 A CN 116061169A
Authority
CN
China
Prior art keywords
script
vehicle
control
control script
mechanical arm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210766469.0A
Other languages
Chinese (zh)
Inventor
李谦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Express Jiangsu Technology Co Ltd
Original Assignee
China Express Jiangsu Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Express Jiangsu Technology Co Ltd filed Critical China Express Jiangsu Technology Co Ltd
Publication of CN116061169A publication Critical patent/CN116061169A/en
Priority to PCT/CN2023/104187 priority Critical patent/WO2024002297A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
    • B60R11/0229Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes
    • B60R11/0235Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof for displays, e.g. cathodic tubes of flat type, e.g. LCD
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00Arrangements for holding or mounting articles, not otherwise provided for
    • B60R2011/0042Arrangements for holding or mounting articles, not otherwise provided for characterised by mounting means
    • B60R2011/008Adjustable or movable supports
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Navigation (AREA)
  • Manipulator (AREA)
  • User Interface Of Digital Computer (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Toys (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

The embodiment of the application provides a script sequence processing method, a script sequence processing device, electronic equipment, vehicle-mounted display equipment and a vehicle, wherein the script sequence processing method comprises the following steps: in the process that a user edits a script sequence by using a control script set, determining a next selectable control script in the control script set aiming at a control script currently selected by the user, wherein the control script is a script for controlling a vehicle-mounted mechanical arm to execute a preset action, and the selectable control script is the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in a preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script; and determining the selectable control script as the next control script available for the user to select. The processing method of the script sequences can enable the vehicle-mounted mechanical arm to sequentially execute preset actions corresponding to the script sequences according to the edited script sequences.

Description

Script sequence processing method and device, electronic equipment and vehicle
The present application claims priority from the chinese patent office, application No. 202122647560. X, entitled "a screen adjustment mechanism and on-board center control screen" filed on 1/11/2021, the entire contents of which are incorporated herein by reference.
Technical Field
The application relates to the field of artificial intelligence, in particular to a script sequence processing method, a script sequence processing device, electronic equipment, vehicle-mounted display equipment and a vehicle.
Background
The vehicle-mounted mechanical arm has been widely used in fields of industrial manufacturing, medical rescue, aerospace, and the like as an automatic control device having a function of imitating a human arm and capable of completing various operations. The vehicle-mounted mechanical arm is arranged in the vehicle cabin so as to provide intelligent driving service for personnel on the vehicle, but the vehicle-mounted mechanical arm is applied to the application field of the vehicle-mounted mechanical arm which is related to a few people.
However, if the vehicle-mounted mechanical arm is to be installed in the vehicle cabin for providing intelligent driving service for the personnel on the vehicle, how to realize personalized control of the vehicle-mounted mechanical arm becomes a problem.
Disclosure of Invention
The embodiment of the application provides a script sequence processing method, a script sequence processing device, electronic equipment, a storage medium and a vehicle-mounted mechanical arm, so as to solve the problems of the related technology, and the technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a method for processing a script sequence, including:
in the process that a user edits a script sequence by using a control script set, aiming at a control script currently selected by the user, determining a next selectable control script in the control script set, wherein the control script is a script for controlling the vehicle-mounted mechanical arm to execute a preset action, and the selectable control script is a control script for controlling the vehicle-mounted mechanical arm to further execute a corresponding preset action in a preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script;
The control script which can be selected is determined as the control script which can be selected by the user.
In a second aspect, an embodiment of the present application provides a processing apparatus for a script sequence, including:
the selectable script determining unit is used for determining a next selectable control script in the control script set aiming at a control script currently selected by a user in the process of editing a script sequence by using the control script set, wherein the control script is used for controlling the vehicle-mounted mechanical arm to execute a preset action, and the selectable control script is used for controlling the vehicle-mounted mechanical arm to further execute the control script corresponding to the preset action in a preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script;
and the selectable script determining unit is used for determining the selectable control script as the next control script available for the user to select.
In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of processing the script sequences.
In a fourth aspect, an embodiment of the present application provides an in-vehicle display apparatus, including: the vehicle-mounted mechanical arm comprises a control unit, a vehicle-mounted mechanical arm and a vehicle-mounted screen;
the control unit is used for executing the processing method of the script sequences so as to determine a target script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence; or a processing device comprising the script sequence, wherein the control unit is used for determining a target script sequence by utilizing the processing device of the script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence;
the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action;
and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
In a fifth aspect, embodiments of the present application provide a vehicle, including: the vehicle-mounted mechanical arm comprises a control unit, a vehicle-mounted mechanical arm and a vehicle-mounted screen;
the control unit is used for executing the processing method of the script sequences so as to determine a target script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence; or a processing device comprising the script sequence, wherein the control unit is used for determining a target script sequence by utilizing the processing device of the script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence;
The vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action;
and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
The advantages or beneficial effects in the technical scheme at least comprise:
according to the processing method of the script sequence, in the process that the user edits the script sequence by using the control script set, each time when the user selects one control script, the control script which can be selected can be automatically determined to be the next control script which can be selected by the user.
Because the selectable control script is the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script. Therefore, under the condition that the selectable control script is determined to be the next control script which can be selected by the user, the next control script which is selected by the user after the currently selected control script can be ensured to be the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script.
The processing method for the script sequences can enable the vehicle-mounted mechanical arm to be in the reachable space in the process of sequentially executing the preset actions corresponding to each script sequence according to the edited script sequences. Therefore, personalized control of the vehicle-mounted mechanical arm can be achieved through the edited script sequences, and the vehicle-mounted mechanical arm can sequentially execute preset actions corresponding to the script sequences according to the edited script sequences.
The foregoing summary is for the purpose of the specification only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features of the present application will become apparent by reference to the drawings and the following detailed description.
Drawings
In the drawings, the same reference numerals refer to the same or similar parts or elements throughout the several views unless otherwise specified. The figures are not necessarily drawn to scale. It is appreciated that these drawings depict only some embodiments according to the disclosure and are not therefore to be considered limiting of its scope.
FIG. 1 is a flow chart of a method of processing a script sequence provided in an embodiment of the present application;
FIG. 2 is a flow chart of a method of determining that a control script may be selected provided in an embodiment of the present application;
FIG. 3 is a schematic illustration of one type of accessible space provided in an embodiment of the present application;
fig. 4 is a schematic diagram of a coordinate system of an in-vehicle mechanical arm provided in an embodiment of the present application;
FIG. 5 is a flow chart of another method of editing a script sequence provided in an embodiment of the present application;
FIG. 6 is a schematic diagram of a processing device for script sequences provided in an embodiment of the present application;
FIG. 7 is a block diagram of an electronic device for implementing a method of processing script sequences provided by embodiments of the present application;
fig. 8 shows an overall schematic diagram of an in-vehicle mechanical arm of an embodiment of the present application;
fig. 9 shows a schematic view of a guide rail of the vehicle-mounted mechanical arm according to the embodiment of the application;
fig. 10 shows a schematic view of a rotation mechanism of the vehicle-mounted mechanical arm according to the embodiment of the application;
FIG. 11 is a schematic view of another embodiment of an installation of a linear motion unit of an in-vehicle robotic arm of an embodiment of the present application;
fig. 12 shows a schematic diagram of a turning action of a vehicle-mounted screen of a vehicle-mounted mechanical arm according to an embodiment of the present application;
fig. 13 illustrates a schematic diagram of a vehicle-mounted screen translation motion of a vehicle-mounted mechanical arm according to an embodiment of the present application;
Fig. 14 shows a schematic diagram of a vehicle-mounted screen rotation action of a vehicle-mounted mechanical arm according to an embodiment of the present application;
fig. 15 illustrates a schematic diagram of a back-and-forth movement of a vehicle-mounted screen of a vehicle-mounted mechanical arm according to an embodiment of the present application;
fig. 16 shows a schematic diagram of the actions of a rotating member of the vehicle-mounted mechanical arm according to the embodiment of the present application.
Detailed Description
Hereinafter, only certain exemplary embodiments are briefly described. As will be recognized by those of skill in the pertinent art, the described embodiments may be modified in various different ways without departing from the spirit or scope of the present application. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive.
As shown in fig. 1, fig. 1 is a flowchart of a method for processing a script sequence provided in an embodiment of the present application. The processing method of the script sequence can comprise the following steps:
step S101: in the process that the user edits the script sequence by using the control script set, aiming at the control script currently selected by the user, determining the next selectable control script in the control script set, wherein the control script is used for controlling the vehicle-mounted mechanical arm to execute the preset action, and the selectable control script is used for controlling the vehicle-mounted mechanical arm to further execute the control script corresponding to the preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script.
Step S102: the control script which can be selected is determined as the control script which can be selected by the user.
According to the processing method of the script sequence, in the process that the user edits the script sequence by using the control script set, each time when the user selects one control script, the control script which can be selected can be automatically determined to be the next control script which can be selected by the user.
Because the selectable control script is the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script. Therefore, under the condition that the selectable control script is determined to be the next control script which can be selected by the user, the next control script which is selected by the user after the currently selected control script can be ensured to be the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script.
The processing method for the script sequences can enable the vehicle-mounted mechanical arm to be in the reachable space in the process of sequentially executing the preset actions corresponding to each script sequence according to the edited script sequences. Therefore, personalized control of the vehicle-mounted mechanical arm can be achieved through the edited script sequences, and the vehicle-mounted mechanical arm can sequentially execute preset actions corresponding to the script sequences according to the edited script sequences.
The execution main body of the script sequence processing method provided in the embodiment of the present application is generally a server, and may also be a client.
The server may be a cloud server or a cloud server cluster for providing services such as data processing, storing, forwarding, and the like, or may be a conventional server or a conventional server cluster for providing services such as data processing, storing, forwarding, and the like. Wherein the general implementation of the legacy server is a computing device. The client is an Application (APP), an Application, or software having at least a script sequence processing function.
In the embodiment of the application, the client can be deployed and operated on the vehicle-mounted electronic equipment, the application electronic equipment and the browser webpage (web). The client deployed and operated on the vehicle-mounted electronic equipment is a vehicle-mounted client, the client deployed and operated on the application electronic equipment is a mobile client, and the client deployed and operated on the browser webpage is a web client.
A common mobile client is a mobile phone client.
In the embodiment of the application, the vehicle-mounted mechanical arm is a mechanical arm which is installed in a vehicle cabin and is used for providing intelligent driving service for personnel on the vehicle.
The number of the vehicle-mounted mechanical arms may be one or a plurality of vehicle-mounted mechanical arms. When the number of in-vehicle mechanical arms is plural, the script sequence may be processed for each of the plural in-vehicle mechanical arms, or the script sequence may be processed for any one of the plural in-vehicle mechanical arms. The following describes in detail a method for processing a script sequence provided in the embodiment of the present application, taking only one number of vehicle-mounted mechanical arms as an example.
The vehicle-mounted mechanical arm can independently execute corresponding preset actions so as to provide intelligent driving service for personnel on the vehicle. Specifically, the vehicle-mounted mechanical arm can be independently used for controlling the movement of the display screen, for example, controlling the preset action of the front-back movement of the vehicle-mounted display screen or the preset action of the angle adjustment, or independently executing the preset action of left-right swing.
In addition, the vehicle-mounted mechanical arm can be matched with a vehicle-mounted information entertainment system, an instrument panel, head-up display, a streaming media rearview mirror, an atmosphere lamp, an intelligent vehicle door, an intelligent sound box and the like in a vehicle cabin, and corresponding preset actions are completed in a preset scene. For example, the panning operation is performed in accordance with the blinking of the atmosphere lamp.
In the embodiment of the application, the vehicle-mounted client controls the vehicle-mounted mechanical arm by analyzing and executing the control script. Specifically, the vehicle-mounted client can analyze the control script and control the vehicle-mounted mechanical arm according to the preset action determined by the control script.
In the embodiment of the application, the control script set includes at least two preset actions. The preset action is preset execution action aiming at the vehicle-mounted mechanical arm, and the vehicle-mounted mechanical arm is in an accessible space in the process of executing the preset action. The preset action may specifically be a separate basic action, for example: upward, downward, or to the left, etc. The preset action may specifically be a complex action consisting of a basic action, for example: swing left and right, up and down, swing or hand swing, etc.
In the embodiment of the present application, a specific process of determining a control script that can be selected next in a control script set for a control script currently selected by a user is shown in fig. 2, and fig. 2 is a flowchart of a method for determining a control script that can be selected according to an embodiment of the present application. The method for determining which control script can be selected may include the steps of:
Step S201: and predicting the stop position of the vehicle-mounted mechanical arm after the preset action corresponding to the currently selected control script is executed.
Step S202: and predicting the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process on the basis of the stop position according to each control script in the control script set.
Step S203: based on the real-time location, a control script that can be selected is determined.
In the embodiment of the application, the control script which can be selected is determined according to the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process further executed on the basis of the stop position, so that the control script which can be selected can be ensured to be in the reachable space in the process of executing the corresponding preset action of the vehicle-mounted mechanical arm. Therefore, the control script which can be selected can be avoided, and the control script which can enable the stop position of the vehicle-mounted mechanical arm to be in the reachable space after the vehicle-mounted mechanical arm is controlled to execute the corresponding preset action can be caused to exceed the reachable space in the process of controlling the vehicle-mounted mechanical arm to execute the corresponding preset action.
Under the condition that the selectable control script is determined to be the next control script which can be selected by the user, the next control script which is selected by the user after the currently selected control script can be ensured to be the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in the preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script. Therefore, the selectable control script is determined through the real-time position, and the vehicle-mounted mechanical arm can be located in the reachable space in the process of sequentially executing the preset actions corresponding to each script sequence according to the edited script sequence.
That is, the personalized control of the vehicle-mounted mechanical arm can be realized through the edited script sequences, so that the vehicle-mounted mechanical arm can sequentially execute preset actions corresponding to each script sequence according to the edited script sequences.
Specifically, taking the currently selected control script as the second control script in the script sequence as an example, a detailed description is made on a process of determining the next selectable control script in the control script set for the control script currently selected by the user:
firstly, after a user selects a second control script, predicting a stop position of the vehicle-mounted mechanical arm after corresponding preset actions are executed aiming at the second control script; then, traversing each control script in the control script set, and respectively predicting the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process on the basis of the stop position. And finally, determining the selectable control script which can be selected as the third control script in the script sequence in the control script set by utilizing the real-time position corresponding to each control script.
The next selectable control script includes at least one control script. If any control script cannot be determined as the next selectable control script in the control script set for the control script currently selected by the user, the processing procedure of the proving script sequence cannot be continued. At this time, it is necessary to stop the processing of the script sequence and generate the target script sequence.
The specific process of determining the control script that may be selected based on the real-time location is described in detail below in conjunction with fig. 3, where fig. 3 is a schematic diagram of an available space provided in an embodiment of the present application. 301 in fig. 3 is used to represent the vehicle-mounted robotic arm, 302 is used to represent 302 the spatial extent defined by the accessible space. In this embodiment of the present application, according to the real-time position, a specific process of determining the selectable control script is as follows:
first, a spatial extent defined by the reachable space is determined. Then, for each control script, it is detected whether the real-time position is within a spatial range. Finally, the control script whose real-time position is in the space range is determined as the selectable control script.
The control script with the real-time position in the space range is determined as the selectable control script, so that the vehicle-mounted mechanical arm can be in the reachable space in the process of sequentially executing the preset actions corresponding to each script sequence according to the edited script sequence. Therefore, personalized control of the vehicle-mounted mechanical arm can be achieved through the edited script sequences, and the vehicle-mounted mechanical arm can sequentially execute preset actions corresponding to the script sequences according to the edited script sequences.
In the embodiment of the application, the specific implementation manner of determining the space range defined by the reachable space is as follows: first, a three-dimensional coordinate system for the vehicle-mounted mechanical arm is constructed by taking the installation position of the vehicle-mounted mechanical arm in a vehicle cabin as an origin of coordinates. Fig. 4 is a schematic diagram of a coordinate system of an in-vehicle mechanical arm according to an embodiment of the present application, as shown in fig. 4. The three-dimensional coordinate system shown in fig. 4 is directed with the x-axis toward the rear of the vehicle and the z-axis toward the roof of the vehicle. Then, a set of coordinate points that the in-vehicle mechanical arm can reach in a certain direction in the cabin space of the vehicle cabin is determined, and the space range is determined using the set of coordinate points. The spatial range may be represented by a pitch angle range, a yaw angle range, and a spatial distance of the vehicle-mounted mechanical arm.
The specific implementation manner of predicting the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process on the basis of the stop position in the embodiment of the application is as follows:
based on the stopping position, predicting the real-time position of the vehicle-mounted mechanical arm in the process of executing the corresponding preset action based on the spatial position change of the vehicle-mounted mechanical arm relative to the installation position in the process of executing the corresponding preset action aiming at each control script in the control script set.
Specifically, for each preset action, the spatial position change of the vehicle-mounted mechanical arm relative to the installation position in the process of executing the preset action is configured correspondingly in advance, and when the real-time position of the vehicle-mounted mechanical arm in the process of executing the corresponding preset action is predicted, the real-time position of the vehicle-mounted mechanical arm in the process of executing the corresponding preset action can be predicted based on the stop position and the spatial position change of the vehicle-mounted mechanical arm relative to the installation position in the process of executing the preset action.
It should be noted that, in the embodiment of the present application, the vehicle-mounted mechanical arm may be composed of at least one joint or link, and in the case that the vehicle-mounted mechanical arm is composed of two or more joints or links, each joint or link may have a situation that exceeds the reachable space in the process of executing the preset action. Therefore, when predicting the real-time position of the vehicle-mounted mechanical arm in the process of executing the corresponding preset action, it is necessary to predict the real-time position of each joint or link in the vehicle-mounted mechanical arm in the process of executing the corresponding preset action.
In the embodiment of the present application, when the execution subject is a client, the determining manner of the currently selected control script may be: and responding to the selected operation triggered by the user aiming at the control script, and determining the currently selected control script. In addition, after determining the selectable control script, the control script that can be selected by the user may be further set to a state that can be selected by the user. In this determination mode, the client needs to have at least a script sequence processing function and also needs to have a script sequence editing function.
The script sequence processing function and the script sequence editing function are deployed respectively, so that the problem that the script sequence editing is delayed due to network communication signal difference among different electronic devices often exists. The script sequence processing function and the script sequence editing function are simultaneously arranged on the same client, so that the problem can be effectively prevented.
In the embodiment of the present application, when the execution subject is a client, the determining manner of the currently selected control script may further be: and determining the selectable control script by using the first prompt information sent by the server for the selectable control script.
In addition, after determining the selectable control script, the method may further send a second prompt message for prompting the control script available for selection by the user to the server, so that the first electronic device sets the control script available for selection by the user to a state available for selection by the user by using the second prompt message.
In the determining mode, the client side not only needs to have at least a script sequence processing function, but also can have a script sequence editing function at the same time, and the selected control script is a control script selected by a user through triggering a target application, a program or software running on the first electronic device through a man-machine interaction interface.
The target application, program or software is an application, program or software having at least a script sequence editing function. In the case where the execution subject is an in-vehicle client, the implementation manner of the first electronic device includes, but is not limited to, a mobile phone and a computer. In the case where the execution subject is a mobile terminal, the first electronic device includes, but is not limited to, a mobile phone, a computer, and an in-vehicle electronic device.
In the embodiment of the application, the script sequence processing function and the script sequence editing function are deployed respectively, so that the resource consumption of the script sequence processing function and the script sequence editing function to the electronic equipment for supporting the respective operation can be reduced.
In the embodiment of the present application, when the execution subject is a server, the determining manner of the currently selected control script may be: and determining the currently selected control script by using third prompt information sent by the second electronic equipment aiming at the currently selected control script. In addition, after determining the selectable control script, the second electronic device may further send fourth prompting information for prompting the control script available for selection by the user, so that the second electronic device sets the control script available for selection by the user to a state available for selection by the user by using the fourth prompting information.
And under the condition that the execution main body is a server, the control script which can be selected is the control script selected by the user through triggering a target application, a program or software running on the second electronic device through the man-machine interaction interface of the second electronic device.
Wherein the target application, program or software is an application, program or software having at least a script sequence editing function. The electronic device includes, but is not limited to, a mobile phone, a computer, and a vehicle-mounted electronic device.
In the embodiment of the application, the script sequence processing function is deployed at the server, so that the determination speed of the control script which can be selected by a user can be improved, and script sequence processing function services can be provided for different users.
In the embodiment of the present application, when the execution body is a server, the detailed procedure of the processing of the script sequence may be as shown in fig. 5, and fig. 5 is a flowchart of another editing method of the script sequence provided in the embodiment of the present application. The method may comprise the steps of:
step S501: and determining the currently selected control script by using third prompt information sent by the second electronic equipment aiming at the currently selected control script.
Step S502: and predicting the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process on the basis of the stop position according to each control script in the control script set.
Step S503: it is detected whether the real-time location is within a spatial range.
Step S503-1: if so, the control script with the real-time position in the space range is determined as the selectable control script.
Step S503-2: if not, the control script with the real-time position not in the space range is determined as the control script which can not be selected.
Step S504: and sending fourth prompt information for prompting the control script which can be selected by the user to the second electronic equipment, so that the second electronic equipment can set the control script which can be selected by the user into a state which can be selected by the user and set the control script which cannot be selected by the user into a state which cannot be selected by the user by utilizing the fourth prompt information.
In the embodiment of the application, the control scripts which can be selected by the user are set to be in a state which can be selected by the user, so that the user can visually perceive which control scripts are the next control scripts which can be selected. Therefore, the experience of the user on script sequence editing can be improved, and the efficiency of the user for editing the script sequence is improved.
In the embodiment of the application, in order to improve the visual degree of the control script which can be selected by the user to the user, improve the user experience of the user, the control script which can be selected by the user can be set to be in a highlight display mode in the process of displaying the control script which can be selected by the user, and then the control script which can be selected by the user is subjected to highlight display.
In addition, in order to make the visual effect more obvious, the control script which can be selected by the user can be set to a mode which can be selected by the user, and after the control script which cannot be selected by the user is set to a mode which cannot be selected by the user, the control script which can be selected by the user is further set to a highlighted mode, and the control script which cannot be selected by the user is set to a gray display mode.
In addition, the degree of visualization of the control script available for the user to select may be further improved by other manners, for example: control scripts that are not available for user selection may also be set to a mode that is not capable of presentation.
In the embodiment of the present application, a processing device for a script sequence is further provided, and referring to fig. 6 specifically, fig. 6 is a schematic diagram of the processing device for a script sequence provided in the embodiment of the present application. The apparatus may include:
the selectable script determining unit 601 is configured to determine, in a process of editing a script sequence by using a control script set, a control script that is used to control the vehicle-mounted mechanical arm to execute a preset action according to a control script currently selected by a user, where the control script is a script that is used to control the vehicle-mounted mechanical arm to execute the preset action, and the selectable control script is a control script that can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in a preset reachable space after the vehicle-mounted mechanical arm has executed the preset action corresponding to the currently selected control script;
The selectable script determining unit 602 is configured to determine the selectable control script as a control script that is available for selection by the user.
In one embodiment, the selectable script determination unit 602 may include:
the stopping position predicting subunit is used for predicting the stopping position of the vehicle-mounted mechanical arm after the preset action corresponding to the currently selected control script is executed;
the real-time position prediction subunit is used for predicting the real-time position of the vehicle-mounted mechanical arm in the corresponding preset action process on the basis of the stop position according to each control script in the control script set;
and the first determination subunit is used for determining the selectable control script according to the real-time position.
In one embodiment, the optional script first determining subunit may include:
a space range determination subunit configured to determine a space range defined by the reachable space;
the real-time position detection subunit is used for detecting whether the real-time position is in a space range or not according to each control script;
a second determining subunit is provided for determining the control script with the real-time position in the space range as the selectable control script.
In one embodiment, the selectable script determination unit 601 may include: a first determining subunit of selectable scripts, configured to determine a currently selected control script in response to a selection operation triggered by a user for the control script;
the apparatus further comprises: and the state setting unit is used for setting the control script which can be selected by the user into a state which can be selected by the user.
In one embodiment, the selectable script determination unit 601 may include: a second determining subunit of the selectable script, configured to determine the selectable control script by using the first prompt information sent by the server for the selectable control script;
the apparatus further comprises: the first prompt information sending unit is used for sending second prompt information for prompting the control script which can be selected by the user to the server side, so that the first electronic equipment can set the control script which can be selected by the user into a state which can be selected by the user by utilizing the second prompt information.
In one embodiment, the selectable script determination unit 601 may include: a third determining subunit of the selectable script, configured to determine, by using the third prompt information sent by the second electronic device for the currently selected control script, the currently selected control script;
The device further comprises a prompt information second sending unit, which is used for sending fourth prompt information for prompting the control script which can be selected by the user to the second electronic equipment, so that the second electronic equipment can set the control script which can be selected by the user into a state which can be selected by the user by utilizing the fourth prompt information.
The functions of each unit in each apparatus of the embodiments of the present application may be referred to the corresponding descriptions in the above methods, which are not described herein again.
Fig. 7 shows a block diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device includes: memory 710 and processor 720, the memory 710 having instructions executable on the processor 720 stored therein. The processor 720, when executing the instructions, implements the method of processing script sequences in the above embodiments. The number of memories 710 and processors 720 may be one or more. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
The electronic device may also include a communication interface 730 for communicating with external devices for interactive data transmission. The various devices are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor 720 may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of a GUI on an external input/output device, such as a display device coupled to an interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in fig. 7, but not only one bus or one type of bus.
Alternatively, in a specific implementation, if the memory 710, the processor 720, and the communication interface 730 are integrated on a chip, the memory 710, the processor 720, and the communication interface 730 may communicate with each other through internal interfaces.
It should be appreciated that the processor may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or any conventional processor or the like. It is noted that the processor may be a processor supporting an advanced reduced instruction set machine (Advanced RISC Machines, ARM) architecture.
The present embodiments provide a computer-readable storage medium (such as the memory 710 described above) storing computer instructions that when executed by a processor implement the methods provided in the embodiments of the present application.
Alternatively, the memory 710 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created from the use of the electronic device by the script sequence, and the like. In addition, memory 710 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 710 may optionally include memory located remotely from processor 720, which may be connected to the electronic device of the XXX via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The embodiment of the application also provides a vehicle-mounted display device, which can comprise the electronic device provided by the embodiment of the application, and the vehicle-mounted mechanical arm and the vehicle-mounted screen of any embodiment of the application.
The embodiment of the application also provides a vehicle-mounted display device, which can comprise a control unit, the vehicle-mounted mechanical arm and the vehicle-mounted screen, wherein the control unit is used for executing the processing method of the script sequence of any embodiment of the application to determine a target script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence; or the vehicle-mounted mechanical arm control unit may include a processing device of the script sequence in any embodiment of the present application, and is configured to determine a target script sequence by using the processing device of the script sequence, and control the vehicle-mounted mechanical arm based on the target script sequence.
In addition, the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action; and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
The embodiment of the application also provides a vehicle which can comprise the vehicle-mounted mechanical arm and the vehicle-mounted screen provided by the embodiment of the application and any embodiment of the application.
The embodiment of the application also provides a vehicle, which can comprise a control unit, the vehicle-mounted mechanical arm and the vehicle-mounted screen, wherein the control unit is used for executing the processing method of the script sequence of any embodiment of the application to determine a target script sequence and controlling the vehicle-mounted mechanical arm based on the target script sequence; or the vehicle-mounted mechanical arm control unit may include a processing device of the script sequence in any embodiment of the present application, and is configured to determine a target script sequence by using the processing device of the script sequence, and control the vehicle-mounted mechanical arm based on the target script sequence.
In addition, the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action; and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
By way of example, the electronic device may be at least one of a body domain control module (Body Domain Control Module, BDCM), an infotainment domain control module (Infotainment Domain Control Module, IDCM), a travel domain control module (Vehicle Domain Control Module, VDCM), an autopilot domain control module (Automated-driving Domain Control Module, ADCM), an on-board robotic arm control unit (Robotic Arm Controller, RAC).
The vehicle in the present embodiment may be exemplified by any power-driven vehicle such as a fuel vehicle, an electric vehicle, a solar vehicle, or the like. The vehicle in the present embodiment may be an autonomous vehicle, for example.
Other components of the vehicle of this embodiment, such as the frame and the vehicle.
It should be noted that, the vehicle-mounted mechanical arm provided in the embodiment of the present application is specifically shown in fig. 8 to 16, and the vehicle-mounted mechanical arm according to the embodiment of the present application is described below with reference to fig. 8 to 16.
As shown in fig. 8, an in-vehicle mechanical arm of an alternative embodiment is shown, including: a multiple degree of freedom adjusting mechanism fixed on the back of the vehicle-mounted screen 3, and a plurality of telescopic units mounted on the multiple degree of freedom adjusting mechanism; the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen 3 to complete any one or more of the following four actions, wherein the four actions comprise: the vehicle-mounted screen translation action, the vehicle-mounted screen overturning action, the vehicle-mounted screen rotation action and the vehicle-mounted screen forward and backward movement action. Further, taking the state that the vehicle-mounted screen 3 is in a state that no action occurs as an initial state, when the vehicle-mounted screen 3 is in the initial state, an initial axis is arranged in the space, and the initial axis is perpendicular to the plane of the vehicle-mounted screen 3 in the initial state; the following specific explanation is given for the four actions described above: and (3) vehicle-mounted screen translation action: as shown in fig. 13, the front surface of the in-vehicle screen 3 translates, and the front surface of the in-vehicle screen 3 translates at any angle in a plane perpendicular to the initial axis; and (3) turning over the vehicle-mounted screen: as shown in fig. 12, the front surface of the vehicle-mounted screen 3 is turned over, and an included angle exists between the front surface of the vehicle-mounted screen 3 and the initial axis after the turning over is completed; vehicle-mounted screen rotation action: as shown in fig. 14, the front surface of the in-vehicle screen 3 rotates around the initial axis or an axis parallel to the initial axis; the vehicle-mounted screen moves back and forth to act: as shown in fig. 15, the front surface of the in-vehicle screen 3 is moved in the front-rear direction, and the movement direction of the front surface of the in-vehicle screen 3 is set in parallel with the initial axis. In other words, the multiple telescopic units are used for driving the vehicle-mounted screen 3 to turn up, down, left and right, and the multiple freedom degree adjusting mechanism is used for driving the vehicle-mounted screen 3 to rotate and translate, wherein the up, down, left and right refer to the actions of tilting the vehicle-mounted screen 3 to the rear side at the upper part, tilting to the rear side at the lower part, tilting to the rear side at the left part and tilting to the rear side at the right part relative to the initial position when the vehicle-mounted screen 3 is in a vertical state facing to the user.
Further, as an optional embodiment, the vehicle-mounted central control screen adjusting mechanism related to the application may not be provided with the multi-degree-of-freedom adjusting mechanism, so that the vehicle-mounted screen 3 is directly connected with the plurality of telescopic units 10, and only the control screen can swing up, down, left and right according to the use requirement.
Further, as an optional embodiment, the vehicle-mounted central control screen adjusting mechanism related to the application may not be provided with the plurality of telescopic units, so that the vehicle-mounted screen 3 is directly connected with the multi-degree-of-freedom adjusting mechanism, and thus the self-rotation and translational sliding of the control screen are realized.
In another alternative embodiment, the motion of each telescoping unit is coupled to a multiple degree of freedom adjustment mechanism, and the drive end of each telescoping unit is coupled to a drive section.
Further, as an alternative embodiment, the driving part is a center console inside the automobile.
Further, as an alternative embodiment, a corresponding control system is arranged in the center console, and the control system is used for controlling the telescopic actions of the telescopic units and the movement of the multi-degree-of-freedom adjusting mechanism.
Further, as an alternative embodiment, the telescopic unit may also be a bendable rod member having a ball structure, and the telescopic rod member is installed by interference extrusion with a side of the multiple degree of freedom adjusting mechanism away from the vehicle screen 3 through the ball. Further, the user can manually apply force to the vehicle-mounted screen 3, so that the multiple-degree-of-freedom adjusting mechanism is applied to the ball head structure as a force transmitting part, and after the ball head structure swings to a certain angle, enough friction force is generated between the ball head structure and the multiple-degree-of-freedom adjusting mechanism, so that the vehicle-mounted screen 3 keeps the current position.
Further, as an alternative embodiment, the moving end of each telescopic unit includes: the linear motion unit 11 and the multi-freedom-degree connector, one end of the linear motion unit 11 is connected with the multi-freedom-degree connector, and the multi-freedom-degree connector is arranged on the multi-freedom-degree adjusting mechanism.
Further, as an alternative embodiment, the multiple degree of freedom connector is a ball joint structure or a universal joint structure.
Further, as shown in fig. 9, as an alternative embodiment, the ball joint structure includes: the ball joint 12 is fixedly connected with the linear motion unit 11, each ball joint 12 is arranged in one ball socket slide block 13, and each ball socket slide block 13 is arranged on the multi-degree-of-freedom adjusting mechanism.
Further, as an alternative embodiment, each ball and socket slider 13 has a spherical recess thereon that mates with the spherical joint 12.
Further, as an alternative embodiment, the universal joint structure includes: the device comprises a first rotating part, a second rotating part and a hinge part connected with the first rotating part and the second rotating part, wherein one end of the first rotating part is fixedly connected with a telescopic unit, the other end of the first rotating part is connected with one end of the hinge part, the other end of the hinge part is rotatably connected with one end of the second rotating part, and the other end of the second rotating part is fixedly connected with a multi-degree-of-freedom adjusting mechanism.
Further, as an alternative embodiment, the linear motion unit 11 is an electric putter or a manual putter. Further, when the linear motion unit 11 is a manual push rod, the user can manually push the vehicle-mounted screen 3 to make the vehicle-mounted screen 3 perform a corresponding action; when the electric push rod of the vehicle-mounted mechanical arm is in a power-off state, the electric push rod should allow a user to drive the electric push rod to correspondingly stretch and retract in a manual mode so as to complete the action of the vehicle-mounted screen 3.
Further, as an alternative embodiment, the contact surfaces between the movable parts of the vehicle-mounted mechanical arm such as the ball joint 12, the linear motion unit 11, the multi-degree-of-freedom adjusting mechanism and the like and the corresponding connection parts have certain friction resistance, and the friction resistance is used for keeping the current posture stable during the vehicle form process.
Further, as an alternative embodiment, a stress sensing portion is disposed in the electric putter or the vehicle-mounted screen 3, where the stress sensing portion is configured to obtain information of an external force applied to a corresponding position, and the stress sensing portion determines a target of the application of the force according to the information of the external force: when the force application target is a passenger, namely the passenger pushes the vehicle-mounted screen 3, the force sensing part analyzes the information of the external force into action information, and the vehicle-mounted mechanical arm carries out corresponding action according to the action information so as to form power assistance in the process of pushing the vehicle-mounted screen by the passenger, so that the passenger can easily drive the vehicle-mounted screen 3 to complete corresponding action; when the force is applied to the vehicle, i.e. the vehicle encounters jolt or the passenger performs touch operation on the vehicle-mounted screen, the vehicle-mounted mechanical arm does not move or drives the corresponding driving part to perform reverse driving so as to control the vehicle-mounted screen 3 to keep the current state.
Further, as an alternative embodiment, the method further includes: the vehicle collision detection system is arranged on an automobile and is used for detecting running information of the vehicle in real time, and when the vehicle is about to happen or has crashed, the vehicle-mounted mechanical arm immediately drives the vehicle-mounted screen 3 to rapidly separate from passengers, so that the passengers are prevented from being crashed with the vehicle-mounted screen 3 under the action of inertia during the collision to cause injury.
Further, as an alternative embodiment, the linear motion unit 11 is an unpowered telescopic rod.
Further, as an alternative embodiment, the linear motion unit 11 is a hydraulic push rod.
Further, as an alternative embodiment, the method further includes: the guide rails 14 are arranged on the multi-degree-of-freedom adjusting mechanism, and each ball-and-socket sliding block 13 is slidably arranged on one guide rail 14.
The present application further has the following embodiments based on the above description:
in an alternative embodiment of the present application, the vehicle-mounted mechanical arm includes three telescopic units.
In an alternative embodiment of the present application, the number of the guide rail 14, the ball joint 12, the ball and socket slider 13 and the linear motion unit 11 is three.
In an alternative embodiment of the present application, three guide rails 14 are disposed at 120-degree angles apart. Further, the extension lines of the three guide rails 14 converge a little after intersecting, and the adjacent extension lines are spaced 120 degrees apart.
In an alternative embodiment of the present application, the multiple degree of freedom adjustment mechanism includes: a sliding mechanism 5 and a rotating mechanism 2, the rotating mechanism 2 is connected with the sliding mechanism 5, one of the rotating mechanism 2 and the sliding mechanism 5 is connected with the vehicle-mounted screen 3, and the other of the rotating mechanism 2 and the sliding mechanism 5 is connected with the telescopic unit.
As shown in fig. 10, in an alternative embodiment of the present application, the rotation mechanism 2 includes: the motor 21, the worm 22 and the turbine 23 are all installed on the supporting part, the motor 21 is connected with the worm 22, the worm 22 is in transmission connection with the turbine 23, the turbine 23 is in meshed connection with the turbine 24, and the turbine 24 is installed on the vehicle-mounted screen 3 or the sliding mechanism 5. Further, the support is connected with several telescopic units or with the sliding mechanism 5. The support portion has a shell structure, and the motor 21, the worm 22, the worm wheel 23 and the sector gear 24 are accommodated in the support portion. The outer edge of one end of the sector gear 24 protrudes radially outwards to form an arc-shaped part, an arc-shaped rack is arranged on the arc-shaped part, the tooth tip of the rack is radially inwards arranged, and the rack is in transmission connection with the turbine 23.
In an optional embodiment of the present application, further comprising: two rotation stoppers 25, the two rotation stoppers 25 are mounted on the supporting portion, and the two rotation stoppers 25 are respectively disposed against both ends of the sector gear 24.
In an alternative embodiment of the present application, the rotation mechanism 2 further includes: and a rotation shaft having one end fixedly mounted on the support portion and the other end rotatably mounted on the rear surface of the in-vehicle screen 3 or the slide mechanism 5 via a bearing or the like.
In an alternative embodiment of the present application, the sliding mechanism 5 includes: the sliding mechanism comprises a first sliding part, a second sliding part and a sliding driving device, wherein the first sliding part is slidably connected with the second sliding part, the sliding direction is perpendicular to the rotating shaft of the rotating mechanism 2, the sliding driving device is arranged between the first sliding part and the second sliding part, and the sliding driving device is used for driving the relative sliding between the first sliding part and the second sliding part.
In an optional embodiment of the present application, further comprising: and the visual sensor is arranged on the front surface of the vehicle-mounted screen 3, is used for detecting the position of eyes of a user and is connected with the control system. Further, the front surface of the in-vehicle screen 3 is set toward the driver as much as possible with the aid of the angle adjusting mechanism and the multiple degree of freedom adjusting mechanism by a visual sensor, which is an intelligent camera or a human body position sensor, and a control system. In another alternative embodiment, the visual sensing means comprise several visual sensors arranged on the front side of the on-board screen 3 and/or at any position of the cabin of the car. In a specific application of the vision sensing device, as a use method of the vision sensing device, the vision sensor is used for identifying appointed gesture movements of passengers of the automobile, and the vehicle-mounted mechanical arm controls the vehicle-mounted screen 3 to perform actions matched with the gesture movements according to the gesture movements obtained by the vision sensor. For example, the gesture controls the vehicle-mounted screen to move back and forth, or triggers the vehicle-mounted screen to face the user along with a certain application scene.
In an optional embodiment of the present application, further comprising: the mechanism controller is used for controlling the vehicle-mounted mechanical arm, the mechanism controller can be used for collecting information of passengers in the vehicle, the information comprises, but is not limited to, personal information such as height information, weight information or sex information of the corresponding passengers, meanwhile, the mechanism controller is also used for collecting posture information of seats of the corresponding passengers, and the vehicle-mounted mechanical arm or the seat posture adjusting mechanism is automatically controlled by processing the personal information of the passengers and the posture information of the seats so that the front face of the vehicle-mounted screen 3 faces the passengers. Meanwhile, the mechanism controller also collects the relative position information of the steering wheel of the automobile at all times, and limits the action range of the vehicle-mounted screen 3 by calculating a safe distance between the vehicle-mounted screen 3 and the steering wheel, namely, the mechanism controller controls the vehicle-mounted mechanical arm to keep the distance between the vehicle-mounted screen 3 and the steering wheel to be always greater than or equal to the safe distance.
In an optional embodiment of the present application, further comprising: the sound sensing device comprises a plurality of sound receivers which are arranged at the outer edge of the vehicle-mounted screen 3 or in the cab of the automobile, and the sound sensing device is connected with the control system. Further, the position of the user speaking is detected by the sound sensing device, so that the orientation position of the in-vehicle screen 3 is adjusted.
As shown in fig. 11 and 16, in an alternative embodiment of the present application, unlike the above-mentioned technical solution that uses matching of the ball-socket slider 13 and the sliding rail to adapt to the displacement of the end portion of the telescopic unit, the present application further provides another technical solution that provides the above-mentioned displacement, specifically as follows: the driving end of each telescopic unit is further provided with a rotating piece 4, each rotating piece 4 is installed on the driving part, and the moving end of each telescopic unit is rotatably connected with one rotating piece 4. I.e. the adaptive displacement that would otherwise occur on the guide rail 14 is transferred to the rotation of the telescopic unit itself to match the displacement of the spherical joint 12 of the telescopic unit.
In an alternative embodiment of the present application, for the above embodiment using the rotary member 4, the multi-degree of freedom connector of the telescopic unit is no longer connected to the guide rail 14, but is directly connected to the multi-degree of freedom adjustment mechanism.
In an alternative embodiment of the present application, the ball and socket slider 13 is directly fixed to the multiple degree of freedom adjustment mechanism, and the ball joint 12 is rotatably mounted to the ball and socket slider 13.
In an alternative embodiment of the present application, the rotary member 4 is rotatably connected to the middle portion of the linear motion unit 11.
In an alternative embodiment of the present application, the rotary member 4 is provided in a shaft-like structure.
In an alternative embodiment of the present application, the driving part is a shell structure, and the three rotating members 4 are fixedly mounted on the shell.
In an alternative embodiment of the present application, the axes of the three rotary members 4 intersect at 120 degree angular intervals.
The vehicle-mounted central control screen as an alternative embodiment comprises the vehicle-mounted screen 3 and any vehicle-mounted mechanical arm, namely the corresponding vehicle-mounted screen 3 is the central control screen, the central control screen is arranged at a console of a front cabin of an automobile, and a plurality of telescopic units and a multi-degree-of-freedom adjusting mechanism jointly participate in driving the central control screen to finish translational motion of the vehicle-mounted screen 3, overturning motion of the vehicle-mounted screen 3, rotating motion of the vehicle-mounted screen 3 and forward and backward movement motion of the vehicle-mounted screen 3 in a narrow space in the automobile. In addition to the above-mentioned examples of application scenarios, individual or combined implementations based on the above actions may also form the presentation of various other application scenarios, such as, for example, calling a user (driver or in-vehicle passenger) by flipping and/or rotating, a specific flip action under certain vehicle-to-vehicle interaction scenarios (exhibiting a rocking or tilting effect or a tilting effect), a specific flip action upon success of an over-the-air (OTA), a triggering of a certain vehicle-to-vehicle interaction scenario to a user (e.g., using a vehicle screen as a cosmetic mirror), triggering of a vehicle screen to move back and forth with a gesture or other action capture, triggering of a vehicle screen rotation with specific content or action capture, adjusting the amount of motion of each single action or combination of actions described above with speech, etc.
The embodiment of the application also provides a vehicle, which comprises at least one of the control device and the vehicle control system according to the embodiment of the application, the vehicle-mounted mechanical arm according to the embodiment of the application and the vehicle-mounted central control screen according to the embodiment of the application.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
Any process or method description in a flowchart or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more (two or more) executable instructions for implementing specific logical functions or steps of the process. And the scope of the preferred embodiments of the present application includes additional implementations in which functions may be performed in a substantially simultaneous manner or in an opposite order from that shown or discussed, including in accordance with the functions that are involved.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
It is to be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. All or part of the steps of the methods of the embodiments described above may be performed by a program that, when executed, comprises one or a combination of the steps of the method embodiments, instructs the associated hardware to perform the method.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules described above, if implemented in the form of software functional modules and sold or used as a stand-alone product, may also be stored in a computer-readable storage medium. The storage medium may be a read-only memory, a magnetic or optical disk, or the like.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think of various changes or substitutions within the technical scope of the present application, and these should be covered in the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A method for processing a script sequence, comprising:
in the process that a user edits a script sequence by using a control script set, determining a next selectable control script in the control script set aiming at a control script currently selected by the user, wherein the control script is a script for controlling a vehicle-mounted mechanical arm to execute a preset action, and the selectable control script is the control script which can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in a preset reachable space after the vehicle-mounted mechanical arm executes the preset action corresponding to the currently selected control script;
And determining the selectable control script as the next control script available for the user to select.
2. The method of claim 1, wherein the determining a next selectable control script in the set of control scripts for a control script currently selected by a user comprises:
predicting a stop position of the vehicle-mounted mechanical arm after the preset action corresponding to the currently selected control script is executed;
predicting a real-time position of the vehicle-mounted mechanical arm in the preset action process based on the stop position according to each control script in the control script set;
and determining the selectable control script according to the real-time position.
3. The method of claim 2, wherein said determining the selectable control script based on the real-time location comprises:
determining a spatial range defined by the reachable space;
detecting whether the real-time position is within the spatial range for each control script;
and determining the control script of which the real-time position is in the space range as the selectable control script.
4. A method according to any one of claims 1-3, wherein the manner in which the currently selected control script is determined comprises: responding to the selected operation triggered by the user aiming at the control script, and determining the currently selected control script;
the method further comprises the steps of: and setting the control script which can be selected by the user into a state which can be selected by the user.
5. A method according to any one of claims 1-3, wherein the manner in which the currently selected control script is determined comprises: determining the selectable control script by using a first prompt message sent by a server for the selectable control script;
the method further comprises the steps of: and sending second prompt information for prompting the control script which can be selected by the user to the server side, so that the first electronic equipment can set the control script which can be selected by the user into a state which can be selected by the user by utilizing the second prompt information.
6. A method according to any one of claims 1-3, wherein the manner in which the currently selected control script is determined comprises: determining the currently selected control script by using third prompt information sent by the second electronic equipment aiming at the currently selected control script;
The method further comprises the steps of: and sending fourth prompt information for prompting the control script which can be selected by the user to the second electronic equipment, so that the second electronic equipment can set the control script which can be selected by the user into a state which can be selected by the user by utilizing the fourth prompt information.
7. A script sequence processing apparatus, comprising:
a selectable script determining unit, configured to determine, in a control script set, a next selectable control script for a control script currently selected by a user in a process that the user edits a script sequence using the control script set, where the control script is a script for controlling a vehicle-mounted mechanical arm to execute a preset action, and the selectable control script is a control script that, after the vehicle-mounted mechanical arm has executed the preset action corresponding to the currently selected control script, can control the vehicle-mounted mechanical arm to further execute the corresponding preset action in a preset reachable space;
and the selectable script determining unit is used for determining the selectable control script as a control script which can be selected by a user next time.
8. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
9. A vehicle-mounted display apparatus, characterized by comprising: the vehicle-mounted mechanical arm comprises a control unit, a vehicle-mounted mechanical arm and a vehicle-mounted screen;
the control unit is configured to execute the processing method of the script sequence of any one of claims 1 to 6, to determine a target script sequence, and to control the vehicle-mounted mechanical arm based on the target script sequence; or a processing device including the script sequence of claim 7, the control unit being configured to determine a target script sequence using the processing device of the script sequence, and control the in-vehicle robot arm based on the target script sequence;
the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action;
and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
10. A vehicle, characterized by comprising: the vehicle-mounted mechanical arm comprises a control unit, a vehicle-mounted mechanical arm and a vehicle-mounted screen;
the control unit is configured to execute the processing method of the script sequence of any one of claims 1 to 6, to determine a target script sequence, and to control the vehicle-mounted mechanical arm based on the target script sequence; or a processing device including the script sequence of claim 7, the control unit being configured to determine a target script sequence using the processing device of the script sequence, and control the in-vehicle robot arm based on the target script sequence;
the vehicle-mounted mechanical arm is used for driving the vehicle-mounted screen to complete at least one preset action;
and the vehicle-mounted screen is connected with the vehicle-mounted mechanical arm.
CN202210766469.0A 2021-11-01 2022-06-30 Script sequence processing method and device, electronic equipment and vehicle Pending CN116061169A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/104187 WO2024002297A1 (en) 2021-11-01 2023-06-29 Method and apparatus for controlling vehicle-mounted robot arm, and vehicle-mounted display device and vehicle

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202122647760 2021-11-01
CN202122647760X 2021-11-01

Publications (1)

Publication Number Publication Date
CN116061169A true CN116061169A (en) 2023-05-05

Family

ID=86168807

Family Applications (15)

Application Number Title Priority Date Filing Date
CN202210161801.0A Pending CN116061820A (en) 2021-11-01 2022-02-22 Control method, device and system of vehicle, mechanical arm and vehicle
CN202210162663.8A Pending CN116061821A (en) 2021-11-01 2022-02-22 Control method, device and system of vehicle, mechanical arm and vehicle
CN202210778466.9A Pending CN116061828A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted display equipment, vehicle-mounted display equipment and vehicle
CN202210767362.8A Pending CN116061824A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210767895.6A Pending CN116061825A (en) 2021-11-01 2022-06-30 Vehicle control method and device, electronic equipment and vehicle
CN202210782081.XA Pending CN116061829A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted display equipment, vehicle-mounted display equipment and vehicle
CN202210765976.2A Pending CN116061167A (en) 2021-11-01 2022-06-30 Vehicle-mounted mechanical arm and control method and device thereof
CN202210766490.0A Pending CN116061819A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210766060.9A Pending CN116061822A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted mechanical arm, electronic equipment and vehicle
CN202210766469.0A Pending CN116061169A (en) 2021-11-01 2022-06-30 Script sequence processing method and device, electronic equipment and vehicle
CN202210766252.XA Pending CN116061823A (en) 2021-11-01 2022-06-30 Vehicle control system, mechanical arm and vehicle
CN202210766245.XA Pending CN116061168A (en) 2021-11-01 2022-06-30 Vehicle-mounted mechanical arm and control method and system thereof
CN202210770121.9A Pending CN116061827A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted mechanical arm, vehicle-mounted display equipment and vehicle
CN202210768779.6A Pending CN116061826A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210767008.5A Pending CN116061170A (en) 2021-11-01 2022-06-30 Script sequence determining method and device, electronic equipment and vehicle

Family Applications Before (9)

Application Number Title Priority Date Filing Date
CN202210161801.0A Pending CN116061820A (en) 2021-11-01 2022-02-22 Control method, device and system of vehicle, mechanical arm and vehicle
CN202210162663.8A Pending CN116061821A (en) 2021-11-01 2022-02-22 Control method, device and system of vehicle, mechanical arm and vehicle
CN202210778466.9A Pending CN116061828A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted display equipment, vehicle-mounted display equipment and vehicle
CN202210767362.8A Pending CN116061824A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210767895.6A Pending CN116061825A (en) 2021-11-01 2022-06-30 Vehicle control method and device, electronic equipment and vehicle
CN202210782081.XA Pending CN116061829A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted display equipment, vehicle-mounted display equipment and vehicle
CN202210765976.2A Pending CN116061167A (en) 2021-11-01 2022-06-30 Vehicle-mounted mechanical arm and control method and device thereof
CN202210766490.0A Pending CN116061819A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210766060.9A Pending CN116061822A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted mechanical arm, electronic equipment and vehicle

Family Applications After (5)

Application Number Title Priority Date Filing Date
CN202210766252.XA Pending CN116061823A (en) 2021-11-01 2022-06-30 Vehicle control system, mechanical arm and vehicle
CN202210766245.XA Pending CN116061168A (en) 2021-11-01 2022-06-30 Vehicle-mounted mechanical arm and control method and system thereof
CN202210770121.9A Pending CN116061827A (en) 2021-11-01 2022-06-30 Control method and device of vehicle-mounted mechanical arm, vehicle-mounted display equipment and vehicle
CN202210768779.6A Pending CN116061826A (en) 2021-11-01 2022-06-30 Mechanical arm control method, device and equipment of vehicle-mounted screen and vehicle
CN202210767008.5A Pending CN116061170A (en) 2021-11-01 2022-06-30 Script sequence determining method and device, electronic equipment and vehicle

Country Status (2)

Country Link
CN (15) CN116061820A (en)
WO (4) WO2024002303A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024002297A1 (en) * 2021-11-01 2024-01-04 华人运通(江苏)技术有限公司 Method and apparatus for controlling vehicle-mounted robot arm, and vehicle-mounted display device and vehicle

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN219351252U (en) * 2022-12-09 2023-07-14 华人运通(江苏)技术有限公司 Screen harness support and vehicle-mounted screen

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3727078B2 (en) * 1994-12-02 2005-12-14 富士通株式会社 Display device
US10540976B2 (en) * 2009-06-05 2020-01-21 Apple Inc. Contextual voice commands
EP2839391A4 (en) * 2012-04-20 2016-01-27 Maluuba Inc Conversational agent
CN103218289B (en) * 2013-03-29 2015-07-08 北京控制工程研究所 Satellite-borne software test automatic executing method
US20150088489A1 (en) * 2013-09-20 2015-03-26 Abdelhalim Abbas Systems and methods for providing man-machine communications with etiquette
CN104331547B (en) * 2014-10-23 2017-05-10 北京控制工程研究所 Space mechanical arm structure parameter optimization method based on operability
JP6129927B2 (en) * 2015-10-15 2017-05-17 クラリオン株式会社 Information processing apparatus, voice operation system, and voice operation method of information processing apparatus
US11141859B2 (en) * 2015-11-02 2021-10-12 Brainlab Ag Determining a configuration of a medical robotic arm
CN106803423B (en) * 2016-12-27 2020-09-04 智车优行科技(北京)有限公司 Man-machine interaction voice control method and device based on user emotion state and vehicle
CN106873765B (en) * 2016-12-27 2018-09-11 比亚迪股份有限公司 The switching method and apparatus of the screen state of car-mounted terminal
CN108327649B (en) * 2017-01-20 2020-11-20 比亚迪股份有限公司 Supporting device of vehicle-mounted display terminal and vehicle
CN107499251B (en) * 2017-04-01 2020-06-02 宝沃汽车(中国)有限公司 Method and device for vehicle-mounted display screen display and vehicle
CN107600075A (en) * 2017-08-23 2018-01-19 深圳市沃特沃德股份有限公司 The control method and device of onboard system
KR102441067B1 (en) * 2017-10-12 2022-09-06 현대자동차주식회사 Apparatus and method for processing user input for vehicle
CN107598929B (en) * 2017-10-25 2020-04-21 北京邮电大学 Single-joint fault space manipulator pose reachable space solving method
CN107877517B (en) * 2017-11-16 2021-03-30 哈尔滨工业大学 Motion mapping method based on cyberporce remote operation mechanical arm
CN109017602B (en) * 2018-07-13 2023-08-18 吉林大学 Self-adaptive center console based on human body gesture recognition and control method thereof
CN109684223B (en) * 2018-12-28 2022-03-15 河南思维轨道交通技术研究院有限公司 Test script automatic linking method and storage medium
CN109766402A (en) * 2019-01-16 2019-05-17 广东南方数码科技股份有限公司 Spatial data processing method, device and computer equipment
DE102019102803B4 (en) * 2019-02-05 2022-02-17 Franka Emika Gmbh Aligning two robotic arms to each other
CN111002996B (en) * 2019-12-10 2023-08-25 广州小鹏汽车科技有限公司 Vehicle-mounted voice interaction method, server, vehicle and storage medium
CN111890373A (en) * 2020-09-29 2020-11-06 常州唯实智能物联创新中心有限公司 Sensing and positioning method of vehicle-mounted mechanical arm
WO2022074448A1 (en) * 2020-10-06 2022-04-14 Mark Oleynik Robotic kitchen hub systems and methods for minimanipulation library adjustments and calibrations of multi-functional robotic platforms for commercial and residential environments with artificial intelligence and machine learning
CN112298059A (en) * 2020-10-26 2021-02-02 武汉华星光电技术有限公司 Vehicle-mounted display screen adjusting device and vehicle
CN113669572A (en) * 2021-07-01 2021-11-19 华人运通(江苏)技术有限公司 Adjusting device of vehicle-mounted screen, vehicle-mounted display device and vehicle
CN113752265B (en) * 2021-10-13 2024-01-05 国网山西省电力公司超高压变电分公司 Method, system and device for planning obstacle avoidance path of mechanical arm
CN116061820A (en) * 2021-11-01 2023-05-05 华人运通(江苏)技术有限公司 Control method, device and system of vehicle, mechanical arm and vehicle
CN113778416A (en) * 2021-11-11 2021-12-10 深圳市越疆科技有限公司 Mechanical arm carrying script generation method and device based on graphical programming

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024002297A1 (en) * 2021-11-01 2024-01-04 华人运通(江苏)技术有限公司 Method and apparatus for controlling vehicle-mounted robot arm, and vehicle-mounted display device and vehicle

Also Published As

Publication number Publication date
CN116061819A (en) 2023-05-05
WO2024002276A1 (en) 2024-01-04
CN116061170A (en) 2023-05-05
CN116061168A (en) 2023-05-05
CN116061821A (en) 2023-05-05
WO2024002273A1 (en) 2024-01-04
CN116061820A (en) 2023-05-05
CN116061823A (en) 2023-05-05
CN116061167A (en) 2023-05-05
WO2024002297A1 (en) 2024-01-04
CN116061827A (en) 2023-05-05
CN116061826A (en) 2023-05-05
CN116061828A (en) 2023-05-05
WO2024002303A1 (en) 2024-01-04
CN116061822A (en) 2023-05-05
CN116061825A (en) 2023-05-05
CN116061829A (en) 2023-05-05
CN116061824A (en) 2023-05-05

Similar Documents

Publication Publication Date Title
CN116061169A (en) Script sequence processing method and device, electronic equipment and vehicle
US9340126B2 (en) Autonomous vehicle with reconfigurable seats
US9227531B2 (en) Autonomous vehicle with reconfigurable seats
US20160264021A1 (en) Autonomous Vehicle Seating System
US20190064637A1 (en) Gimbal control method, gimbal control apparatus, and gimbal
US9199553B2 (en) Autonomous vehicle with reconfigurable seats
WO2018159017A1 (en) Vehicle display control device, vehicle display system, vehicle display control method and program
WO2020195625A1 (en) Information processing device, information processing method, and information processing program
CN108394456A (en) Non-autonomous steering pattern
US20210001490A1 (en) Motion retargeting control for human-robot interaction
US11027430B2 (en) Systems and methods for latency compensation in robotic teleoperation
WO2024002306A1 (en) Control method and apparatus for vehicle-mounted mechanical arm, vehicle-mounted display device, and vehicle
JP2015093364A (en) On-vehicle robot
US20160207205A1 (en) Simulator
KR101902287B1 (en) Apparatus and method for displaying in vehicle
CN118106949A (en) Control method of mechanical arm, vehicle and electronic equipment
TW202414030A (en) Scene display method, device, electronic equipment and storage medium
WO2024113839A1 (en) Control method for mechanical arm, and vehicle and electronic device
WO2024089890A1 (en) Remote operation system and remote operation method
JP2018186432A (en) Display controller
JP2022088089A (en) Control device, vehicle and program
WO2024096900A1 (en) Visual representation and control enabled by remote computation and rendering
CN116068765A (en) Visual field blind area display method, device, equipment, vehicle and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination