CN113636421A - Method and apparatus for transmitting information - Google Patents

Method and apparatus for transmitting information Download PDF

Info

Publication number
CN113636421A
CN113636421A CN202110958838.1A CN202110958838A CN113636421A CN 113636421 A CN113636421 A CN 113636421A CN 202110958838 A CN202110958838 A CN 202110958838A CN 113636421 A CN113636421 A CN 113636421A
Authority
CN
China
Prior art keywords
human body
target
elevator car
target human
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110958838.1A
Other languages
Chinese (zh)
Other versions
CN113636421B (en
Inventor
佟莎莎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Baidu Online Network Technology Beijing Co Ltd
Original Assignee
Baidu Online Network Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Baidu Online Network Technology Beijing Co Ltd filed Critical Baidu Online Network Technology Beijing Co Ltd
Priority to CN202110958838.1A priority Critical patent/CN113636421B/en
Publication of CN113636421A publication Critical patent/CN113636421A/en
Application granted granted Critical
Publication of CN113636421B publication Critical patent/CN113636421B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B1/00Control systems of elevators in general
    • B66B1/02Control systems without regulation, i.e. without retroactive action
    • B66B1/06Control systems without regulation, i.e. without retroactive action electric
    • B66B1/14Control systems without regulation, i.e. without retroactive action electric with devices, e.g. push-buttons, for indirect control of movements
    • B66B1/16Control systems without regulation, i.e. without retroactive action electric with devices, e.g. push-buttons, for indirect control of movements with means for storing pulses controlling the movements of a single car or cage
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B1/00Control systems of elevators in general
    • B66B1/34Details, e.g. call counting devices, data transmission from car to control system, devices giving information to the control system
    • B66B1/3415Control system configuration and the data transmission or communication within the control system
    • B66B1/3423Control system configuration, i.e. lay-out
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B66HOISTING; LIFTING; HAULING
    • B66BELEVATORS; ESCALATORS OR MOVING WALKWAYS
    • B66B5/00Applications of checking, fault-correcting, or safety devices in elevators
    • B66B5/0006Monitoring devices or performance analysers
    • B66B5/0012Devices monitoring the users of the elevator system

Abstract

The embodiment of the disclosure discloses a method and a device for sending information. One embodiment of the method comprises: responding to the received target floor information sent by a user through an operation panel in the elevator car, and acquiring a video in the elevator car; identifying the acquired video, and determining a target human body from the acquired video according to an identification result; responding to the situation that the target floor is reached after the first preset time of the elevator car is predicted, and determining whether the time for the target human body to watch the floor display screen in the elevator car exceeds a second preset time or not based on the acquired video; responding to the fact that the time length that a target human body is watched on the floor display screen does not exceed a second preset time length, and determining that the elevator door is opened after the elevator car reaches the target floor, and determining whether the target human body leaves the elevator car or not according to a human body tracking result aiming at the target human body; in response to determining that the target human body does not leave the elevator car, a prompt is sent. The implementation realizes the sending of the prompt message.

Description

Method and apparatus for transmitting information
The application is a divisional application of a method and a device for sending information, the application date of the original application is 2019, 02, 28, the application number of the original application is CN201910148754.4, and the invention creation name of the original application is as follows: methods and apparatus for transmitting information.
Technical Field
The disclosed embodiments relate to the field of computer technologies, and in particular, to a method and an apparatus for transmitting information.
Background
With the development of modern society, elevators are more and more important in daily work and life of people, and are particularly indispensable for people working or living in high-rise buildings.
Generally, after entering an elevator car, a user transmits floor information of a destination floor to which the user wants to go by using an operation panel in the elevator car. And then, the elevator car is taken to reach the target floor, and after the elevator car reaches the target floor, the elevator door is opened so as to facilitate the user to leave the elevator car. However, some users, after entering the elevator car, are always dedicated to doing something, such as watching a mobile phone, reading a book, getting lost, etc., often neglect that the elevator has reached the destination floor to which it is going and has opened the door, which results in the user missing the opportunity to get off the elevator at the destination floor.
Disclosure of Invention
The embodiment of the disclosure provides a method and a device for sending information.
In a first aspect, an embodiment of the present disclosure provides a method for sending information, where the method includes: responding to the received target floor information sent by a user through an operation panel in the elevator car, and acquiring a video in the elevator car; identifying the acquired video, and determining a target human body from the acquired video according to an identification result; responding to the situation that the target floor is reached after the first preset time of the elevator car is predicted, and determining whether the time of the target human body watching the floor display screen in the elevator car exceeds a second preset time or not based on the acquired video; responding to the fact that the time length that the target human body is watched on the floor display screen does not exceed a second preset time length, determining that an elevator door is opened after the elevator car reaches the target floor, and determining whether the target human body leaves the elevator car or not according to a human body tracking result aiming at the target human body; and sending prompt information in response to the fact that the target human body does not leave the elevator car.
In some embodiments, the above method further comprises: and responding to the fact that the time length that the target human body gazes at the floor display screen exceeds a second preset time length, and determining that the elevator door is opened after the elevator car reaches the target floor, and determining not to send prompt information.
In some embodiments, the identifying the acquired video and determining the target human body from the acquired video according to the identification result includes: and performing human behavior recognition based on the acquired video, and taking a human body operating the operation panel as a target human body.
In some embodiments, the determining whether the duration of the target human body gazing at the floor display screen in the elevator car exceeds a second preset duration based on the acquired video includes: for the video frame of the acquired video, identifying the face angle of the target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; in response to the fact that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame; and in response to the fact that the number of the continuous occurrence frames of the target video frames in the acquired video exceeds a preset frame number threshold, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
In some embodiments, the human tracking result includes the presence and absence of a target human; and the determining whether the target human body leaves the elevator car according to the human body tracking result for the target human body includes: determining that the target human body does not leave the elevator car in response to determining that the human body tracking result is that the target human body exists; and determining that the target human body has left the elevator car in response to determining that the human body tracking result is that the target human body disappears.
In a second aspect, an embodiment of the present disclosure provides an apparatus for transmitting information, where the apparatus includes: the elevator control device comprises an acquisition unit, a control unit and a control unit, wherein the acquisition unit is configured to respond to the received target floor information sent by a user through an operation panel in an elevator car and acquire a video in the elevator car; an identification unit configured to identify the acquired video and determine a target human body from the acquired video according to an identification result; a first determination unit configured to determine whether a duration in which the target human body gazes at a floor display screen in the elevator car exceeds a second preset duration based on the acquired video in response to the target floor being reached after the elevator car is predicted for a first preset duration; a second determination unit configured to determine whether the target human body leaves the elevator car according to a human body tracking result for the target human body in response to determining that a time period for which the target human body gazes at the floor display screen does not exceed a second preset time period and determining that an elevator door is opened after the elevator car reaches the target floor; a transmitting unit configured to transmit a prompt message in response to determining that the target human body does not leave the elevator car.
In some embodiments, the above apparatus further comprises: and the third determining unit is configured to respond to the fact that the time length of the target human body watching the floor display screen exceeds a second preset time length and the elevator door is opened after the elevator car reaches the target floor, and determine not to send prompt information.
In some embodiments, the above-mentioned identification unit is further configured to: and performing human behavior recognition based on the acquired video, and taking a human body operating the operation panel as a target human body.
In some embodiments, the first determining unit is further configured to: for the video frame of the acquired video, identifying the face angle of the target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; in response to the fact that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame; and in response to the fact that the number of the continuous occurrence frames of the target video frames in the acquired video exceeds a preset frame number threshold, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
In some embodiments, the human tracking result includes the presence and absence of a target human; and the second determination unit is further configured to: determining that the target human body does not leave the elevator car in response to determining that the human body tracking result is that the target human body exists; and determining that the target human body has left the elevator car in response to determining that the human body tracking result is that the target human body disappears.
In a third aspect, an embodiment of the present disclosure provides a terminal, where the terminal includes: one or more processors; a storage device, on which one or more programs are stored, which, when executed by the one or more processors, cause the one or more processors to implement the method as described in any implementation manner of the first aspect.
In a fourth aspect, the disclosed embodiments provide a computer-readable medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the method as described in any implementation manner of the first aspect.
According to the method and the device for sending information provided by the embodiment of the disclosure, if target floor information sent by a user through an operation panel in an elevator car is received, a video in the elevator car is obtained, the obtained video is identified, a target human body is determined from the video according to an identification result, if the target floor is reached after a first preset time of the elevator car is predicted, whether the time length of the target human body for watching a floor display screen in the elevator car exceeds a second preset time length is determined on the basis of the obtained video, if the time length of the target human body for watching the floor display screen does not exceed the second preset time length is determined, an elevator door is opened after the elevator car reaches the target floor, whether the target human body leaves the elevator car is determined according to a human body tracking result aiming at the target human body, if the target human body is determined not to leave the elevator car, prompt information is sent, therefore, the prompt information is sent under the condition that the target human body watching floor display screen does not exceed the second preset time and does not leave at the target floor, so that the target human body elevator car is prompted to reach the target floor.
Drawings
Other features, objects and advantages of the disclosure will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is an exemplary system architecture diagram in which one embodiment of the present disclosure may be applied;
FIG. 2 is a flow diagram for one embodiment of a method for transmitting information, according to the present disclosure;
FIG. 3 is a schematic diagram of one application scenario of a method for transmitting information according to the present disclosure;
FIG. 4 is a flow diagram of yet another embodiment of a method for transmitting information according to the present disclosure;
FIG. 5 is a schematic block diagram illustrating one embodiment of an apparatus for transmitting information according to the present disclosure;
FIG. 6 is a block diagram of a computer system suitable for use in implementing a terminal device of an embodiment of the disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 illustrates an exemplary system architecture 100 of a method for transmitting information or an apparatus for transmitting information to which embodiments of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The terminal devices 101, 102, 103 may interact with the server 105 via the network 104 to receive or send messages or the like. The terminal devices 101, 102, 103 can be installed with elevator operation control programs to control the normal and stable operation of the elevator.
The terminal apparatuses 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices having elevator control functions, including but not limited to computers, elevator control cabinets, and the like. When the terminal apparatuses 101, 102, 103 are software, they can be installed in the electronic apparatuses listed above. It may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services) or as a single piece of software or software module. And is not particularly limited herein.
The server 105 may be a server providing various services, such as a background server providing support for information sent on the terminal devices 101, 102, 103. The backend server may analyze and otherwise process the received data such as video, and feed back the processing result (e.g., the prompt information) to the terminal apparatuses 101, 102, and 103.
The server 105 may be hardware or software. When the server 105 is hardware, it may be implemented as a distributed server cluster composed of a plurality of servers, or may be implemented as a single server. When the server 105 is software, it may be implemented as multiple pieces of software or software modules (e.g., to provide distributed services), or as a single piece of software or software module. And is not particularly limited herein.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
It should be noted that the method for sending information provided by the embodiments of the present disclosure is generally performed by the terminal devices 101, 102, 103, and accordingly, the apparatus for sending information is generally disposed in the terminal devices 101, 102, 103.
With continued reference to fig. 2, a flow 200 of one embodiment of a method for transmitting information in accordance with the present disclosure is shown. The method for transmitting information comprises the following steps:
step 201, in response to receiving the target floor information sent by the user through the operation panel in the elevator car, obtaining the video in the elevator car.
In this embodiment, the execution subject of the method for transmitting information (e.g., the terminal devices 101, 102, 103 shown in fig. 1) can receive the destination floor information transmitted by the user through the operation panel in the elevator car by a wired connection manner or a wireless connection manner. Thereafter, the execution body can acquire a video acquired by the image acquisition device (e.g., a camera) installed in the elevator car.
In practice, a camera can be installed in the elevator car of the elevator, and the camera can collect videos in the elevator car. For example, a camera may be mounted on top of an elevator car so that the camera may capture video of elevator occupants within the elevator car and send the captured video to the executive.
Generally, after a user has carried out an elevator car, destination floor information, which is floor information of a destination floor to which the user intends to go, is transmitted by using an operation panel in the elevator car. Generally, an operation panel in the elevator car is disposed at both sides of an entrance of the elevator car, and the operation panel may include a plurality of buttons, and the buttons may be marked with numbers corresponding to floors, door opening marks, door closing marks, or the like.
And 202, identifying the acquired video, and determining a target human body from the acquired video according to an identification result.
In this embodiment, the execution subject may recognize a video frame of the acquired video and determine the target human body from the acquired video according to the recognition result. As an example, the executing subject may first perform human detection on a video frame of the acquired video, resulting in at least one human frame. Then, the execution subject may recognize a target human body frame from the at least one human body frame, and use a human body corresponding to the target human body frame as a target human body. For example, after receiving the target floor information sent by the user through the operation panel in the elevator car, the execution main body may identify a human body frame closest to the operation panel in the acquired first video frame in the elevator car as a target human body frame, and use a human body corresponding to the target human body frame as the target human body. In general, the user closest to the operation panel at this time is the target user who transmits the target floor information, that is, the human body of the target user is the target human body.
In some optional implementations of this embodiment, the step 202 may specifically be performed as follows: and performing human behavior recognition based on the acquired video, and taking a human body operating the operation panel as a target human body.
In this implementation, the execution main body may perform human behavior recognition on a human body in the acquired video by using various behavior recognition methods, and use the human body operating the operation panel as a target human body. As an example, a conventional behavior recognition method, such as a template-based method, a probability statistics-based method, a semantic-based method, and the like, may be employed, and a human behavior recognition algorithm based on deep learning may also be employed.
And 203, responding to the situation that the target floor is reached after the first preset time length of the elevator car is predicted, and determining whether the time length that the target human body watches the floor display screen in the elevator car exceeds a second preset time length or not based on the acquired video.
In this embodiment, the executive agent may predict that the elevator car reaches the target floor after a first preset length of time. For example, the executive body can predict the time of the elevator car reaching each floor according to the information of the position, the running speed, the number of floors to be stopped midway and the like of the elevator car. If the executive agent predicts that the elevator car will reach the target floor after the first preset duration, the executive agent may further determine whether the duration that the target human is gazing at the floor display screen within the elevator car exceeds a second preset duration based on the acquired video. As an example, the executive may utilize existing eye tracking technology to determine whether the eyes of the target person are looking at the floor display within the elevator car. Here, the first preset time period and the second preset time period may be set according to actual needs, and are not limited herein.
In practice, for the convenience of elevator passengers, a floor display screen is often arranged in the elevator car and used for displaying the floor reached by the elevator car at the current time.
In some optional implementation manners of this embodiment, in step 203, based on the obtained video, it is determined whether a duration that the target human body gazes at the floor display screen in the elevator car exceeds a second preset duration, which may include the following:
firstly, for a video frame of an acquired video, identifying a face angle of a target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; and in response to determining that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame.
In this implementation, when the execution subject predicts that the elevator car will reach the target floor after the first preset time period, for each video frame of the currently acquired video, the face angle of the target human body in the video frame may be identified in various manners, for example, a template-based method, a face set feature-based method, a deep learning-based method, and the like, so as to determine whether the face angle of the target human body in the video frame is within the preset angle range. And if the face angle of the target human body in the video frame is determined to be in a preset angle range, marking the video frame as a target video frame. Here, the preset angle range may be related to the installation position of the floor display screen in the elevator car. As an example, the preset angle range may be obtained by a technician based on statistics of the face angles of a plurality of users looking at the floor display screen in the elevator car.
Then, in response to determining that the number of frames of the target video frames in the acquired video continuously appears exceeds a preset frame number threshold, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
In the implementation mode, the execution main body can count whether the number of continuous frames of the target video frames in the obtained video exceeds a preset frame number threshold value, and if the number of continuous frames of the target video frames in the obtained video exceeds the preset frame number threshold value, the duration that the target human body watches the floor display screen in the elevator car is determined to exceed a second preset duration. Here, the frame number threshold may be determined according to a second preset duration. For example, the frame number threshold may be a product of the second preset duration and the video frame rate of the acquired video.
And 204, in response to the fact that the time length that the target human body watches the floor display screen does not exceed the second preset time length and the fact that the elevator door is opened after the elevator car reaches the target floor, determining whether the target human body leaves the elevator car or not according to the human body tracking result aiming at the target human body.
In this embodiment, if it is determined that the time period for which the target human body gazes at the floor display screen does not exceed the second preset time period, and at the same time, it is determined that the elevator car has reached the target floor and the elevator door has been opened, the execution main body may determine whether the target human body leaves the elevator car according to the human body tracking result for the target human body. As an example, the execution subject, after determining the target human body, may track the target human body based on the acquired video to determine whether the target human body leaves the elevator car. For example, when tracking a target human body, if the target human body disappears from a video, it can be determined that the target human body has left the elevator car.
In some optional implementations of the present embodiment, the human tracking result may include the presence and absence of the target human. And step 204, determining whether the target human body leaves the elevator car according to the human body tracking result aiming at the target human body, wherein the method specifically comprises the following steps:
1) and in response to determining that the human tracking result is that the target human exists, determining that the target human does not leave the elevator car.
In this implementation, the execution subject may determine that the target human body does not leave the elevator car if it is determined that the human body tracking result is that the target human body exists.
2) And in response to determining that the human tracking result is that the target human disappears, determining that the target human has left the elevator car.
In this implementation, the execution subject may determine that the target human body has left the elevator car if it is determined that the human body tracking result is that the target human body disappears.
And step 205, responding to the fact that the target human body does not leave the elevator car, and sending prompt information.
In this embodiment, if it is determined that the target human body does not leave the elevator car, the execution main body may send a prompt message to the playback device in the elevator car for the playback device to present. If it is determined that the target human body has left the elevator car, the execution subject may determine not to send the prompt message to the playback device within the elevator car.
Here, the prompt information may be information in a voice form. Taking the playing device as an example of a loudspeaker, the execution main body can send voice prompt information to the loudspeaker, and the voice prompt information is played by the loudspeaker to prompt that a target human body elevator car in the elevator car reaches a target floor. As an example, the playback device may play the voice guidance information multiple times in succession.
With continued reference to fig. 3, fig. 3 is a schematic diagram of an application scenario of the method for transmitting information according to the present embodiment. In the application scenario of fig. 3, after the user enters the elevator car, the destination floor information "12" is transmitted to the terminal device 301 through the operation panel in the elevator car. In response to receiving the destination floor information "12" transmitted by the user, the terminal device 301 may acquire the video within the elevator car. After that, the terminal device 301 may recognize the acquired video and determine the target human body a from the acquired video according to the recognition result. In response to predicting the elevator car to reach the target floor 12 after the first preset duration "2 minutes", the terminal device 301 may determine whether the duration that the target human body a gazes at the floor display screen in the elevator car exceeds the second preset duration "1 second" based on the acquired video. If it is determined that the time length that the target human body A gazes at the floor display screen does not exceed the second preset time length of 1 second, and it is determined that the elevator door is opened after the elevator car reaches the target floor of 12 floors, the terminal device 301 may determine whether the target human body A leaves the elevator car according to the human body tracking result for the target human body A. If it is determined that the target human body a does not leave the elevator car, the terminal device 301 may send a voice prompt message "you are good, floor 12 has been reached" to a speaker in the elevator car.
The method provided by the embodiment of the disclosure realizes that the prompt message is sent when the target human body watching floor display screen does not exceed the second preset time and does not leave at the target floor, so as to prompt that the target human body elevator car reaches the target floor.
With further reference to fig. 4, a flow 400 of yet another embodiment of a method for transmitting information is shown. The process 400 of the method for transmitting information includes the steps of:
and step 401, in response to receiving the target floor information sent by the user through the operation panel in the elevator car, acquiring a video in the elevator car.
In this embodiment, step 401 is similar to step 201 of the embodiment shown in fig. 2, and is not described here again.
And 402, identifying the acquired video, and determining a target human body from the acquired video according to an identification result.
In this embodiment, step 402 is similar to step 202 of the embodiment shown in fig. 2, and is not described herein again.
And 403, in response to the fact that the target floor is reached after the first preset time length of the elevator car is predicted, determining whether the time length that the target human body watches the floor display screen in the elevator car exceeds a second preset time length or not based on the acquired video.
In this embodiment, step 403 is similar to step 203 of the embodiment shown in fig. 2, and is not described herein again.
And step 404, in response to the fact that the time length that the target human body watches the floor display screen does not exceed the second preset time length and the fact that the elevator door is opened after the elevator car reaches the target floor, determining whether the target human body leaves the elevator car according to the human body tracking result aiming at the target human body.
In this embodiment, step 404 is similar to step 204 of the embodiment shown in fig. 2, and is not described here again.
Step 405, in response to determining that the target human body does not leave the elevator car, sending a prompt message.
In this embodiment, step 405 is similar to step 205 of the embodiment shown in fig. 2, and is not described herein again.
And step 406, in response to the fact that the time length that the target human body gazes at the floor display screen exceeds a second preset time length and the fact that the elevator door is opened after the elevator car reaches the target floor, determining not to send prompt information.
In this embodiment, if it is determined that the time period during which the target human body gazes at the floor display screen in the elevator car exceeds the second preset time period while it is determined that the elevator car has reached the target floor and the elevator door has been opened, the execution main body may determine not to send the prompt message. That is, in the case where it is determined that the target human body has viewed the floor display screen, no prompt message is sent regardless of whether the target human body has left the elevator at the target floor.
As can be seen from fig. 4, compared with the embodiment corresponding to fig. 2, the flow 400 of the method for sending information in the present embodiment highlights a step of not sending the prompt message in case that the target human body has looked at the floor display for more than the second preset time period. Therefore, the scheme described by the embodiment can send the prompt message more specifically, and unnecessary disturbance to passengers in the elevator car is reduced.
With further reference to fig. 5, as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of an apparatus for sending information, which corresponds to the method embodiment shown in fig. 2, and which is particularly applicable in various electronic devices.
As shown in fig. 5, the apparatus 500 for transmitting information of the present embodiment includes: an acquisition unit 501, a recognition unit 502, a first determination unit 503, a second determination unit 504, and a transmission unit 505. The obtaining unit 501 is configured to obtain a video in the elevator car in response to receiving target floor information sent by a user through an operation panel in the elevator car; the recognition unit 502 is configured to recognize the acquired video, and determine a target human body from the acquired video according to a recognition result; the first determination unit 503 is configured to determine whether the target human body watches the floor display screen in the elevator car for a time period exceeding a second preset time period based on the acquired video in response to the target floor being reached after the elevator car is predicted to reach the first preset time period; a second determination unit 504 configured to determine whether the target human body leaves the elevator car according to a human body tracking result for the target human body in response to determining that a time period for which the target human body gazes at the floor display screen does not exceed a second preset time period and determining that an elevator door is opened after the elevator car reaches the target floor; the transmitting unit 505 is configured to transmit a prompt message in response to determining that the target human body does not leave the elevator car.
In this embodiment, specific processes of the obtaining unit 501, the identifying unit 502, the first determining unit 503, the second determining unit 504, and the sending unit 505 of the apparatus 500 for sending information and technical effects brought by the specific processes may refer to related descriptions of step 201, step 202, step 203, step 204, and step 205 in the corresponding embodiment of fig. 2, which are not described herein again.
In some optional implementations of this embodiment, the apparatus 500 further includes: and a third determining unit (not shown in the figure) configured to determine not to send the prompt message in response to determining that the time length for which the target human body gazes at the floor display screen exceeds a second preset time length and determining that the elevator door is opened after the elevator car reaches the target floor.
In some optional implementations of the present embodiment, the identifying unit 502 is further configured to: and performing human behavior recognition based on the acquired video, and taking a human body operating the operation panel as a target human body.
In some optional implementations of the present embodiment, the first determining unit 503 is further configured to: for the video frame of the acquired video, identifying the face angle of the target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; in response to the fact that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame; and in response to the fact that the number of the continuous occurrence frames of the target video frames in the acquired video exceeds a preset frame number threshold, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
In some optional implementations of the present embodiment, the human body tracking result includes the presence and absence of a target human body; and the second determining unit 504 is further configured to: determining that the target human body does not leave the elevator car in response to determining that the human body tracking result is that the target human body exists; and determining that the target human body has left the elevator car in response to determining that the human body tracking result is that the target human body disappears.
Referring now to fig. 6, shown is a schematic diagram of an electronic device (e.g., terminal device in fig. 1) 600 suitable for use in implementing embodiments of the present disclosure. The terminal device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the use range of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 may include a processing means (e.g., central processing unit, graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data necessary for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 600 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 6 may represent one device or may represent multiple devices as desired.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 609, or may be installed from the storage means 608, or may be installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of embodiments of the present disclosure.
It should be noted that the computer readable medium described in the embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In embodiments of the present disclosure, however, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: responding to the received target floor information sent by a user through an operation panel in the elevator car, and acquiring a video in the elevator car; identifying the acquired video, and determining a target human body from the acquired video according to an identification result; responding to the situation that the target floor is reached after the first preset time of the elevator car is predicted, and determining whether the time of the target human body watching the floor display screen in the elevator car exceeds a second preset time or not based on the acquired video; responding to the fact that the time length that the target human body is watched on the floor display screen does not exceed a second preset time length, determining that an elevator door is opened after the elevator car reaches the target floor, and determining whether the target human body leaves the elevator car or not according to a human body tracking result aiming at the target human body; and sending prompt information in response to the fact that the target human body does not leave the elevator car.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. The described units may also be provided in a processor, and may be described as: a processor includes an acquisition unit, a recognition unit, a first determination unit, a second determination unit, and a transmission unit. The names of the units do not form a limitation on the units themselves in some cases, and for example, the identification unit may be further described as "a unit that identifies the acquired video and determines the target human body from the acquired video according to the identification result".
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept as defined above. For example, the above features and (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.

Claims (10)

1. A method for transmitting information, comprising:
responding to the received target floor information sent by a user through an operation panel in the elevator car, and acquiring a video in the elevator car;
performing human behavior recognition based on the acquired video, and taking a human body operating an operation panel as a target human body;
in response to the target floor being reached after the first preset duration of the elevator car is predicted, determining whether the duration of the target human body gazing at a floor display screen in the elevator car exceeds a second preset duration based on the acquired video;
in response to the fact that the time length that the target human body is watched on the floor display screen does not exceed a second preset time length and the fact that the elevator door is opened after the elevator car reaches the target floor, whether the target human body leaves the elevator car or not is determined according to a human body tracking result aiming at the target human body;
in response to determining that the target human body does not leave the elevator car, sending a prompt message.
2. The method of claim 1, wherein the method further comprises:
and responding to the fact that the time length that the target human body gazes at the floor display screen exceeds a second preset time length, and determining that the elevator door is opened after the elevator car reaches the target floor, and determining not to send prompt information.
3. The method of claim 1, wherein the determining whether the target human body is gazing at a floor display screen within the elevator car for more than a second preset duration based on the acquired video comprises:
for the video frame of the acquired video, identifying the face angle of the target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; in response to the fact that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame;
and in response to the fact that the number of frames of the target video frames in the obtained video exceeds a preset frame number threshold value, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
4. The method of claim 1, wherein the human tracking results include a target human presence and a target human disappearance; and
the determining whether the target human body leaves the elevator car according to the human body tracking result for the target human body includes:
in response to determining that the human tracking result is that a target human is present, determining that the target human does not leave the elevator car;
determining that the target human body has left the elevator car in response to determining that the human body tracking result is that the target human body is disappeared.
5. An apparatus for transmitting information, comprising:
an acquisition unit configured to acquire a video within an elevator car in response to receiving target floor information sent by a user through an operation panel within the elevator car;
a recognition unit configured to perform human behavior recognition based on the acquired video, with a human body operating the operation panel as a target human body;
a first determination unit configured to determine whether a duration in which the target human body gazes at a floor display screen within the elevator car exceeds a second preset duration based on the acquired video in response to the target floor being reached after the elevator car is predicted for a first preset duration;
a second determination unit configured to determine whether the target human body leaves the elevator car according to a human body tracking result for the target human body in response to determining that a time period for which the target human body gazes at the floor display screen does not exceed a second preset time period and determining that an elevator door is opened after the elevator car reaches the target floor;
a transmitting unit configured to transmit a prompt message in response to determining that the target human body does not leave the elevator car.
6. The apparatus of claim 5, wherein the apparatus further comprises:
a third determination unit configured to determine not to send a prompt message in response to determining that a time period for the target human body to gaze at the floor display screen exceeds a second preset time period and determining that an elevator door is opened after the elevator car reaches the target floor.
7. The apparatus of claim 5, wherein the first determining unit is further configured to:
for the video frame of the acquired video, identifying the face angle of the target human body in the video frame, and determining whether the face angle of the target human body in the video frame is within a preset angle range; in response to the fact that the face angle of the target human body in the video frame is within a preset angle range, marking the video frame as a target video frame;
and in response to the fact that the number of frames of the target video frames in the obtained video exceeds a preset frame number threshold value, determining that the time length of the target human body watching the floor display screen in the elevator car exceeds a second preset time length.
8. The apparatus of claim 5, wherein the human tracking result includes a target human presence and a target human disappearance; and
the second determination unit is further configured to:
in response to determining that the human tracking result is that a target human is present, determining that the target human does not leave the elevator car;
determining that the target human body has left the elevator car in response to determining that the human body tracking result is that the target human body is disappeared.
9. A terminal, comprising:
one or more processors;
a storage device having one or more programs stored thereon,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-4.
10. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of any one of claims 1-4.
CN202110958838.1A 2019-02-28 2019-02-28 Method and apparatus for transmitting information Active CN113636421B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110958838.1A CN113636421B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110958838.1A CN113636421B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information
CN201910148754.4A CN109693981B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201910148754.4A Division CN109693981B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information

Publications (2)

Publication Number Publication Date
CN113636421A true CN113636421A (en) 2021-11-12
CN113636421B CN113636421B (en) 2023-01-13

Family

ID=66233695

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201910148754.4A Active CN109693981B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information
CN202110958838.1A Active CN113636421B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201910148754.4A Active CN109693981B (en) 2019-02-28 2019-02-28 Method and apparatus for transmitting information

Country Status (1)

Country Link
CN (2) CN109693981B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114920096A (en) * 2022-05-14 2022-08-19 云知声智能科技股份有限公司 Elevator control method and device based on intelligent large screen, electronic equipment and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111186730B (en) * 2020-01-20 2022-09-16 赣州市耀灵天华数字经济技术有限公司 Elevator control method and elevator control system based on human body tracking and automatic allocation
CN111924673B (en) * 2020-07-15 2022-08-19 重庆锐云科技有限公司 Linkage elevator scheduling method, system, computer equipment and storage medium
CN113479732B (en) * 2021-07-01 2023-04-18 成都新潮传媒集团有限公司 Elevator control method, device and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5360051A (en) * 1976-11-10 1978-05-30 Hitachi Ltd Cage arrival guiding device for elevator
JPH11222362A (en) * 1998-02-05 1999-08-17 Hitachi Building Systems Co Ltd Display device for elevator
US6615175B1 (en) * 1999-06-10 2003-09-02 Robert F. Gazdzinski “Smart” elevator system and method
JP2007297213A (en) * 2006-04-28 2007-11-15 Inventio Ag Illuminating facility of elevator cage and method for guiding passenger in elevator
JP2010100370A (en) * 2008-10-22 2010-05-06 Hitachi Ltd Operation input device for elevator and method therefor
CN102046506A (en) * 2008-07-07 2011-05-04 三菱电机株式会社 Elevator control device and elevator control method
CN105270941A (en) * 2014-07-09 2016-01-27 东芝电梯株式会社 Elevator system
CN107265220A (en) * 2016-03-30 2017-10-20 株式会社日立大厦系统 Device is notified in the car of elevator
CN107963529A (en) * 2016-10-20 2018-04-27 奥的斯电梯公司 Building traffic analyzer

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2211985Y (en) * 1994-11-18 1995-11-08 宋晨路 Voice automatic floor teller for lift
JP5764852B1 (en) * 2014-06-10 2015-08-19 東芝エレベータ株式会社 Elevator hall call registration system
JP6006269B2 (en) * 2014-08-20 2016-10-12 東芝エレベータ株式会社 Elevator system
CN106744096A (en) * 2017-01-20 2017-05-31 百度在线网络技术(北京)有限公司 The control method and device of elevator operation
JP6972613B2 (en) * 2017-03-30 2021-11-24 日本電気株式会社 Elevator control device, elevator control system, control method and program
CN109117705B (en) * 2018-06-14 2021-01-19 浙江凯耀照明股份有限公司 System and method for recognizing sitting posture through desk lamp
CN109110591A (en) * 2018-09-21 2019-01-01 成都博美实润科技有限公司 A kind of elevator automatic identification resident floor device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5360051A (en) * 1976-11-10 1978-05-30 Hitachi Ltd Cage arrival guiding device for elevator
JPH11222362A (en) * 1998-02-05 1999-08-17 Hitachi Building Systems Co Ltd Display device for elevator
US6615175B1 (en) * 1999-06-10 2003-09-02 Robert F. Gazdzinski “Smart” elevator system and method
JP2007297213A (en) * 2006-04-28 2007-11-15 Inventio Ag Illuminating facility of elevator cage and method for guiding passenger in elevator
CN102046506A (en) * 2008-07-07 2011-05-04 三菱电机株式会社 Elevator control device and elevator control method
JP2010100370A (en) * 2008-10-22 2010-05-06 Hitachi Ltd Operation input device for elevator and method therefor
CN101723216A (en) * 2008-10-22 2010-06-09 株式会社日立制作所 Operation input device for elevator and operation input method
CN105270941A (en) * 2014-07-09 2016-01-27 东芝电梯株式会社 Elevator system
CN107265220A (en) * 2016-03-30 2017-10-20 株式会社日立大厦系统 Device is notified in the car of elevator
CN107963529A (en) * 2016-10-20 2018-04-27 奥的斯电梯公司 Building traffic analyzer

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114920096A (en) * 2022-05-14 2022-08-19 云知声智能科技股份有限公司 Elevator control method and device based on intelligent large screen, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN109693981B (en) 2021-10-01
CN113636421B (en) 2023-01-13
CN109693981A (en) 2019-04-30

Similar Documents

Publication Publication Date Title
CN109693981B (en) Method and apparatus for transmitting information
US10544007B2 (en) Risk-aware management of elevator operations
EP3693966B1 (en) System and method for continuous privacy-preserved audio collection
CN110430384B (en) Video call method and device, intelligent terminal and storage medium
US10778353B2 (en) Providing real-time audience awareness to speaker
WO2023273064A1 (en) Object speaking detection method and apparatus, electronic device, and storage medium
WO2020147521A1 (en) Image display method and apparatus
US11269591B2 (en) Artificial intelligence based response to a user based on engagement level
CN111599021A (en) Virtual space roaming guiding method and device and electronic equipment
CN104170375A (en) Architecture and system for group video distribution
KR20210042860A (en) Method, device and system for outputting information
CN112530205A (en) Airport parking apron airplane state detection method and device
CN112184519A (en) Travel monitoring method and device, electronic equipment and storage medium
EP4171048A1 (en) Video processing method and apparatus
CN113342170A (en) Gesture control method, device, terminal and storage medium
CN110363695B (en) Robot-based crowd queue control method and device
WO2020005016A1 (en) Method and system for conducting survey relating to urination, and non-transitory computer-readable recording medium
CN110196900A (en) Exchange method and device for terminal
US10904067B1 (en) Verifying inmate presence during a facility transaction
CN112019948A (en) Intercommunication device communication method, intercommunication device and storage medium
CN110401603B (en) Method and device for processing information
CN110677448A (en) Associated information pushing method, device and system
US20220309900A1 (en) Information processing device, information processing method, and program
JP6496220B2 (en) Information distribution apparatus and information distribution program
CN111312243B (en) Equipment interaction method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant