CN111695481A - Library seat management system and method based on image recognition - Google Patents

Library seat management system and method based on image recognition Download PDF

Info

Publication number
CN111695481A
CN111695481A CN202010501677.9A CN202010501677A CN111695481A CN 111695481 A CN111695481 A CN 111695481A CN 202010501677 A CN202010501677 A CN 202010501677A CN 111695481 A CN111695481 A CN 111695481A
Authority
CN
China
Prior art keywords
seat
image
library
module
image recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN202010501677.9A
Other languages
Chinese (zh)
Inventor
严梓峻
丁伟杰
汪雄
朱敏杰
吕德潮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Shaoxing
Original Assignee
University of Shaoxing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Shaoxing filed Critical University of Shaoxing
Priority to CN202010501677.9A priority Critical patent/CN111695481A/en
Publication of CN111695481A publication Critical patent/CN111695481A/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/02Reservations, e.g. for tickets, services or events
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Abstract

The invention discloses a library seat management system and method based on image recognition. Through installing image acquisition equipment in the indoor subregion of library's reading, can gather each regional seat image, analysis and treatment through core control module can obtain the seat image recognition result to each region, transmit to high in the clouds server through wireless WIFI transmission module, can obtain seat occupation information, the reader can use mobile terminal to look over the seat occupation condition, can also select, predetermine, reserve the seat, and the completion accounts for the seat identity and verifies, thereby it is orderly, the efficient carries out intelligent management to the library seat, and then improved seat utilization ratio in the library.

Description

Library seat management system and method based on image recognition
Technical Field
The invention relates to the technical field of image processing and seat management, in particular to a library seat management system and method based on image recognition.
Background
In recent years, with the increasing of enrollment scale in colleges and universities, along with the increasingly fierce social competition, more and more students continuously rush to 'charge' the library to deal with various examinations or autonomous learning so as to improve the competitiveness or enrich the self-learning, meanwhile, the library attracts a large number of readers to learn from the library due to the advantages of quiet reading environment, large amount of learning resources, strong learning atmosphere and the like, but because the number of reading room seats in the library is limited, the number of readers is far larger than the number of the seats, the supply and demand of the reading room seats in the library are unbalanced, the queuing order before opening the library is disordered, the occupation of readers causes increasingly prominent problems, and the 'examination week' period is particularly serious, so that the contradictions between library staff and readers, and readers are caused.
At present, computer management is basically realized on other resources of a library, only seat resources are still occupied in a manual management stage, a large amount of manpower and material resources are consumed, although a manager can properly clean seats which are unoccupied but occupied, part of unconscious students still can occupy more seats by one person, meanwhile, students who need seats can learn by no seat, and limited resources are not reasonably utilized.
Therefore, how to provide a more intelligent, efficient and convenient library seat management scheme is a problem that needs to be solved urgently by the technical personnel in the field.
Disclosure of Invention
In view of the above, the invention provides a library seat management system based on image recognition, which enables readers to use mobile terminals to complete seat checking, reserving, verifying and reserving functions, enables the seat management process to be more scientific and ordered, and solves the problems of insufficient intelligence, low efficiency, insufficient effect and the like of the existing seat management method.
In order to achieve the purpose, the invention adopts the following technical scheme:
in one aspect, the present invention provides a library seat management system based on image recognition, the system comprising: the system comprises image acquisition equipment, a core control module, a wireless WIFI transmission module, a cloud server and a mobile terminal;
the image acquisition devices are distributed in front of a plurality of seats in a library reading room in regions and are used for periodically acquiring seat images of corresponding regions;
the core control module is used for receiving seat images acquired by the image acquisition equipment, carrying out face recognition and processing on the received seat images, judging whether a person exists in each seat position or not and obtaining an image recognition result;
the wireless WIFI transmission module is used for uploading the image identification result obtained by the core control module to the cloud server;
the cloud server is used for receiving the image recognition result uploaded by the wireless WIFI transmission module, storing and analyzing the image recognition result in real time to obtain seat occupation information, and providing information link and data support for the mobile terminal to achieve functions of registration and login, seat viewing, seat selection, seat reservation, verification and confirmation and seat reservation.
Further, the image acquisition device is an OV5647 camera. The camera has 500W pixels, the collected image is clear, and the camera is very suitable for detecting the face in the seat information in the later period.
Furthermore, the core control module comprises a timer, a central processing unit, a data memory and a power supply, and the timer, the data memory and the power supply are all electrically connected with the central processing unit;
the timer is used for setting image acquisition interval time, the central processing unit is respectively connected with the plurality of image acquisition devices, the central processing unit is used for controlling the image acquisition devices to regularly acquire seat images with preset quantity according to the set image acquisition interval time, preprocessing and face recognition analysis are carried out on the seat images, whether a person exists at each seat position in the seat images is judged, an image recognition result is obtained, the data storage device is used for storing the seat image data and the image recognition result in real time, and the power supply is used for supplying power to the central processing unit.
Further, the model of the WIFI transmission module is ESP 8266. The ESP8266 is an ultra-low power consumption UART-WIFI transparent transmission module, supports the wireless 802.11b/g/n standard, establishes two working modes of STA/AP, is internally provided with a TCP/IP protocol stack, and supports the standard TCP/UDP Server and Client. The module can improve the data transmission efficiency.
Further, the cloud server comprises:
the receiving module is used for receiving the image identification result uploaded by the wireless WIFI transmission module and the related request information sent by the mobile terminal;
the account management module is used for managing the registration login information and the account authority of the user;
the analysis module is used for analyzing and processing the image recognition result uploaded by the wireless WIFI transmission module to obtain seat occupation information;
the display module is used for adding different marks to seats in a library reading room according to the seat occupation information and displaying the seat occupation situation according to the request of the mobile terminal;
the database is used for storing the registration login information and the seat occupation information of the user;
the selection module is used for selecting a corresponding seat according to the request of the mobile terminal;
the reservation module is used for reserving a corresponding seat according to the request of the mobile terminal;
the verification module is used for verifying the user identity information according to the request of the mobile terminal;
the judging module is used for judging whether the user who selects or reserves the corresponding seat completes identity verification within a preset time period or not to obtain a seat occupying result and updating seat occupying information in real time;
the related request information comprises the requests of registration login, seat viewing, seat selection, seat reservation, verification confirmation, seat reservation and the like.
Further, when the relevant request information includes a seat reservation request, the cloud server further includes a reservation timing module for timing according to the reservation time and judging whether the user at the reserved seat position completes the authentication within the reservation time, if the authentication is completed, the seat occupancy information is reserved, and if the authentication is not completed, the seat occupancy information is released.
In another aspect, the present invention further provides a method for managing library seats based on image recognition, where the method uses the above-mentioned system for managing library seats based on image recognition, and includes:
dividing a library reading room into a plurality of areas, and regularly collecting seat images with preset number in each area according to set image collection interval time;
preprocessing and face recognition analysis are carried out on the seat image of each area, whether a person exists in each seat position is judged, and an image recognition result is obtained;
and storing and analyzing the image recognition result in real time to obtain seat occupation information, and displaying the seat occupation information in real time.
Further, the seat image is preprocessed, including converting the color image into a gray scale image, compressing the image and histogram equalization. The image enhancement is realized, the influence caused by illumination and the like is reduced, the subsequent image processing is facilitated, and the time and the calculation amount consumed by image recognition are reduced.
Further, the process of judging whether a person is in each seat position and obtaining an image recognition result specifically comprises the following steps:
respectively judging whether each seat position in each seat image is occupied or not through a face recognition algorithm to obtain a face recognition result of each seat image;
respectively marking the face recognition result of each seat image for the first time, marking the face recognition result as 1 if any person exists and marking the face recognition result as 0 if no person exists, and constructing a corresponding matrix for each seat image according to the marking result to obtain a plurality of matrixes;
calculating the probability that the same position in the matrixes is 1, judging whether the position is occupied or not according to the obtained probability, and marking for the second time, wherein the occupied mark is 1, and the non-occupied mark is 0;
and constructing a binary data rectangle according to the secondary marking result to obtain an image identification result.
Further, judging whether the position is occupied according to the obtained probability, and the process of carrying out secondary marking specifically comprises the following steps:
when the probability exceeds a preset probability threshold value, judging that the position is occupied, and marking the position as 1; and when the probability does not exceed a preset probability threshold, judging that the position is not unmanned and marking as 0.
According to the technical scheme, compared with the prior art, the library seat management system and method based on image recognition are provided, the system is provided with image acquisition equipment in each area in a library reading room, seat images of each area can be acquired, seat image recognition results of each area can be obtained through analysis and processing of a core control module, the seat image recognition results are transmitted to a cloud server through a wireless WIFI transmission module, seat occupation information can be obtained, a reader can use a mobile terminal to check the seat occupation condition, seats can be selected, preset and reserved, and seat occupation identity verification is completed, so that the library seats are orderly and efficiently intelligently managed, and the seat utilization rate in the library is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a structural architecture of a library seat management system based on image recognition according to the present invention;
FIG. 2 is a block diagram of a core control module according to an embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating a seat area division of a library reading room according to an embodiment of the present invention;
FIG. 4 is a schematic view of an image of the seating within each zone in an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a cloud server according to an embodiment of the present invention;
FIG. 6 is a schematic flowchart of a library seat management method based on image recognition according to the present invention;
fig. 7 is a schematic diagram of a functional architecture of a user terminal APP in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In one aspect, referring to fig. 1, an embodiment of the present invention discloses a library seat management system based on image recognition, including: the system comprises an image acquisition device 1, a core control module 2, a wireless WIFI transmission module 3, a cloud server 4 and a mobile terminal 5;
the image acquisition devices 1 are arranged in front of a plurality of seats in a library reading room in regions, and the image acquisition devices 1 are used for regularly acquiring seat images of corresponding regions;
the core control module 2 is used for receiving the seat images acquired by the plurality of image acquisition devices 1, performing face recognition and processing on the received seat images, judging whether a person exists in each seat position, and obtaining an image recognition result;
the wireless WIFI transmission module 3 is used for uploading the image identification result obtained by the core control module 2 to the cloud server 4;
the cloud server 4 is used for receiving the image recognition result uploaded by the wireless WIFI transmission module 3, storing and analyzing the image recognition result in real time to obtain seat occupation information, and providing information link and data support for the mobile terminal 5 to realize registration and login, seat check, seat selection, seat reservation, verification and confirmation and seat reservation functions.
In the embodiment, firstly, the library reading room seats are divided into one area every six, each area is arranged in 3 rows and 2 columns, the image acquisition device 1 is arranged in front of each area, and the image acquisition device adopts a raspberry type OV5647 camera in the embodiment. The camera has 500W pixels, the collected image is clear, and the camera is very suitable for detecting the face in the seat information in the later period.
Specifically, referring to fig. 2, the core control module 2 includes a timer 21, a central processing unit 22, a data storage 23, and a power supply 24, and the timer 21, the data storage 23, and the power supply 24 are all electrically connected to the central processing unit 22;
the timer 21 is used for setting an image acquisition interval time, in the present embodiment, a timing of 5 minutes is set, and the timer is mainly used for controlling the image acquisition time, the central processing unit 22 is respectively connected with the plurality of image acquisition devices 1, the central processing unit 22 is used for controlling the image acquisition devices 1 to periodically acquire a preset number of seat images according to the set image acquisition interval time, in the present embodiment, 10 seat images are acquired in real time every 5 minutes, image information is transmitted to the data storage 23, the processing and the judgment of the central processing unit 22 are waited, then the seat images are preprocessed and subjected to face recognition analysis, whether each seat position in the seat images is occupied is judged, and an image recognition result is obtained, the data storage 23 is used for storing the seat image data and the image recognition result in real time, and the power supply 24 is used for supplying power to the central processing unit 22.
Specifically, the core control module 2 in this embodiment adopts the raspberry pi 4B, the dominant frequency of the raspberry pi main control chip can reach 1.5GHZ, and the memory is 4 GB. The main control chip has abundant available resource space and processing speed for image processing. Each raspberry pi 4B can drive 2 OV5647 cameras.
The model of the WIFI transmission module 3 in this embodiment is ESP 8266. The ESP8266 is an ultra-low power consumption UART-WIFI transparent transmission module, supports the wireless 802.11b/g/n standard, establishes two working modes of STA/AP, is internally provided with a TCP/IP protocol stack, and supports the standard TCP/UDP Server and Client. The module can improve the data transmission efficiency.
In this embodiment, referring to fig. 3, every six seats in the library reading room are set as a region, each region is arranged in 3 rows and 2 columns, an image acquisition device 1 is installed in front of each region, 6 seat positions of the seat image are respectively located at corresponding positions of an image, the image of 6 seats is shown in fig. 4, each image corresponds to a matrix of [3,2], the initial value of the matrix is 0, the central processing unit processes and judges the features extracted from the seat image by using an image algorithm, when the central processing unit identifies the face of the corresponding position, the value of the corresponding matrix position becomes 1, when the probability that the value of the matrix position of 10 images is 1 exceeds 0.5, the position is judged to be a person, the final result "1" is output, otherwise, the position is judged to be no person, the final result "0" is output, and a final binary data matrix is obtained, i.e. the image recognition result described above. And the binary data matrix is transmitted to the cloud server, and whether a person is in the corresponding position of the library reading room is determined by using the value of the corresponding position of the binary data matrix.
Specifically, referring to fig. 5, the cloud server 4 includes:
the receiving module 40 is configured to receive the image identification result uploaded by the WIFI transmission module 3 and the related request information sent by the mobile terminal 5;
an account management module 41, configured to manage login information and account permissions of a user;
the analysis module 42 is configured to analyze and process the image recognition result uploaded by the WIFI transmission module 3 to obtain seat occupancy information;
the display module 43 is used for adding different marks to the seats in the library reading room according to the seat occupation information and displaying the seat occupation situation according to the request of the mobile terminal 5;
a database 44 for storing registration login information of a user and seat occupancy information;
a selection module 45, configured to select a corresponding seat according to a request of the mobile terminal 5;
a reservation module 46 for reserving a corresponding seat according to a request of the mobile terminal 5;
the verification module 47 is used for verifying the user identity information according to the request of the mobile terminal 5;
the judging module 48 is used for judging whether the user who selects or reserves the corresponding seat completes identity verification within a preset time period to obtain a seat occupying result, and updating seat occupying information in real time;
the related request information comprises requests of registration login, seat viewing, seat selection, seat reservation, verification confirmation, seat reservation and the like.
In some embodiments, when the relevant request information includes a seat reservation request, the cloud server 4 further includes a reservation timing module 49, configured to time according to the reservation time, and determine whether the user at the reserved seat position completes authentication within the reservation time, if the user completes authentication, the seat occupancy information is reserved, and if the user does not complete authentication, the seat occupancy information is released.
Cloud server 4 adopts the arri cloud server in this embodiment, but this server computing power elasticity is flexible, has promoted fortune dimension efficiency greatly, has reduceed the system construction cost, has characteristics such as stable, safety, elasticity. The cloud database of the Aliskiu can be compatible with relational databases such as SQL Server, MySQL and the like, and can conveniently store data. The communication between the Ali cloud server and the mobile terminal can be realized by utilizing wireless WIFI.
On the other hand, referring to fig. 6, the embodiment of the present invention further discloses a library seat management method based on image recognition, which uses the above-mentioned library seat management system based on image recognition, including:
s1: collecting an image: dividing a library reading room into a plurality of areas, and regularly collecting seat images with preset number in each area according to set image collection interval time;
s2: recognizing the human face: preprocessing and face recognition analysis are carried out on the seat image of each area, whether a person exists in each seat position is judged, and an image recognition result is obtained;
s3: managing seats: and storing and analyzing the image recognition result in real time to obtain seat occupation information, and displaying the seat occupation information in real time.
Specifically, the seating image is preprocessed, including converting the color image into a grayscale image, compressing the image, and histogram equalization.
Specifically, the process of determining whether a person is located at each seat position and obtaining an image recognition result specifically includes:
respectively judging whether each seat position in each seat image is occupied or not through a face recognition algorithm to obtain a face recognition result of each seat image;
respectively marking the face recognition result of each seat image for the first time, marking the face recognition result as 1 if any person exists and marking the face recognition result as 0 if no person exists, and constructing a corresponding matrix for each seat image according to the marking result to obtain a plurality of matrixes;
calculating the probability that the same position in the matrixes is 1, judging whether the position is occupied or not according to the obtained probability, and marking for the second time, wherein the occupied mark is 1, and the non-occupied mark is 0;
and constructing a binary data rectangle according to the secondary marking result to obtain an image identification result.
Specifically, the step of judging whether a person is at the position according to the obtained probability and performing secondary marking specifically includes:
when the probability exceeds a preset probability threshold value, judging that the position is occupied, and marking the position as 1; and when the probability does not exceed a preset probability threshold, judging that the position is not unmanned and marking as 0.
In the embodiment, extraction of Haar-Like features of a human face is performed on a preprocessed image, an AdaBoost algorithm is used for training a large amount of data to obtain a cascade classifier, the image is read into the cascade classifier to accurately recognize the human face, the algorithm is characterized in that a valuable weak classifier is trained by using an iterative idea through weight distribution of training data, multiple iterations are performed to obtain a plurality of weak classifiers, the weak classifiers are combined into a strong classifier, and finally the strong classifier is combined to form the cascade classifier. When the face at the corresponding position is identified, the value of the corresponding matrix position is changed into 1, when the probability that the value of the same matrix position of 10 images is 1 exceeds 0.5, the position is judged to be a person, the final result '1' is output, otherwise, the position is judged to be no person, the final result '0' is output, and the final binary data matrix is obtained.
Corresponding APP is installed on the mobile terminal, referring to the attached figure 7, each student logs in the mobile terminal APP through the student number and the fixed password, and seat checking, seat selection and seat reservation can be carried out on a library reading room of the school. On the APP interface, a seat map is displayed, with different colors of the seat representing different states of the seat, "grey" representing the seat is not used by a person, "red" representing the seat is being used, and "green" representing the seat has been reserved.
After the seat is selected, the cloud server starts counting down for 30 minutes, if the seat arrives within the specified time, the specific two-dimensional code beside the seat is scanned for identity confirmation, the APP displays that the seat is occupied successfully, and if the seat does not arrive within the specified time, the system automatically releases the seat. 22 parts per day: 00 to 22: and 30, the system starts a seat reservation function, students can make a seat reservation in a reading room on the next day through the mobile phone APP, and reach the designated position within 30 minutes after the library is opened on the next day, and scan codes to confirm, after the seat occupancy is successfully displayed, if the seat occupancy is not successfully reached within the specified time, the system automatically releases the seat. In the self-study process, if the user leaves the seat and the central processing unit judges that no person exists, the cloud server reserves the user information for 30 minutes, and if the user does not return to the seat on time, the system automatically releases the seat. If the user needs to leave the seat for a long time, the user needs to select to release the seat through the mobile phone APP for other students to use.
Meanwhile, in order to enable the system function to be more complete, a student can manually select a seat after initiating a seat selection request, the system can automatically select the seat for the user, in order to ensure that the system runs more orderly, a violation detection function is further arranged, the user who does not verify sitting on time is reminded or even warned, the user who breaks rules multiple times can give certain punishment, and specific rules can be reasonably set according to actual needs.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. An image recognition based library seat management system, comprising: the system comprises image acquisition equipment, a core control module, a wireless WIFI transmission module, a cloud server and a mobile terminal;
the image acquisition devices are distributed in front of a plurality of seats in a library reading room in regions and are used for periodically acquiring seat images of corresponding regions;
the core control module is used for receiving seat images acquired by the image acquisition equipment, carrying out face recognition and processing on the received seat images, judging whether a person exists in each seat position or not and obtaining an image recognition result;
the wireless WIFI transmission module is used for uploading the image identification result obtained by the core control module to the cloud server;
the cloud server is used for receiving the image recognition result uploaded by the wireless WIFI transmission module, storing and analyzing the image recognition result in real time to obtain seat occupation information, and providing information link and data support for the mobile terminal to achieve functions of registration and login, seat viewing, seat selection, seat reservation, verification and confirmation and seat reservation.
2. An image recognition-based library seat management system as claimed in claim 1, wherein the image capture device is an OV5647 camera.
3. The system for library seat management based on image recognition according to claim 1, wherein the core control module comprises a timer, a central processing unit, a data storage and a power supply, and the timer, the data storage and the power supply are all electrically connected with the central processing unit;
the timer is used for setting image acquisition interval time, the central processing unit is respectively connected with the plurality of image acquisition devices, the central processing unit is used for controlling the image acquisition devices to regularly acquire seat images with preset quantity according to the set image acquisition interval time, preprocessing and face recognition analysis are carried out on the seat images, whether a person exists at each seat position in the seat images is judged, an image recognition result is obtained, the data storage device is used for storing the seat image data and the image recognition result in real time, and the power supply is used for supplying power to the central processing unit.
4. The system of claim 1, wherein the model of the WIFI transmission module is ESP 8266.
5. The system of claim 1, wherein the cloud server comprises:
the receiving module is used for receiving the image identification result uploaded by the wireless WIFI transmission module and the related request information sent by the mobile terminal;
the account management module is used for managing the registration login information and the account authority of the user;
the analysis module is used for analyzing and processing the image recognition result uploaded by the wireless WIFI transmission module to obtain seat occupation information;
the display module is used for adding different marks to seats in a library reading room according to the seat occupation information and displaying the seat occupation situation according to the request of the mobile terminal;
the database is used for storing the registration login information and the seat occupation information of the user;
the selection module is used for selecting a corresponding seat according to the request of the mobile terminal;
the reservation module is used for reserving a corresponding seat according to the request of the mobile terminal;
the verification module is used for verifying the user identity information according to the request of the mobile terminal;
the judging module is used for judging whether the user who selects or reserves the corresponding seat completes identity verification within a preset time period or not to obtain a seat occupying result and updating seat occupying information in real time;
the related request information comprises registration login, seat viewing, seat selection, seat reservation, verification confirmation and seat reservation.
6. The system of claim 5, wherein when the relevant request information includes a seat reservation request, the cloud server further comprises a reservation timing module configured to time according to a reservation time and determine whether the user at the reserved seat position completes the authentication within the reservation time, if the authentication is completed, the seat occupancy information is reserved, and if the authentication is not completed, the seat occupancy information is released.
7. A method for library seat management based on image recognition, using the system of any one of claims 1-6, comprising:
dividing a library reading room into a plurality of areas, and regularly collecting seat images with preset number in each area according to set image collection interval time;
preprocessing and face recognition analysis are carried out on the seat image of each area, whether a person exists in each seat position is judged, and an image recognition result is obtained;
and storing and analyzing the image recognition result in real time to obtain seat occupation information, and displaying the seat occupation information in real time.
8. An image recognition based library seat management system as claimed in claim 7, wherein the pre-processing of the seat map image includes converting the color map into a gray scale map, compressing the image and histogram equalization.
9. The system for library seat management based on image recognition as claimed in claim 7, wherein the process of determining whether a person is located at each seat position and obtaining the image recognition result specifically comprises:
respectively judging whether each seat position in each seat image is occupied or not through a face recognition algorithm to obtain a face recognition result of each seat image;
respectively marking the face recognition result of each seat image for the first time, marking the face recognition result as 1 if any person exists and marking the face recognition result as 0 if no person exists, and constructing a corresponding matrix for each seat image according to the marking result to obtain a plurality of matrixes;
calculating the probability that the same position in the matrixes is 1, judging whether the position is occupied or not according to the obtained probability, and marking for the second time, wherein the occupied mark is 1, and the non-occupied mark is 0;
and constructing a binary data rectangle according to the secondary marking result to obtain an image identification result.
10. The system of claim 9, wherein the determining whether the position is occupied according to the obtained probability and performing the secondary labeling specifically comprises:
when the probability exceeds a preset probability threshold value, judging that the position is occupied, and marking the position as 1; and when the probability does not exceed a preset probability threshold, judging that the position is not unmanned and marking as 0.
CN202010501677.9A 2020-06-04 2020-06-04 Library seat management system and method based on image recognition Withdrawn CN111695481A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010501677.9A CN111695481A (en) 2020-06-04 2020-06-04 Library seat management system and method based on image recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010501677.9A CN111695481A (en) 2020-06-04 2020-06-04 Library seat management system and method based on image recognition

Publications (1)

Publication Number Publication Date
CN111695481A true CN111695481A (en) 2020-09-22

Family

ID=72479014

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010501677.9A Withdrawn CN111695481A (en) 2020-06-04 2020-06-04 Library seat management system and method based on image recognition

Country Status (1)

Country Link
CN (1) CN111695481A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113052780A (en) * 2020-11-16 2021-06-29 泰州市出彩网络科技有限公司 Data packaging system using bluetooth communication
CN117521869A (en) * 2024-01-08 2024-02-06 广东拓迪智能科技有限公司 Library space management method, device and system and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113052780A (en) * 2020-11-16 2021-06-29 泰州市出彩网络科技有限公司 Data packaging system using bluetooth communication
CN117521869A (en) * 2024-01-08 2024-02-06 广东拓迪智能科技有限公司 Library space management method, device and system and storage medium

Similar Documents

Publication Publication Date Title
CN105303632B (en) A kind of mobile monitor is registered system and method for work
CN105678476B (en) Video-based intelligent guidance system and guidance method for study room
CN109902628B (en) Library seat management system based on vision thing networking
CN110910549A (en) Campus personnel safety management system based on deep learning and face recognition features
CN108351967A (en) A kind of plurality of human faces detection method, device, server, system and storage medium
CN109829995A (en) A kind of recognition of face classroom is registered system
CN111695481A (en) Library seat management system and method based on image recognition
CN108830439A (en) Electricity business hall intelligent Service monitoring method and system based on recognition of face
WO2019061979A1 (en) Member aggregation determination logic-based smart attendance system and method
CN109360305B (en) Library management method and system based on face recognition
CN111382808A (en) Vehicle detection processing method and device
CN113411542A (en) Intelligent working condition monitoring equipment
CN109903412A (en) A kind of intelligent check class attendance system based on face recognition technology
CN109508685A (en) Power communication dispatching method based on face recognition technology
CN113630721A (en) Method and device for generating recommended tour route and computer readable storage medium
CN109409759B (en) Data mining system and method based on coal mine safety training game
CN110443577A (en) A kind of campus attendance checking system based on recognition of face
CN109801394B (en) Staff attendance checking method and device, electronic equipment and readable storage medium
CN116777685A (en) Scenic spot guiding system, method and device and management server
CN106503747A (en) A kind of image recognition statistical analysis system
CN110879988A (en) Information compliance detection method, client, device, server and computer readable medium
WO2022222957A1 (en) Method and system for identifying target
CN113869269A (en) Activity site congestion degree detection method and device, electronic equipment and storage medium
CN114612897A (en) Intelligent fruit and vegetable weighing and ticketing method and device, electronic equipment and storage medium
CN111738884A (en) Student behavior diagnosis and management method based on intelligent campus student position information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20200922

WW01 Invention patent application withdrawn after publication