CN114554079A - Intelligent service management method and intelligent service management system - Google Patents
Intelligent service management method and intelligent service management system Download PDFInfo
- Publication number
- CN114554079A CN114554079A CN202210025622.4A CN202210025622A CN114554079A CN 114554079 A CN114554079 A CN 114554079A CN 202210025622 A CN202210025622 A CN 202210025622A CN 114554079 A CN114554079 A CN 114554079A
- Authority
- CN
- China
- Prior art keywords
- image
- service
- camera
- processing
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims abstract description 96
- 238000000034 method Methods 0.000 claims abstract description 443
- 230000008569 process Effects 0.000 claims abstract description 411
- 238000012545 processing Methods 0.000 claims abstract description 316
- 230000005540 biological transmission Effects 0.000 claims description 93
- 238000001514 detection method Methods 0.000 claims description 10
- 238000012546 transfer Methods 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 230000001934 delay Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011112 process operation Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The application relates to an intelligent service management method and an intelligent service management system, wherein the intelligent service management method comprises the following steps: acquiring a camera image of a basic service process and image information of the camera image; performing image processing according to the camera image and the image information to generate a first image processing result; sending the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; wherein the business process, the basic business process and the image processing process are independent. By the method and the device, the problem of unstable camera service processing is solved, and the purpose that the intelligent service and the basic service of the camera are not influenced mutually is achieved.
Description
Technical Field
The present application relates to the field of intelligent service management, and in particular, to an intelligent service management method and an intelligent service management system.
Background
Modern cameras typically have intelligent business processing functions. The intelligent service processing of the camera can perform image processing on the acquired graphic data and perform the intelligent service processing of the camera based on the result of the image processing.
In the related technology, the intelligent service requirement of the camera changes frequently, which results in the instability of the service processing system of the camera, and once the intelligent service accesses the memory out of bounds, the process of the whole camera system is crashed, which seriously affects the operation of other basic services (such as stream pulling, video recording, etc.).
Aiming at the problem of unstable camera service processing system in the related art, no effective solution is provided at present.
Disclosure of Invention
In the embodiment, an intelligent service management method and an intelligent service management system are provided to solve the problem of instability of a camera service processing system in the related art.
In a first aspect, in this embodiment, an intelligent service management method is provided, which is applied to an image processing process, and includes:
acquiring a camera image of a basic service process and image information of the camera image;
performing image processing according to the camera image and the image information to generate a first image processing result;
sending the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; wherein the business process, the basic business process and the image processing process are independent.
In some embodiments, the acquiring a camera image of an underlying business process and image information of the camera image includes:
acquiring the camera image and the image information extracted by the image acquisition process;
wherein the camera image and the image information are obtained by the image acquisition process from a first image transmission subscriber establishment result generated by the basic service process according to an established first image transmission subscriber, obtained from the basic service process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and obtained from image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully; the image acquisition process and the image processing process are independent of each other.
In some embodiments, the sending the first image processing result to a business process comprises:
detecting the generation state of the first image processing result to obtain a generated detection result;
if the generated detection result indicates that the first image processing result is successfully generated, distributing the first image processing result to the service processing process, sending a first image release request to an image acquisition process, and indicating the image acquisition process to release the camera image and the image information based on the first image release request;
and if the generation detection result indicates that the first image processing result is failed to be generated, directly sending a first image release request to the image acquisition process to indicate the image acquisition process to release the camera image and the image information based on the first image release request.
In some embodiments, after the distributing the first image processing result to the business processing process, the method further includes:
and acquiring a next camera image and next image information from the basic service process through the image acquisition process, and performing image processing according to the next camera image and the next image information to generate a next first image processing result.
In some embodiments, after the generating the first traffic processing result, the method further includes:
and the service processing process sends a second image release request to an image acquisition process, and instructs the image acquisition process to release the camera image and the image information based on the second image release request.
In some embodiments, before the acquiring the camera image of the basic business process, the method further includes:
acquiring task arrangement information of the basic service process and a first image transmission subscriber establishment result, and establishing connection with the basic service process and the service processing process respectively according to the task arrangement information and the first image transmission subscriber establishment result;
and the establishment result of the first image transmission subscriber is generated by the basic service process establishing the first image transmission subscriber according to the acquired task arrangement information and the establishment result of the first image transmission subscriber.
In some embodiments, the obtaining task orchestration information and first image transmission subscriber establishment results for the base business process comprises:
acquiring an image distribution subscriber establishment result of an image acquisition process;
according to the image distribution subscriber establishing result and the task arrangement information, connecting with the image acquisition process;
wherein the image distribution subscriber establishment result is generated by the image acquisition process acquiring the first image transmission subscriber establishment result of the underlying business process, generated according to the underlying business process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and generated according to image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully.
In a second aspect, in this embodiment, an intelligent service management method is provided, which is applied to an image service management process, and includes:
acquiring a camera image of a basic service process and image information of the camera image;
performing image processing according to the camera image and the image information to generate at least one second image processing result; performing service processing according to the at least one second image processing result to generate at least one second service processing result; wherein the basic service process and the image service management process are independent of each other.
In some embodiments, the acquiring a camera image of an underlying business process and image information of the camera image includes:
acquiring a second image transmission subscriber establishment result generated by the basic service process according to the established second image transmission subscriber;
if the second image transmission subscriber establishment result indicates that the second image transmission subscriber is established successfully, acquiring the camera image and the image information from the basic service process;
obtaining the camera image and the image information from image capture hardware if the second image transfer subscriber setup result indicates that the second image transfer subscriber setup failed.
In a third aspect, this embodiment provides an intelligent service management system, where the system is deployed with: a basic service process, an image processing process and a service processing process;
the image processing process acquires a camera image of a basic service process and image information of the camera image;
the image processing process carries out image processing according to the camera image and the image information to generate a first image processing result;
the image processing process sends the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result;
wherein the business process, the basic business process and the image processing process are independent.
Compared with the related art, the intelligent service management method and the intelligent service management system provided by the embodiment acquire the camera image of the basic service process and the image information of the camera image; performing image processing according to the camera image and the image information to generate a first image processing result; sending the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; the service processing process, the basic service process and the image processing process are independent from each other, so that the problem of unstable service processing of the camera is solved, and the purpose of not influencing the intelligent service and the basic service of the camera is realized.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a diagram of an application scenario of an intelligent traffic management method in one embodiment;
FIG. 2 is a flow diagram illustrating a method for intelligent traffic management in one embodiment;
FIG. 3 is a schematic flow chart of a method for intelligent traffic management in another embodiment;
FIG. 4 is a schematic flow chart diagram of a method for intelligent traffic management in yet another embodiment;
FIG. 5 is a schematic flow chart diagram of a method for intelligent traffic management in yet another embodiment;
FIG. 6 is a block diagram of an intelligent business management system in one embodiment;
FIG. 7 is a block diagram of an intelligent traffic management system in another embodiment;
FIG. 8 is a block diagram of an intelligent business management system in yet another embodiment;
FIG. 9 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
For a clearer understanding of the objects, aspects and advantages of the present application, reference is made to the following description and accompanying drawings.
Unless defined otherwise, technical or scientific terms used herein shall have the same general meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The use of the terms "a" and "an" and "the" and similar referents in the context of this application do not denote a limitation of quantity, either in the singular or the plural. The terms "comprises," "comprising," "has," "having," and any variations thereof, as referred to in this application, are intended to cover non-exclusive inclusions; for example, a process, method, and system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or modules, but may include other steps or modules (elements) not listed or inherent to such process, method, article, or apparatus. Reference throughout this application to "connected," "coupled," and the like is not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference to "a plurality" in this application means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. In general, the character "/" indicates a relationship in which the objects associated before and after are an "or". The terms "first," "second," "third," and the like in this application are used for distinguishing between similar items and not necessarily for describing a particular sequential or chronological order.
The intelligent service management method provided by the application can be applied to the application environment shown in fig. 1. Wherein the terminal 102 communicates with the server 104 via a network. The terminal 102 acquires a camera image of a basic service process and image information of the camera image; the terminal 102 performs image processing according to the camera image and the image information to generate a first image processing result; the terminal 102 sends the first image processing result to a service processing process, so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; wherein, the service processing process, the basic service process and the image processing process are independent; the server 104 receives and stores the first image processing result and/or the first business processing result. The terminal 102 may be, but not limited to, various cameras, and terminals related to image-based intelligent service processing, such as a smart phone, a tablet computer, and a portable wearable device; the server 104 may be implemented as a stand-alone server or as a server cluster comprised of multiple servers.
An intelligent service management method is provided in this embodiment, fig. 2 is a flowchart of the intelligent service management method of this embodiment, and as shown in fig. 2, the method is applied to an image processing process, and the method flow includes the following steps:
step S202, acquiring a camera image of the basic business process and image information of the camera image.
The basic service process is a process capable of realizing a basic function of capturing video and audio signals in real time by a camera of the terminal 102; the camera image may be a YUV image (luminance-Chrominance, an image encoded in brightness (luminance) and Chrominance (Chrominance)); the image information refers to the attribute information of the camera image, and includes the original camera image format, the image frame number, the image frame rate, the image storage address, the video channel number corresponding to the image, and the like.
Step S204, image processing is carried out according to the camera image and the image information, and a first image processing result is generated.
The step of image processing refers to a process of further processing the acquired camera image and image information by using a preset image processing algorithm in the image processing process, and labeling a result of generating first image information in the image information, for example, performing face recognition, target tracking, and the like on the acquired camera image; the first image processing result is an image result obtained after processing by an image processing algorithm, and may be staff information after face recognition or a target contour frame for dynamically tracking a target.
Step S206, sending the first image processing result to a service processing process, so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; wherein, the business processing process, the basic business process and the image processing process are independent.
It should be noted that, in one terminal 102, the image processing process and the service processing process may be multiple, and different image processing purposes and different service processing purposes are respectively implemented, for example, a first image processing process is used for recognizing a human face in an image, a second image processing process is used for performing contour recognition on an object in the image to track a dynamic object, the first service processing process is used for instructing to alarm according to the object in the image of the camera, the second service processing process is used for instructing to rotate a pan-tilt of the terminal 102 where the camera is located according to a moving direction of the object in the image of the camera, or, the first image processing process, the second image processing process, the first service processing process and the second service processing process are simultaneously utilized to implement recognition of a target task as a foreign person and implement recognition of a contour of the dynamic object on the foreign person, rotating the cradle head to follow the dynamic target task and simultaneously sending alarm information; the step of the service processing refers to a process of forming a display image with identification information by superposing the first image information result on the acquired camera image on the basis of the first image processing result; specifically, after the display image with the identification information is generated, the business processing process may generate the business processing result according to the display image, so as to instruct the server 104 to perform business processing according to the business processing result, for example, the business processing process matches staff information identified by a human face with the display image superimposed with a camera image, generates a business processing result as an alarm and tracks the human face when matching is unsuccessful, and sends the business processing result to the terminal 102 and the server 104 where the business processing result is located; the terminal 102 indicates the cradle head to perform face tracking, send alarm information and/or the terminal 102 displays the superimposed image, and the server 104 stores the service processing result.
Through the steps, in the intelligent service management method of the camera in the terminal 102, the basic service is realized by using the basic service process, the intelligent service based on image processing is realized by using the image processing process and the service processing process, the basic service process and the image processing process are independent from each other, so that the service processing process, the basic service process and the image processing process are not interfered with each other in the intelligent service operation of the camera, and when data interaction is carried out among the processes, the image processing process not only can acquire the data of the basic service process, but also can acquire the image processing results of other image processing processes for image data multiplexing, so that the multifunctional detection of the camera is realized, and the data multiplexing degree is improved; meanwhile, because the memory space occupied by the process operation is certain, the operation of the basic service of the camera cannot be interfered when the image processing process has faults of collapse, overflow and the like, the problem of instability of a camera service system is solved, and the stability of the camera service system is improved.
In some embodiments, the obtaining of the camera image of the underlying business process and the image information of the camera image includes:
acquiring the camera image and the image information extracted by the image acquisition process;
the camera image and the image information are acquired by the image acquisition process from a first image transmission subscriber establishment result generated by the basic service process according to the established first image transmission subscriber, the camera image and the image information are acquired from the basic service process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and the camera image and the image information are acquired from image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully; the image acquisition process and the image processing process are independent of each other.
It should be noted that the result of establishing the first image transmission subscriber may be in the form of a return value to the camera image acquisition function indicating that the first image transmission subscriber is successfully established or failed, or may be in the form of detecting a camera image transmission interface indicating that the first image transmission subscriber is successfully established, or else, failing; the first image transmission subscriber is used for detecting the camera image and the image information acquired by the basic service process in real time, if the basic service process is detected to acquire the camera image and the image information, the first image transmission subscriber generates a trigger information number, and the image acquisition process extracts the camera image and the image information from the basic service process after receiving the trigger signal transmitted in real time; the camera image and the image information acquired by the image acquisition process in this embodiment are stored in a storage unit shared by the processes, where the storage unit may be a shared memory or a shared hard disk.
Through the steps, an image acquisition process is set between the basic service process and the image processing process, and when the first image transmission subscriber is successfully established in the basic service process, the image acquisition process acquires the camera image and the image information in the basic service process so as to transmit the camera image and the image information to the image processing process for image processing; when the first image transmission subscriber fails to be established in the basic service process, the image acquisition process acquires the camera image and the image information from the image capturing hardware, so that the stability of camera service processing can be realized when the first image transmission subscriber fails to be established in the basic service process, and the problem of unstable camera service processing is solved.
In some embodiments, the sending the first image processing result to a business process comprises:
detecting the generation state of the first image processing result to obtain a generated detection result;
if the generated detection result indicates that the first image processing result is successfully generated, distributing the first image processing result to the service processing process, sending a first image release request to an image acquisition process, and indicating the image acquisition process to release the camera image and the image information based on the first image release request;
and if the generation detection result indicates that the first image processing result is failed to be generated, directly sending a first image release request to the image acquisition process to indicate the image acquisition process to release the camera image and the image information based on the first image release request.
When the image acquisition process receives the first image release request, the image acquisition process executes the first image release request according to the actual execution condition of the image acquisition process, for example, under the condition that the image acquisition process also performs data transmission with other image processing processes executing tasks, the image acquisition process delays the execution of the first image release request; it should be noted that, the image obtaining process may also actively determine whether the extracted camera image and image information need to be released after the camera image and image information are extracted and before the first image release request is received.
Through the steps, after the image processing of the camera image and the image information is finished, the image acquisition process is instructed to release the extracted camera image and the extracted image information so as to release a partial space of the image acquisition process to acquire the next camera image and the next image information, the memory of the image acquisition process can be instructed to be released under the condition that the image processing process has no result, the execution of other processes cannot be influenced, and the problem of unstable camera service processing is solved.
In some embodiments, after the distributing the first image processing result to the business processing process, the method further includes:
and acquiring a next camera image and next image information from the basic service process through the image acquisition process, and performing image processing according to the next camera image and the next image information to generate a next first image processing result.
Through the steps, after image processing is carried out once to generate the first image processing result, the next camera image and the next image information received by the image acquisition process can be acquired, and next image processing is carried out, so that the next first image processing result is obtained, and a logical cycle in time is formed.
In some embodiments, after the generating the first business process result, the method further includes:
and the service processing process sends a second image release request to the image acquisition process, and instructs the image acquisition process to release the camera image and the image information based on the second image release request.
When the image acquisition process receives the second image release request, the image acquisition process executes the second image release request according to the actual execution condition of the image acquisition process, for example, under the condition that the image acquisition process also performs data transmission with other service processing processes executing tasks, the image acquisition process delays the execution of the second image release request; it should be noted that, the image acquiring process may also actively determine whether the extracted camera image and image information need to be released after the camera image and image information are extracted and before the second image release request is received.
Through the steps, after the service processing is finished according to the first image processing result and the first service processing result is obtained, the service processing process instructs the image acquisition process to release the extracted camera image and image information so as to release a part of space of the image acquisition process to acquire the next camera image and the next image information, so that the execution of other processes cannot be influenced, and the problem of unstable service processing of the camera is solved.
In some embodiments, before the acquiring the camera image of the basic business process, the method further includes:
acquiring task arrangement information of the basic service process and a first image transmission subscriber establishment result, and establishing connection with the basic service process and the service processing process respectively according to the task arrangement information and the first image transmission subscriber establishment result;
and the establishment result of the first image transmission subscriber is generated by the basic service process establishing the first image transmission subscriber according to the acquired task arrangement information and the establishment result of the first image transmission subscriber.
It should be noted that the task arrangement information may be task arrangement configuration information preset by the system, or task arrangement configuration information modified by the user according to the actual function requirement; the task arrangement information can be firstly obtained when the system is started for the first time for initialization, or can be obtained again after the system configuration or the task arrangement information is detected to be modified by a user; if the task orchestration information does not include information or an interface to establish the first image transfer subscriber, the first image transfer subscriber is not established, and the image processing process interfaces with image capture hardware.
Through the steps, before the camera acquires the image of the camera, tasks of all processes need to be arranged according to task arrangement information, and results that different processes are mutually independent and mutually connected through the subscriber are obtained through arrangement, so that the intelligent service of the camera is executed, the mutual execution of the tasks cannot be influenced among the mutually independent processes, the intelligent service is stably executed by the camera, and the problem of unstable service processing of the camera is solved.
In some embodiments, the obtaining task orchestration information and first image transmission subscriber setup results for the base business process comprises:
acquiring an image distribution subscriber establishment result of an image acquisition process;
according to the image distribution subscriber establishing result and the task arrangement information, connecting with the image acquisition process;
wherein the image distribution subscriber establishment result is generated by the image acquisition process acquiring the first image transmission subscriber establishment result of the underlying business process, generated according to the underlying business process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and generated according to image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully.
It should be noted that the image distribution subscriber is configured to perform real-time detection on the camera image and the image information extracted by the image acquisition process, and if it is detected that the camera image and the image information are extracted by the image acquisition process, the image distribution subscriber generates a trigger information number, and after receiving the trigger signal sent in real time, the image processing process extracts the camera image and the image information from the image acquisition process.
Through the steps, the task arrangement object also comprises an image acquisition process, and according to the establishment condition of the image transmission subscriber in the basic service process, when the image transmission subscriber is successfully established in the basic service process, the image acquisition process is connected with the basic service; when the image transmission subscriber is failed to establish in the basic service process, the image acquisition process is connected with the image capturing hardware, so that the stability of the intelligent service processing of the camera can be realized when the image transmission subscriber is failed to establish, and the problem of unstable service processing of the camera is solved.
The embodiment also provides an intelligent service management method. Fig. 3 is a flowchart of another intelligent service management method of this embodiment, as shown in fig. 3, the method is applied to an image service management process, and the method includes the following steps:
step S302, acquiring a camera image of the basic service process and image information of the camera image.
The basic service process is a process capable of realizing a basic function of capturing video and audio signals in real time by a camera of the terminal 102; the camera image may be a YUV image (luminance-Chrominance, an image encoded in brightness (luminance) and Chrominance (Chrominance)); the image information refers to the attribute information of the camera image, and includes the original camera image format, the image frame number, the image frame rate, the image storage address, the video channel number corresponding to the image, and the like.
Step S304, processing the image according to the camera image and the image information to generate at least one second image processing result; performing service processing according to the at least one second image processing result to generate at least one second service processing result; wherein, the basic service process and the image service management process are independent.
It should be noted that, performing business processing according to the at least one second image processing result to generate at least one second business processing result means, in an image service management process, a second service processing result may be generated according to a second image processing result, a second service processing result may be generated according to a plurality of second image processing results, and a plurality of second service processing results may be generated according to a plurality of second image processing results, depending on the implementation objective of the image service management process, for example, in order to achieve the goal of an alarm for a foreign person in a camera, which is the only goal of the camera and does not use the same image processing results as other goals, the image service management process integrates functions of face image recognition, contour recognition, external person alarm and driving the camera pan-tilt to rotate in the camera image.
Through the above steps, in another intelligent service management method of a camera in a terminal 102, a basic service is implemented using a basic service process, functions of image processing and service processing in an intelligent service based on image processing are implemented using one process of an image service management process, and the basic service process and the image service management process are independent from each other, therefore, the basic service process and the image service management process do not interfere with each other in the intelligent service operation of the camera, when data interaction is carried out between the processes, the image service management process integrates intelligent services with low multiplexing degree, reduces the development difficulty of the camera function, when the image service management process has faults of collapse, overflow and the like, the operation of the basic service of the camera cannot be interfered, the problem of instability of a camera service system is solved, and the stability of the camera service system is improved.
In some embodiments, the obtaining of the camera image of the underlying business process and the image information of the camera image includes:
acquiring a second image transmission subscriber establishment result generated by the basic service process according to the established second image transmission subscriber;
if the second image transmission subscriber establishment result indicates that the second image transmission subscriber establishment is successful, acquiring the camera image and the image information from the basic service process;
the camera image and the image information are acquired from image capture hardware if the second image transfer subscriber setup result indicates that the second image transfer subscriber setup failed.
It should be noted that the second image transmission subscriber establishment result may be in the form of a return value to the camera image acquisition function indicating that the second image transmission subscriber is established successfully or fails, or may be in the form of detecting a camera image transmission interface indicating that the second image transmission subscriber is established successfully, otherwise, failing.
Through the steps, the image service management process also has an image acquisition function, and when the second image transmission subscriber is successfully established in the basic service process, the image service management process acquires the camera image and the image information in the basic service process so as to perform image processing; when the second image transmission subscriber fails to be established in the basic service process, the image service management process acquires the image and the image information of the camera from the image capturing hardware, so that the stability of camera service processing can be realized when the second image transmission subscriber fails to be established in the basic service process, and the problem of unstable camera service processing is solved.
In some embodiments, before the acquiring the camera image of the basic business process in the other intelligent business management method, the method further includes:
acquiring single-process task arrangement information of the basic service process and a second image transmission subscriber establishment result, and establishing connection with the basic service process according to the single-process task arrangement information and the second image transmission subscriber establishment result;
and the establishment result of the second image transmission subscriber is generated by the basic service process establishing the second image transmission subscriber according to the acquired single-process task arrangement information and the establishment result of the second image transmission subscriber.
It should be noted that the single-process task arrangement information may be a single-process task arrangement configuration information preset by the system, or may be a single-process task arrangement configuration information modified by the user according to the actual function requirement; the single-process task arrangement information can be firstly acquired when the system is started for the first time for initialization, or can be acquired again after the system configuration or the single-process task arrangement information is detected to be modified by a user; if the information or interface of the second image transmission subscriber is not established in the single-process task scheduling information, the second image transmission subscriber is not established, and then the image service management process is connected with the image capturing hardware.
Through the steps, before the camera acquires the camera image, tasks of the image service management process need to be arranged according to single-process task arrangement information, and results that the image service management process and the basic service process are mutually independent and mutually connected through the subscriber are obtained through arrangement, so that the intelligent service of the camera is executed, the mutually independent processes cannot influence the mutual execution of the tasks, the camera can stably execute the intelligent service, and the problem of unstable camera service processing is solved.
It should be noted that the two intelligent service management methods may be implemented separately, or a service process may be set after the basic service process, and the target function of the camera is extracted through the service process, so that it is determined that the target function is implemented by using any of the embodiments, and the service process is also established according to the task scheduling information, which is not described herein again.
The present embodiment is described and illustrated below by means of preferred embodiments.
Fig. 4 is a flowchart of another intelligent service management method according to the embodiment, and as shown in fig. 4, the intelligent service management method includes a basic service process, an image acquisition process, an image processing process, and a service processing process;
firstly, an image acquisition process judges whether to acquire YUV from a basic service process according to whether the basic service process has YUV service, and if the basic service process has YUV service, YUV is acquired from the basic service process; otherwise, acquiring YUV from the hardware interface. The image acquisition process distributes the acquired YUV information, wherein the YUV information comprises YUV images and image frame numbers, image storage addresses, image frame rates and the like corresponding to the YUV images. Meanwhile, the image acquisition process acquires the next YUV image.
Secondly, the image processing process receives YUV information distributed by the image acquisition process and/or intelligent results distributed by other image processing processes, and analyzes the YUV information and/or the intelligent results; the image acquisition process judges whether an intelligent result of the analysis is generated or not, and if so, the intelligent result is distributed; otherwise, informing the image acquisition process that the YUV is used, and determining whether to release the frame of YUV by the image acquisition process. And at the moment, the single-frame YUV task execution flow of the image processing process is finished.
Finally, the business processing process receives the intelligent result distributed by the image processing process and carries out business processing; and after the service processing process carries out service processing, informing the image acquisition process that YUV is used up, and determining whether the frame of YUV is released or not by the image acquisition process. At this time, the service processing flow of the service processing process is ended.
Fig. 5 is a flowchart of another intelligent service management method according to the embodiment, as shown in fig. 5, the intelligent service management method is used for arranging task execution flows of a basic service process, an image acquisition process, an image processing process and a service processing process;
firstly, the basic service process starts task arrangement and acquires the task arrangement content, and the task arrangement content is preset by a program or set by a user; the basic business process judges whether the YUV service is supported, if so, a YUV service subscriber is established as an image transmission subscriber connected with the image acquisition process for the image acquisition process to subscribe, and other processes are sequentially informed to construct a corresponding arrangement flow; if the basic service process does not support YUV service, directly informing other processes and constructing a corresponding arrangement flow; the judgment of whether the YUV service is supported is carried out according to whether the basic service process has a YUV service interface or according to system configuration and user configuration.
Secondly, the image acquisition process receives the notification of the basic service process and starts the arrangement process; the image acquisition process judges whether to acquire YUV from the basic service process according to the YUV service of the basic service process, if yes, a YUV service subscriber requesting to subscribe the basic service process is requested; otherwise, an attempt is made to subscribe to the hardware interface of the image capture hardware. The image acquisition process creates an image distribution subscriber for the image processing process to subscribe.
Thirdly, the image processing process receives a task arrangement notice of changing the basic service process and starts an arrangement process; judging whether to subscribe the image acquisition process result, if so, requesting to subscribe a result distribution subscriber of the image acquisition process, and then creating a result distribution subscriber for a service processing process or other image processing processes to subscribe; otherwise, judging whether to subscribe the result of other image processing processes, if so, requesting to subscribe a result distribution subscriber of other image processing processes, and creating a result distribution subscriber for the service processing process or other image processing processes to subscribe.
Finally, the business processing process receives the task arrangement notice of the basic business process and starts the arrangement process; and the business processing process subscribes a result distribution subscriber of one or more image processing processes, and the arrangement flow of the business processing process is ended.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here. For example, in fig. 5, task arrangement of the image acquisition process may be performed before task arrangement of the image processing process, or may be performed after the image processing process, or may be performed simultaneously, which is not described herein again.
The embodiment also provides an intelligent service management system. Fig. 6 is a structural diagram of an intelligent service management system according to this embodiment, and as shown in fig. 6, the system is deployed with: a basic service process, an image processing process and a service processing process;
the image processing process acquires a camera image of a basic service process and image information of the camera image;
the image processing process carries out image processing according to the camera image and the image information to generate a first image processing result;
the image processing process sends the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result;
wherein, the business processing process, the basic business process and the image processing process are independent.
In this embodiment, an intelligent service management system is further provided, and fig. 7 is a structural diagram of another intelligent service management system of this embodiment, as shown in fig. 7, the system is deployed with: a basic service process, an image acquisition process, an image processing process and a service processing process;
specifically, the basic service process is mainly deployed with a task arrangement module, which is used for acquiring task arrangement information and sending the task arrangement information to the image acquisition process, the image processing process and the service processing process;
the image acquisition process is provided with a communication management module, an image management module and an image acquisition module; the communication management module of the image acquisition process is used for providing a service for subscribing image related information for the image processing process; the image management module is used for managing image data, and the image data can be stored in a shared memory; the image acquisition module is used for acquiring image data, and the image data can be directly acquired from hardware or acquired from a basic service process construction subscriber;
the image processing process is provided with a communication management module, an intelligent analysis decision module and an intelligent analysis module; the communication management module of the image processing process is used for subscribing image information provided by the image acquisition process or image processing results provided by other image processing processes; the intelligent analysis decision module is used for deciding and subscribing image information of an image acquisition process or image processing result information of other image processing processes; wherein, the image acquisition process can be one or a plurality of processes; the intelligent analysis module is used for carrying out image analysis on subscribed image data information, wherein the image data information can be YUV information, an image processing result generated by other image processing processes, or a combination of the YUV information and the image processing result.
The business processing process is provided with a communication management module and a business processing module; the communication management module of the business processing process is used for subscribing the image processing result provided by the image processing process; the subscribing to the image processing process may subscribe to one image processing process or a plurality of image processing processes; the business processing module is used for carrying out corresponding business processing, such as alarming, video recording, target tracking and the like, according to the received image processing result.
In this embodiment, an intelligent service management system is further provided, where the system is deployed with: a basic business process and an image business management process. FIG. 8 is a structural diagram of another intelligent business management system of this embodiment, as shown in FIG. 8, the image business management process is deployed with an image management module, an intelligent analysis management module and a business processing module;
the basic business process acquires a camera image of the basic business process and image information of the camera image;
the image service management process carries out image processing according to the camera image and the image information to generate at least one second image processing result; performing service processing according to the at least one second image processing result to generate at least one second service processing result; wherein, the basic service process and the image service management process are independent.
Specifically, first, the image management module is deployed with an information management module, an image storage module, and an image acquisition/release module; the information management module of the image management module stores the relevant information of each extracted image, such as a frame number, a physical address, a video channel number and the like; the image storage module is used for storing image data; the image acquisition/release module is used for acquiring and releasing images, and the release time of the image acquisition/release module is determined by the service processing module and can be released after image capture. Secondly, the intelligent analysis management module is provided with a logic management module and at least one intelligent analysis module; the logic management module is used for connecting a plurality of intelligent analysis modules in series to obtain a final intelligent analysis result; the at least one intelligent analysis module is used for executing an intelligent analysis step based on image processing; finally, the service processing module can be deployed with one or more service processing methods such as alarming, video recording, image capturing and/or holder linkage.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 9. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an intelligent business management method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 9 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to be limiting. All other embodiments, which can be derived by a person skilled in the art from the examples provided herein without any inventive step, shall fall within the scope of protection of the present application.
It is obvious that the drawings are only examples or embodiments of the present application, and it is obvious to those skilled in the art that the present application can be applied to other similar cases according to the drawings without creative efforts. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
The term "embodiment" is used herein to mean that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by one of ordinary skill in the art that the embodiments described in this application may be combined with other embodiments without conflict.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the patent protection. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.
Claims (10)
1. An intelligent service management method, applied to an image processing process, the method comprising:
acquiring a camera image of a basic service process and image information of the camera image;
performing image processing according to the camera image and the image information to generate a first image processing result;
sending the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result; wherein the business process, the basic business process and the image processing process are independent.
2. The intelligent business management method of claim 1, wherein the obtaining of the camera image of the underlying business process and the image information of the camera image comprises:
acquiring the camera image and the image information extracted by the image acquisition process;
wherein the camera image and the image information are obtained by the image acquisition process from a first image transmission subscriber establishment result generated by the basic service process according to an established first image transmission subscriber, obtained from the basic service process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and obtained from image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully; the image acquisition process and the image processing process are independent of each other.
3. The intelligent traffic management method according to claim 1, wherein the sending the first image processing result to a traffic processing process comprises:
detecting the generation state of the first image processing result to obtain a generated detection result;
if the generated detection result indicates that the first image processing result is successfully generated, distributing the first image processing result to the service processing process, sending a first image release request to an image acquisition process, and indicating the image acquisition process to release the camera image and the image information based on the first image release request;
and if the generation detection result indicates that the first image processing result is failed to be generated, directly sending a first image release request to the image acquisition process to indicate the image acquisition process to release the camera image and the image information based on the first image release request.
4. The intelligent traffic management method according to claim 3, further comprising, after the distributing the first image processing result to the traffic processing process:
and acquiring a next camera image and next image information from the basic service process through the image acquisition process, and performing image processing according to the next camera image and the next image information to generate a next first image processing result.
5. The intelligent traffic management method according to claim 1, comprising, after the generating the first traffic processing result:
and the service processing process sends a second image release request to an image acquisition process, and instructs the image acquisition process to release the camera image and the image information based on the second image release request.
6. The intelligent business management method of claim 1, further comprising, prior to said obtaining camera images of the underlying business process:
acquiring task arrangement information of the basic service process and a first image transmission subscriber establishment result, and establishing connection with the basic service process and the service processing process respectively according to the task arrangement information and the first image transmission subscriber establishment result;
and the establishment result of the first image transmission subscriber is generated by the basic service process establishing the first image transmission subscriber according to the acquired task arrangement information and the establishment result of the first image transmission subscriber.
7. The intelligent business management method of claim 6, wherein the obtaining task orchestration information and first image transmission subscriber setup results for the base business process comprises:
acquiring an image distribution subscriber establishment result of an image acquisition process;
according to the image distribution subscriber establishing result and the task arrangement information, connecting with the image acquisition process;
wherein the image distribution subscriber establishment result is generated by the image acquisition process acquiring the first image transmission subscriber establishment result of the underlying business process, generated according to the underlying business process when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established successfully, and generated according to image capture hardware when the first image transmission subscriber establishment result indicates that the first image transmission subscriber is established unsuccessfully.
8. An intelligent service management method, which is applied to an image service management process, the method comprising:
acquiring a camera image of a basic service process and image information of the camera image;
performing image processing according to the camera image and the image information to generate at least one second image processing result; performing service processing according to the at least one second image processing result to generate at least one second service processing result; wherein the basic service process and the image service management process are independent of each other.
9. The intelligent business management method of claim 8, wherein the obtaining of the camera image of the underlying business process and the image information of the camera image comprises:
acquiring a second image transmission subscriber establishment result generated by the basic service process according to the established second image transmission subscriber;
if the second image transmission subscriber establishment result indicates that the second image transmission subscriber is established successfully, acquiring the camera image and the image information from the basic service process;
obtaining the camera image and the image information from image capture hardware if the second image transfer subscriber setup result indicates that the second image transfer subscriber setup failed.
10. An intelligent business management system, characterized in that the system is deployed with: a basic service process, an image processing process and a service processing process;
the image processing process acquires a camera image of a basic service process and image information of the camera image;
the image processing process carries out image processing according to the camera image and the image information to generate a first image processing result;
the image processing process sends the first image processing result to a service processing process so that the service processing process performs service processing according to the first image processing result to generate a first service processing result;
wherein the business process, the basic business process and the image processing process are independent.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210025622.4A CN114554079A (en) | 2022-01-11 | 2022-01-11 | Intelligent service management method and intelligent service management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210025622.4A CN114554079A (en) | 2022-01-11 | 2022-01-11 | Intelligent service management method and intelligent service management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114554079A true CN114554079A (en) | 2022-05-27 |
Family
ID=81670589
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210025622.4A Pending CN114554079A (en) | 2022-01-11 | 2022-01-11 | Intelligent service management method and intelligent service management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114554079A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080001953A1 (en) * | 2006-06-29 | 2008-01-03 | Fuji Xerox Co., Ltd. | Image processing device and method and storage medium storing program |
| CN105678591A (en) * | 2016-02-29 | 2016-06-15 | 北京时代云英科技有限公司 | Video-analysis-based commercial intelligent operation decision-making support system and method |
| CN108667915A (en) * | 2018-04-24 | 2018-10-16 | 百度在线网络技术（北京）有限公司 | Information transmission system, method and apparatus |
| WO2018219120A1 (en) * | 2017-05-31 | 2018-12-06 | 腾讯科技（深圳）有限公司 | Image display method, image processing method and device, terminal and server |
| CN109698938A (en) * | 2018-12-20 | 2019-04-30 | 国网北京市电力公司 | Image analysis method, apparatus and system |
| CN109783338A (en) * | 2019-01-02 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Recording method, device and computer equipment based on business information |
| CN110610363A (en) * | 2019-08-27 | 2019-12-24 | 腾讯科技（深圳）有限公司 | Method, apparatus and medium for providing service by autonomously controlling identity information |
| CN113076533A (en) * | 2020-01-03 | 2021-07-06 | 中国移动通信集团广东有限公司 | Service processing method and device |
| WO2021218432A1 (en) * | 2020-04-30 | 2021-11-04 | 华为技术有限公司 | Method and apparatus for interpreting picture book, electronic device and smart robot |
| WO2021218035A1 (en) * | 2020-04-30 | 2021-11-04 | 武汉旷视金智科技有限公司 | Video obtaining method and apparatus, terminal device, and server |
-
2022
- 2022-01-11 CN CN202210025622.4A patent/CN114554079A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080001953A1 (en) * | 2006-06-29 | 2008-01-03 | Fuji Xerox Co., Ltd. | Image processing device and method and storage medium storing program |
| CN105678591A (en) * | 2016-02-29 | 2016-06-15 | 北京时代云英科技有限公司 | Video-analysis-based commercial intelligent operation decision-making support system and method |
| WO2018219120A1 (en) * | 2017-05-31 | 2018-12-06 | 腾讯科技（深圳）有限公司 | Image display method, image processing method and device, terminal and server |
| CN108667915A (en) * | 2018-04-24 | 2018-10-16 | 百度在线网络技术（北京）有限公司 | Information transmission system, method and apparatus |
| CN109698938A (en) * | 2018-12-20 | 2019-04-30 | 国网北京市电力公司 | Image analysis method, apparatus and system |
| CN109783338A (en) * | 2019-01-02 | 2019-05-21 | 深圳壹账通智能科技有限公司 | Recording method, device and computer equipment based on business information |
| CN110610363A (en) * | 2019-08-27 | 2019-12-24 | 腾讯科技（深圳）有限公司 | Method, apparatus and medium for providing service by autonomously controlling identity information |
| CN113076533A (en) * | 2020-01-03 | 2021-07-06 | 中国移动通信集团广东有限公司 | Service processing method and device |
| WO2021218432A1 (en) * | 2020-04-30 | 2021-11-04 | 华为技术有限公司 | Method and apparatus for interpreting picture book, electronic device and smart robot |
| WO2021218035A1 (en) * | 2020-04-30 | 2021-11-04 | 武汉旷视金智科技有限公司 | Video obtaining method and apparatus, terminal device, and server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10065119B2 (en) | Game accessing method and processing method, server, terminal, and system | |
| CN110213522B (en) | Video data processing method and device and related equipment | |
| US6965399B1 (en) | Camera control system | |
| CN108429879B (en) | Electronic apparatus, camera control method, camera control apparatus, and computer-readable storage medium | |
| CN107566891B (en) | Method and system for real-time screen capture of smart television | |
| CN111901896A (en) | Information sharing method, information sharing device, electronic equipment and storage medium | |
| CN113259770B (en) | Video playing method, device, electronic equipment, medium and product | |
| CN114140945A (en) | Cabinet lattice application method and device of intelligent cabinet and computing equipment | |
| JP2009171472A (en) | System and device for monitoring network video image | |
| CN111582240A (en) | Object quantity identification method, device, equipment and medium | |
| US20030184651A1 (en) | Image distribution method | |
| AU2018432003B2 (en) | Video processing method and device, and terminal and storage medium | |
| CN115665450A (en) | Video update pushing method and terminal | |
| CN114554079A (en) | Intelligent service management method and intelligent service management system | |
| CN111263113B (en) | Data packet sending method and device and data packet processing method and device | |
| CN113660540B (en) | Image information processing method, system, display method, device and storage medium | |
| CN113014852A (en) | Information prompting method, device and equipment | |
| CN103974087B (en) | Video image file compressibility, client and method | |
| CN112948804B (en) | Program control method, device and computer readable storage medium | |
| CN106973307A (en) | A kind of video equipment access method and device | |
| US11222494B2 (en) | Indexing a video surveillance stream to match an access control credential or token with best facial image detected at a security portal method of operation and system | |
| CN112507798A (en) | Living body detection method, electronic device, and storage medium | |
| CN110673919A (en) | Screen capturing method and device | |
| JP2018106408A (en) | Information processing system, information processing device and program | |
| US20240062385A1 (en) | Method, apparatus, and non-transitory computer-readable storage medium storing a program for monitoring motion in video stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |