WO2023273155A1 - Image processing method and apparatus, and electronic device, computer-readable storage medium and computer program product - Google Patents

Image processing method and apparatus, and electronic device, computer-readable storage medium and computer program product Download PDF

Info

Publication number
WO2023273155A1
WO2023273155A1 PCT/CN2021/134884 CN2021134884W WO2023273155A1 WO 2023273155 A1 WO2023273155 A1 WO 2023273155A1 CN 2021134884 W CN2021134884 W CN 2021134884W WO 2023273155 A1 WO2023273155 A1 WO 2023273155A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
dimensional model
point
floor
orientation
Prior art date
Application number
PCT/CN2021/134884
Other languages
French (fr)
Chinese (zh)
Inventor
谭志颖
干刚
Original Assignee
西安商汤智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西安商汤智能科技有限公司 filed Critical 西安商汤智能科技有限公司
Publication of WO2023273155A1 publication Critical patent/WO2023273155A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images

Definitions

  • the present application relates to the technical field of image processing, and in particular to an image processing method and device, electronic equipment, computer-readable storage media, and computer program products.
  • the present application provides an image processing method and device, electronic equipment, a computer-readable storage medium, and a computer program product.
  • an image processing method comprising:
  • the first camera is a camera in the target scene, and the first position is the position under the coordinate system of the first three-dimensional model;
  • the method further includes:
  • camera parameters of the first camera where the camera parameters at least include one or more of the following: camera type, viewing angle;
  • the camera parameters are displayed in a visual manner in the first three-dimensional model.
  • the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional
  • the method also includes:
  • the second camera is a camera whose shooting range includes the first point
  • the third camera is a camera whose shooting range includes the second point
  • a first camera coverage index is obtained according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
  • a first camera coverage index is obtained according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
  • the first camera coverage indicator is displayed at the first point
  • the second camera coverage indicator is displayed at the second point.
  • the method before the first camera coverage indicator is displayed at the first point, the method further includes:
  • the first camera coverage index is obtained according to a ratio of the first quantity to the third quantity.
  • the displaying the first camera coverage indicator at the first point includes:
  • mapping relationship represents the mapping relationship between the camera coverage index and the color
  • the first point is displayed in the color of the first point.
  • the first camera is located on the first floor, and the method further includes:
  • the second floor is displayed in the first three-dimensional model.
  • the method before displaying the first camera in the first three-dimensional model according to the first position, the method further includes:
  • the target orientation being the orientation of the first camera in the coordinate system of the first three-dimensional model
  • the displaying the first camera in the first three-dimensional model according to the first position includes:
  • the second three-dimensional model is displayed in the first three-dimensional model.
  • the method before displaying the first camera in the first three-dimensional model according to the first position, the method further includes:
  • the displaying the first camera in the first three-dimensional model according to the first position includes:
  • the acquiring the first position of the first camera includes:
  • the second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
  • the method further includes:
  • the picture captured by the first camera is displayed in the display area of the first camera.
  • an image processing device comprising:
  • An acquisition unit configured to acquire a first three-dimensional model of the target scene and a first position of a first camera, the first camera is a camera in the target scene, and the first position is the coordinates of the first three-dimensional model position under the system;
  • a display unit configured to display the first camera in the first three-dimensional model according to the first position.
  • the acquisition unit is further configured to:
  • camera parameters of the first camera where the camera parameters at least include one or more of the following: camera type, viewing angle;
  • the display unit is further configured to display the camera parameters in a visual manner in the first three-dimensional model.
  • the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional The position of the model is different, and the image processing means further includes:
  • a processing unit configured to determine a first number of second cameras and a second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the The camera at the second point;
  • the processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
  • the processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
  • the display unit is further configured to display the first camera coverage indicator at the first point, and display the second camera coverage indicator at the second point.
  • the acquiring unit is further configured to acquire a third number of cameras on the first floor before the first camera coverage index is displayed at the first point;
  • the processing unit is further configured to obtain the first camera coverage index according to a ratio of the first quantity to the third quantity.
  • the display unit is configured as:
  • mapping relationship represents the mapping relationship between the camera coverage index and the color
  • the first point is displayed in the color of the first point.
  • the first camera is located on the first floor
  • the display unit is further configured to: when an instruction to display the second floor is detected, in the first three-dimensional model Show the second floor.
  • the acquisition unit is further configured to acquire the target orientation of the first camera before displaying the first camera in the first three-dimensional model according to the first position and the second three-dimensional model of the first camera, the target orientation is the orientation of the first camera in the coordinate system of the first three-dimensional model;
  • the display unit is configured as:
  • the second three-dimensional model is displayed in the first three-dimensional model.
  • the acquisition unit is further configured to acquire the target orientation of the first camera before displaying the first camera in the first three-dimensional model according to the first position and images from the first camera;
  • the display unit is configured as:
  • the acquisition unit is configured to:
  • the second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
  • the display unit is further configured as:
  • the picture captured by the first camera is displayed in the display area of the first camera.
  • an electronic device including: a processor and a memory, the memory is configured to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions , the electronic device executes the method according to the foregoing first aspect and any possible implementation manner thereof.
  • another electronic device including: a processor, a sending device, an input device, an output device, and a memory, the memory is configured to store computer program codes, the computer program codes include computer instructions, and in the When the processor executes the computer instruction, the electronic device executes the method according to the above first aspect and any possible implementation manner thereof.
  • a computer-readable storage medium is provided.
  • a computer program is stored in the computer-readable storage medium, and the computer program includes program instructions.
  • the program instructions are executed by a processor, the The processor executes the method according to the first aspect and any possible implementation manner thereof.
  • a computer program product includes a computer program or an instruction, and when the computer program or instruction is run on a computer, the computer executes the first aspect and any of the above-mentioned aspects.
  • FIG. 1 is a schematic flow diagram of an image processing method provided in an embodiment of the present application
  • FIG. 2 is a schematic diagram of camera parameters of a visualized first camera provided in an embodiment of the present application
  • Fig. 3 is a schematic diagram of the effect of displaying floors in the first three-dimensional model provided by the embodiment of the present application;
  • Fig. 4 is another schematic diagram showing the effect of displaying floors in the first three-dimensional model provided by the embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of an image processing device provided in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of a hardware structure of an image processing device provided by an embodiment of the present application.
  • At least one (item) means one or more
  • “multiple” means two or more
  • at least two (items) means two or three And three or more
  • "and/or” is used to describe the association relationship of associated objects, indicating that there can be three types of relationships, for example, "A and/or B” can mean: only A exists, only B exists, and A exists at the same time and B, where A and B can be singular or plural.
  • the character "/" can indicate that the contextual objects are an "or” relationship, which refers to any combination of these items, including any combination of single items (items) or plural items (items).
  • At least one item (piece) of a, b or c can mean: a, b, c, "a and b", “a and c", “b and c", or "a and b and c ", where a, b, c can be single or multiple.
  • an embodiment of the present application provides an image processing method to improve the display effect of the position of the camera in the venue.
  • [a, b] will be used below to represent the value interval greater than or equal to a and less than or equal to b
  • (c, d) will be used to represent the value interval greater than c and less than or equal to d
  • [e, f) represents the value interval greater than or equal to e and less than f.
  • the execution subject of the embodiment of the present application is an image processing device, wherein the image processing device may be any electronic device capable of executing the technical solutions disclosed in the method embodiments of the present application.
  • the image processing device may be one of the following: a mobile phone, a computer, a tablet computer, and a wearable smart device.
  • FIG. 1 is a schematic flowchart of an image processing method provided in an embodiment of the present application.
  • the target scene may be any scene.
  • the target scene is inside a building; for another example, the target scene is an underground parking lot; for another example, the target scene is a campus; for another example, the target scene is a scene in a shopping mall.
  • the three-dimensional model (including the first three-dimensional model and the second three-dimensional model to be mentioned below) may be a computer-aided design (computer aided design, CAD) three-dimensional model, and the three-dimensional model may also be a three-dimensional convex hull, A 3D model can also be a 3D point cloud.
  • CAD computer aided design
  • the first camera is a camera in the target scene.
  • the first position is the position of the first camera in the coordinate system of the first three-dimensional model.
  • the image processing device uses the 3D model of the target scene input by the user through the input component as the first 3D model.
  • the above-mentioned input components include: a keyboard, a mouse, a touch screen, a touch pad and an audio input device.
  • the image processing apparatus receives the 3D model of the target scene sent by the terminal as the first 3D model.
  • the above-mentioned terminal can be any of the following: mobile phone, computer, tablet computer, server.
  • the image processing device includes a laser radar.
  • the image processing device scans the target scene through the laser radar, and obtains a 3D model of the target scene as a first 3D model.
  • the image processing apparatus uses the position of the first camera input by the user through the input component as the first position.
  • the image processing apparatus receives the position of the first camera sent by the terminal as the first position.
  • the image processing device acquires the second position of the first camera in the global positioning system and the coordinate transformation relationship, wherein the coordinate transformation relationship is the coordinate system of the global positioning system The conversion relationship with the coordinate system of the first 3D model.
  • the image processing device converts the second position according to the coordinate transformation relationship to obtain the first position of the first camera.
  • acquiring the first three-dimensional model of the target scene and acquiring the first position of the first camera may be performed separately, or may be performed simultaneously.
  • the image processing device displays the first camera in the first three-dimensional model according to the first position, so as to more intuitively display the position of the first camera in the target scene.
  • the image processing apparatus may display any camera in the target scene in the first three-dimensional model.
  • the image processing device also performs the following steps:
  • the camera parameters include one or more of the following: orientation, camera type, and viewing angle.
  • the orientation may be the orientation of the camera in the coordinate system of the first three-dimensional model, or the coordinates of the camera in the coordinate system of the global positioning system.
  • Camera types include dome cameras, bolt cameras, and dome cameras.
  • the viewing angle may be the shooting range of the camera in the coordinate system of the first three-dimensional model, and the shooting range may also be the coordinates of the camera in the global positioning system coordinate system.
  • the image processing device uses the camera parameters input by the user through the input component as the camera parameters of the first camera.
  • the image processing apparatus receives the camera parameters sent by the terminal as the camera parameters of the first camera.
  • visualization refers to converting data into graphics or images for display on the screen.
  • the image processing device displays the camera parameters in the first three-dimensional model in a visualized manner, which can make the display effect of the first camera more intuitive.
  • the effect shown in FIG. 2 can be obtained by displaying camera parameters in a scalable manner, wherein the fan-shaped area captured by the first camera is the shooting range of the camera.
  • the first camera is a dome camera, that is, the first camera is a dome camera.
  • the orientation of the first camera can also be intuitively felt through FIG. 2 .
  • the image processing device can improve the display effect of the camera parameters of the first camera by performing step 1 and step 2
  • the image processing device also performs the following steps:
  • previewing the picture captured by the first camera may be displaying the image or video stream captured by the first camera.
  • the instruction to preview the picture captured by the first camera may be an instruction input by the user to the image processing device through the input component.
  • the image processing device displays the first three-dimensional model on the touch screen
  • the image processing device when the user touches the first camera in the first three-dimensional model, the image processing device generates an instruction to preview the picture captured by the first camera .
  • the image processing device displays the first 3D model on the screen, and the user clicks the first camera in the first 3D model with a mouse cursor, the image processing device generates an instruction to preview the image captured by the first camera.
  • the instruction to preview the image captured by the first camera may also be an instruction generated when a condition for previewing the image captured by the first camera is met.
  • the condition for previewing the picture captured by the first camera is that the target object appears within the shooting range of the first camera.
  • the image processing device determines that the image captured by the first camera contains the target object by comparing the image captured by the first camera with the image containing the target object, it determines that the target object appears within the shooting range of the first camera, that is, determines Meet the conditions for previewing the images captured by the first camera.
  • image processing determines that Zhang San appears in the shooting range of the first camera when the image captured by the first camera is compared with Zhang San's face image to determine that the image captured by the first camera contains Zhang San Then, it is determined that the conditions for previewing the picture captured by the first camera are satisfied.
  • the condition for previewing the picture captured by the first camera is that the duration of the target object appearing in the shooting range of the first camera exceeds a duration threshold.
  • the image processing device compares the image captured by the first camera with the image containing the target object and determines that the duration of the target object appearing in the shooting range of the first camera exceeds the duration threshold, it determines that the first camera meets the preview requirement. The condition of the captured picture.
  • the display area of the first camera is used to display the picture captured by the first camera, and the display area of the first camera is located in the display area of the first three-dimensional model.
  • the display area of the first camera points to the first camera, indicating that the picture displayed in the display area of the first camera is captured by the first camera screen.
  • the display area of the first camera is a head up display (head up display, HUD) layer where the first camera is located.
  • HUD head up display
  • the image processing device can display the pictures captured by the first camera in the display area of the first camera to make the pictures captured by the first camera
  • the display of the picture is more intuitive, so that the user can feel more intuitively that the picture displayed in the display area of the first camera is the picture collected by the first camera. If the display area of the first camera is located in the area covered by the first three-dimensional model, the display effect of the picture captured by the first camera can be further improved.
  • the first three-dimensional model includes a first point and a second point, and a position of the first point in the first three-dimensional model is different from a position of the second point in the first three-dimensional model.
  • the image processing device also performs the following steps:
  • the second camera is a camera whose shooting range includes the first point
  • the third camera is a camera whose shooting range includes the second point.
  • the first camera coverage index is obtained according to the first quantity, and the first camera coverage index is positively correlated with the first quantity.
  • the first camera coverage index is obtained according to the above-mentioned first quantity, and the above-mentioned second camera coverage index is positively correlated with the above-mentioned second quantity.
  • the camera coverage index of a certain point is used to represent the number of cameras whose shooting range covers the point.
  • the first number is n 1
  • the second number is n 2
  • the coverage index of the first camera is i 1
  • the coverage index of the second camera is i 2 .
  • n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
  • k 1 and k 2 are positive numbers
  • c 1 and c 2 are real numbers.
  • n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
  • k 1 and k 2 are positive numbers
  • c 1 and c 2 are real numbers.
  • n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
  • k 1 and k 2 are positive numbers
  • c 1 and c 2 are real numbers.
  • the shooting range of camera a and the shooting range of camera b both include point A, that is, the number of cameras whose shooting range includes point A is 2.
  • the shooting range of camera c includes point B, that is, the number of cameras whose shooting range includes point B is 1. Since the number of cameras whose shooting range includes point A is greater than the number of cameras whose shooting range includes point B, the information of point A obtained through the camera (including camera a and camera b) is greater than the information of point B obtained through the camera (ie, camera c). Point information is accurate.
  • camera a captures image d containing person C.
  • camera b captures image e containing person C.
  • camera c captures image f containing person D.
  • the attribute information of person C determined based on image d and image e (including clothing attributes and appearance attributes) is more accurate than the attribute information of person C determined based on image f.
  • the image processing device can intuitively display the accuracy of the information of the first point acquired through the camera by displaying the coverage index of the first camera at the first point. Similarly, by displaying the coverage index of the second camera at the second point, the image processing device can visually display the accuracy of the information of the second point acquired through the camera.
  • the image processing device may display the camera coverage indicators of different floors based on steps 4 to 7 to improve the display effect of the camera coverage indicators.
  • the display effect of the image processing device displaying different floors in the first three-dimensional model can be referred to FIG. 3 and FIG. 4 .
  • the building shown in Figure 3 is the same as the building shown in Figure 4, and the target scene is the interior of the building.
  • the floor shown in Figure 3 is the A floor of the target scene
  • the floor shown in Figure 4 is the B floor of the target scene, that is, the display effect of the image processing device displaying the A floor in the first three-dimensional model can be referred to in Figure 3, the image processing device Refer to FIG. 4 for the display effect of displaying the B floor in the first three-dimensional model.
  • the first point belongs to the first floor
  • the second point belongs to the second floor, wherein the first floor and the second floor are different.
  • the image processing device may display the camera coverage index of the first point when displaying the first floor, and display the camera coverage index of the second point when displaying the second floor.
  • the first point and the second point are only examples, and should not be understood as only displaying the camera coverage indicators of any two points in the first three-dimensional model.
  • the image processing device may display camera coverage indicators of all points in the first three-dimensional model.
  • the camera coverage indicator can only be displayed at one point in the first floor, nor that it can only be displayed in the second floor A dot shows the camera coverage indicator.
  • the camera coverage index can be displayed at one or more points on the first floor, and the camera coverage index can also be displayed at one or more points on the second floor.
  • the third number is the number of cameras on the first floor.
  • the image processing device uses the number of cameras on the first floor input by the user through the input component as the third number.
  • the image processing device receives the number of cameras on the first floor sent by the terminal as the third number.
  • the ratio of the first quantity to the third quantity the first quantity/the third quantity. For example, if the first quantity is 10 and the third quantity is 30, then the ratio of the first quantity to the third quantity is 1/3.
  • n 3 and i 1 satisfy the following formula:
  • k 3 is a positive number
  • c 3 is a real number
  • n 3 and i 1 satisfy the following formula:
  • k 3 is a positive number
  • c 3 is a real number
  • n 3 and i 1 satisfy the following formula:
  • i 1 (k 3 ⁇ n 3 +c 3 ) 2 (6)
  • k 3 is a positive number
  • c 3 is a real number
  • the image processing device acquires the fourth number of cameras on the second floor, and obtains the second camera coverage index according to a ratio between the second number and the fourth number.
  • the image processing device displays the first camera coverage index at the first point by performing the following steps:
  • mapping relationship represents the mapping relationship between the camera coverage index and the color.
  • the camera coverage index represented by green is larger than the camera coverage index represented by red.
  • the darker the color the greater the coverage index of the camera.
  • the image processing apparatus obtains the first camera coverage index by performing step 8.
  • the mapping relationship can be seen in the table below:
  • the image processing apparatus acquires the mapping relationship input by the user through the input component.
  • the image processing apparatus receives the mapping relationship sent by the terminal to acquire the mapping relationship.
  • the first camera is located on the first floor.
  • the image processing device displays the first camera in the first three-dimensional model, that is, the image processing device displays the first floor in the first three-dimensional model.
  • the image processing apparatus displays the first floor in the first three-dimensional model by hiding floors in the first three-dimensional model except the first floor.
  • the first three-dimensional model has five floors in total, and the first floor is the third floor in the first three-dimensional model.
  • the image processing device can hide the fourth floor and the fifth floor in the first three-dimensional model, and then display the first floor while displaying the appearance of the first three-dimensional model. Since the first floor is the third floor, the first floor and the second floor will be covered when the first floor is displayed. In this way, when the first 3D model is displayed, the first floor and the second floor will be avoided. Display the resulting interference, thereby improving the display effect of the first floor.
  • the image processing device acquires road network information of the first floor, and determines whether the first point belongs to the feasible area according to the road network information.
  • the step of displaying the coverage indicator of the first camera at the first point is performed, wherein the feasible area refers to an area where people can walk.
  • the image processing device also performs the following steps:
  • the image processing device switches the floor displayed on the first three-dimensional model to the second floor when an instruction to display the second floor is detected.
  • the instruction to display the second floor may be an instruction input by the user to the image processing device through the input component.
  • the image processing device displays the first 3D model and the floor information of the first 3D model on the display page
  • the image processing device when the user touches the second floor in the floor information through the touch screen, the image processing device generates an instruction to display the second floor.
  • the image processing device displays the first 3D model and the floor information of the first 3D model on the screen, and the user clicks the second floor in the floor information with the mouse cursor, the image processing device generates an instruction to display the second floor.
  • the command to display the second floor may be a command generated when a condition for displaying the second floor is satisfied.
  • the condition for displaying the second floor is that the target object is present in the second floor.
  • the image processing device determines that the target object appears on the second floor when determining that the image collected by the camera on the second floor contains the target object by comparing the image captured by the camera on the second floor with the image containing the target object, That is, it is determined that the condition for displaying the second floor is satisfied.
  • image processing compares the image captured by the camera on the second floor with the face image of Zhang San and determines that the image captured by the camera on the second floor contains Zhang San, and determines that Zhang San appears in In the second floor, it is further determined that the condition for displaying the second floor is satisfied.
  • the condition for displaying the second floor is that a fire event occurs on the second floor.
  • the image processing device determines that the condition for displaying the second floor is met when the image processing device determines that a fire event occurs on the second floor by processing the image collected by the camera in the second floor.
  • the image processing device displays the second floor in the first three-dimensional model by hiding floors in the first three-dimensional model except the second floor.
  • the first three-dimensional model has five floors
  • the second floor is the fourth floor in the first three-dimensional model.
  • the image processing device can hide the fifth floor in the first three-dimensional model, and then display the second floor while displaying the appearance of the first three-dimensional model. Since the second floor is the fourth floor, the first, second and third floors will be covered when the second floor is displayed, so that when the first 3D model is displayed, the first, second and third floors The interference caused by the third floor to the display of the second floor, thereby improving the display effect of the second floor.
  • the image processing device further performs the following steps before performing step 102:
  • the target orientation is the orientation of the first camera
  • the target orientation represents the shooting direction of the first camera
  • the second 3D model is the 3D model of the first camera.
  • the image processing apparatus takes the orientation of the first camera input by the user through the input component as the target orientation.
  • the image processing apparatus receives the orientation of the first camera sent by the terminal as the target orientation.
  • the image processing device acquires the orientation and coordinate transformation relationship of the first camera in the target scene, wherein the coordinate transformation relationship is the global positioning system coordinate system and the first three-dimensional model The conversion relationship between the coordinate systems.
  • the image processing device converts the orientation of the first camera in the target scene into the orientation of the first camera in the first three-dimensional model according to the coordinate transformation relationship to obtain the orientation of the target.
  • the image processing apparatus uses the 3D model of the first camera input by the user through the input component as the second 3D model.
  • the image processing apparatus receives the 3D model of the first camera sent by the terminal as the second 3D model.
  • the image processing device includes a laser radar.
  • the image processing device uses the laser radar to scan the first camera to obtain the 3D model of the first camera as the second 3D model.
  • acquiring the second three-dimensional model of the first camera and acquiring the target orientation of the first camera may be performed separately, or may be performed simultaneously.
  • step 14 the image processing device executes the following steps in the process of executing step 102:
  • step 15 the image processing device determines the position of the second 3D model in the first 3D model according to the first position, and determines the orientation of the second 3D model in the first 3D model according to the orientation of the target, and then according to the second 3D model
  • the position in the first three-dimensional model and the orientation of the second three-dimensional model in the first three-dimensional model display the second three-dimensional model in the first three-dimensional model, so as to achieve better display effect, so that the second three-dimensional model is displayed in the first three-dimensional model
  • the display effect of the 2D and 3D models is more realistic.
  • the second 3D model can accurately display the first position (ie, the abscissa, ordinate and vertical coordinate of the first camera in the first 3D model), by displaying the second 3D model in the first 3D model, the The accuracy of the displayed position of the first camera.
  • the display effect obtained by the image processing device by performing step 15 can be referred to in FIG. 2 .
  • the image processing device further performs the following steps before performing step 102:
  • the image of the first camera may be obtained by shooting the first camera.
  • the image processing device After performing step 16, the image processing device performs the following steps in the process of performing step 102:
  • the cost of obtaining the image of the first camera is low, and the difficulty of displaying the image of the first camera in the first 3D model is low, and the amount of data processing is low, by performing step 16 and step 17 in the first The first camera is displayed in the 3D model, which can reduce the cost and reduce the amount of data processing.
  • the embodiment of the present application also provides a possible application scenario.
  • the layout of the surveillance cameras includes: the installation height of the surveillance cameras, the orientation of the surveillance cameras, the shooting range of the surveillance cameras, and the coverage indicators of the cameras at various locations within the site.
  • the monitoring camera can be displayed in the three-dimensional model of the place, and the camera parameters of the monitoring camera and the position of the monitoring camera can be visually displayed, so that relevant personnel can observe the location of the monitoring camera without going to the place Layout, thereby reducing the labor cost and time cost of observing the layout of the monitoring cameras in the place, and improving the efficiency of relevant personnel observing the layout of the monitoring cameras in the place.
  • the display effect of the three-dimensional model of the monitoring camera in the place can be changed, so that relevant personnel can observe the effect after adjusting the layout of the monitoring camera through the image processing device, thereby Reduce the labor cost and time cost of relevant personnel to adjust the layout of surveillance cameras in the site, thereby improving the work efficiency of relevant personnel.
  • surveillance cameras are installed in many places in the building of Company A, but according to the actual monitoring effect, it can be determined that there is a dead spot in surveillance at B in Building A.
  • the relevant personnel of company A added a surveillance camera to the 3D model of the building, and reasonably arranged the height and orientation of the surveillance camera, so that the dead angle at point B was within the shooting range of the surveillance camera, so as to remove the monitoring blind spots.
  • the relevant personnel determine that the monitoring dead angle of B can be removed, they can adjust the layout of the surveillance cameras, which can reduce labor costs and time costs, and improve the work efficiency of relevant personnel.
  • the writing order of each step does not mean a strict execution order and constitutes any limitation on the implementation process.
  • the specific execution order of each step should be based on its function and possible
  • the inner logic is OK.
  • FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the present application.
  • the image processing device 1 includes an acquisition unit 11 and a display unit 12 .
  • the image processing device 1 further includes a processing unit 13 . in:
  • the acquisition unit 11 is configured to acquire a first three-dimensional model of the target scene and a first position of a first camera, the first camera is a camera in the target scene, and the first position is a position of the first three-dimensional model position in the coordinate system;
  • the display unit 12 is configured to display the first camera in the first three-dimensional model according to the first position.
  • the acquisition unit 11 is further configured to:
  • camera parameters of the first camera where the camera parameters at least include one or more of the following: camera type, viewing angle;
  • the display unit 12 is further configured to display the camera parameters in a visual manner in the first three-dimensional model.
  • the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional
  • the positions in the model are different
  • the image processing device 1 also includes:
  • the processing unit 13 is configured to determine a first number of second cameras and a second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the first point The camera mentioned in the second point;
  • the processing unit 13 is further configured to obtain a first camera coverage index according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
  • the processing unit 13 is further configured to obtain a first camera coverage index according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
  • the display unit 12 is further configured to display the first camera coverage indicator at the first point, and display the second camera coverage indicator at the second point.
  • the acquiring unit 11 is further configured to acquire a third number of cameras on the first floor before the first camera coverage indicator is displayed at the first point;
  • the processing unit 13 is further configured to obtain the first camera coverage index according to a ratio of the first number to the third number.
  • the display unit 12 is configured as:
  • mapping relationship represents the mapping relationship between the camera coverage index and the color
  • the first point is displayed in the color of the first point.
  • the first camera is located on the first floor
  • the display unit 12 is further configured to: when an instruction to display the second floor is detected, the first three-dimensional model The second floor is shown in .
  • the acquisition unit 11 is further configured to acquire the target of the first camera before displaying the first camera in the first three-dimensional model according to the first position orientation and a second three-dimensional model of the first camera, the target orientation being the orientation of the first camera in the coordinate system of the first three-dimensional model;
  • the display unit 12 is configured as:
  • the second three-dimensional model is displayed in the first three-dimensional model.
  • the acquisition unit 11 is further configured to acquire the target of the first camera before displaying the first camera in the first three-dimensional model according to the first position Heading and the image of the first camera;
  • the display unit 12 is configured as:
  • the acquisition unit 11 is configured to:
  • the second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
  • the display unit 12 is further configured as:
  • the picture captured by the first camera is displayed in the display area of the first camera.
  • the image processing device displays the first camera in the first three-dimensional model according to the first position, which can more intuitively show the position of the first camera in the target scene.
  • the functions or modules included in the device provided in the embodiments of the present application can be configured to execute the methods described in the above method embodiments, and its specific implementation can refer to the descriptions of the above method embodiments. For brevity, here No longer.
  • FIG. 6 is a schematic diagram of a hardware structure of an image processing device provided by an embodiment of the present application.
  • the image processing device 2 includes a processor 21 , a memory 22 , an input device 23 and an output device 24 .
  • the processor 21, the memory 22, the input device 23 and the output device 24 are coupled through connectors, and the connectors include various interfaces, transmission lines or buses, etc., which are not limited in this embodiment of the present application. It should be understood that in various embodiments of the present application, coupling refers to interconnection in a specific way, including direct connection or indirect connection through other devices, for example, connection through various interfaces, transmission lines, and buses.
  • the processor 21 may be one or more graphics processing units (graphics processing unit, GPU), and in the case where the processor 21 is a GPU, the GPU may be a single-core GPU or a multi-core GPU.
  • the processor 21 may be a processor group composed of multiple GPUs, and the multiple processors are coupled to each other through one or more buses.
  • the processor may also be other types of processors, etc., which are not limited in this embodiment of the present application.
  • the memory 22 can be configured to store computer program instructions, and various computer program codes configured to execute the program codes of the solutions of the present application.
  • the memory includes but is not limited to random access memory (random access memory, RAM), read-only memory (read-only memory, ROM), erasable programmable read-only memory (erasable programmable read only memory, EPROM ), or a portable read-only memory (compact disc read-only memory, CD-ROM), which is configured to store relevant instructions and data.
  • the input device 23 is configured to input data and/or signals
  • the output device 24 is configured to output data and/or signals.
  • the input device 23 and the output device 24 can be independent devices, or an integrated device.
  • the memory 22 can be configured not only to store relevant instructions, but also to store relevant data, for example, the memory 22 can be configured to store the first three-dimensional model and the first position obtained through the input device 23, etc. etc., the embodiment of the present application does not limit the specific data stored in the memory.
  • FIG. 6 only shows a simplified design of an image processing device.
  • the image processing device may also include other necessary components, including but not limited to any number of input/output devices, processors, memories, etc., and all image processing devices that can implement the embodiments of the present application are included in this within the scope of the application.
  • the disclosed systems, devices and methods may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one display unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in or transmitted via a computer-readable storage medium.
  • the computer instructions can be sent from a web site, computer, server, or data center via wired (e.g. coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device including a server, a data center, and the like integrated with one or more available media.
  • the available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a digital versatile disc (digital versatile disc, DVD)), or a semiconductor medium (for example, a solid state disk (solid state disk, SSD) )Wait.
  • the processes can be completed by computer programs to instruct related hardware.
  • the programs can be stored in computer-readable storage media.
  • When the programs are executed may include the processes of the foregoing method embodiments.
  • the aforementioned storage medium includes: various media capable of storing program codes such as read-only memory (ROM) or random access memory (RAM), magnetic disk or optical disk.
  • Embodiments of the present disclosure provide an image processing method and device, electronic equipment, a computer-readable storage medium, and a computer program product, wherein the method includes: acquiring a first three-dimensional model of a target scene and a first position of a first camera, and the second A camera is a camera in the target scene, and the first position is a position in the coordinate system of the first 3D model; the first camera is displayed in the first 3D model according to the first position.
  • the technical solutions provided by the embodiments of the present disclosure improve the display effect of the position of the camera in the venue.

Abstract

Disclosed in the present application are an image processing method and apparatus, and an electronic device, a computer-readable storage medium and a computer program product. The method comprises: acquiring a first three-dimensional model of a target scene and a first position of a first camera, wherein the first camera is a camera in the target scene, and the first position is a position in a coordinate system of the first three-dimensional model; and according to the first position, displaying the first camera in the first three-dimensional model.

Description

图像处理方法及装置、电子设备、计算机可读存储介质及计算机程序产品Image processing method and device, electronic device, computer-readable storage medium, and computer program product
相关申请的交叉引用Cross References to Related Applications
本申请基于申请号为202110730285.4、申请日为2021年06月29日,申请名称为“图像处理方法及装置、电子设备及计算机可读存储介质”的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此以引入方式结合在本申请中。This application is based on the Chinese patent application with the application number 202110730285.4, the filing date is June 29, 2021, and the application name is "Image processing method and device, electronic equipment and computer-readable storage medium", and requires the Chinese patent application Priority, the entire content of this Chinese patent application is hereby incorporated in this application by way of introduction.
技术领域technical field
本申请涉及图像处理技术领域,尤其涉及一种图像处理方法及装置、电子设备、计算机可读存储介质及计算机程序产品。The present application relates to the technical field of image processing, and in particular to an image processing method and device, electronic equipment, computer-readable storage media, and computer program products.
背景技术Background technique
随着科技的发展,成像设备的应用场景越来越多,如越来越多的场所内安装了摄像头,以便根据摄像头采集到的视频流进行安全防护。为更好的管理摄像头以及确定视频流的采集地点,需要获知摄像头的安装位置。因此,如何更好的显示摄像头的位置信息具有非常重要的意义。With the development of science and technology, there are more and more application scenarios of imaging equipment. For example, cameras are installed in more and more places for security protection based on the video streams collected by the cameras. In order to better manage the camera and determine the collection location of the video stream, it is necessary to know the installation location of the camera. Therefore, how to better display the location information of the camera is of great significance.
发明内容Contents of the invention
本申请提供一种图像处理方法及装置、电子设备、计算机可读存储介质及计算机程序产品。The present application provides an image processing method and device, electronic equipment, a computer-readable storage medium, and a computer program product.
第一方面,提供了一种图像处理方法,所述方法包括:In a first aspect, an image processing method is provided, the method comprising:
获取目标场景的第一三维模型以及第一摄像头的第一位置,所述第一摄像头为所述目标场景内的摄像头,所述第一位置为所述第一三维模型的坐标系下的位置;Acquiring the first three-dimensional model of the target scene and the first position of the first camera, the first camera is a camera in the target scene, and the first position is the position under the coordinate system of the first three-dimensional model;
依据所述第一位置在所述第一三维模型中显示所述第一摄像头。displaying the first camera in the first three-dimensional model according to the first position.
结合本申请任一实施方式,所述方法还包括:In combination with any embodiment of the present application, the method further includes:
获取所述第一摄像头的摄像头参数,所述摄像头参数至少包括以下中的一个或一个以上:摄像头类型、可视角度;Obtain camera parameters of the first camera, where the camera parameters at least include one or more of the following: camera type, viewing angle;
在所述第一三维模型中以可视化的方式显示所述摄像头参数。The camera parameters are displayed in a visual manner in the first three-dimensional model.
结合本申请任一实施方式,所述第一三维模型包括第一点和第二点,所述第一点在所述第一三维模型中的位置和所述第二点在所述第一三维模型中的位置不同,所述方法还包括:In combination with any embodiment of the present application, the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional Depending on the location in the model, the method also includes:
确定第二摄像头的第一数量和第三摄像头的第二数量,所述第二摄像头为拍摄范围包括所述第一点的摄像头,所述第三摄像头为拍摄范围包括所述第二点的摄像头;Determining the first number of second cameras and the second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the second point ;
依据所述第一数量得到第一摄像头覆盖指标,所述第一摄像头覆盖指标与所述第一数量呈正相关;A first camera coverage index is obtained according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
依据所述第一数量得到第一摄像头覆盖指标,所述第二摄像头覆盖指标与所述第二数量呈正相关;A first camera coverage index is obtained according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
在所述第一点显示所述第一摄像头覆盖指标,并在所述第二点显示所述第二摄像头覆盖指标。The first camera coverage indicator is displayed at the first point, and the second camera coverage indicator is displayed at the second point.
结合本申请任一实施方式,所述在所述第一点显示第一摄像头覆盖指标之前,所述 方法还包括:In combination with any embodiment of the present application, before the first camera coverage indicator is displayed at the first point, the method further includes:
获取第一楼层内的摄像头的第三数量;Get the third number of cameras in the first floor;
依据所述第一数量与所述第三数量的比值得到所述第一摄像头覆盖指标。The first camera coverage index is obtained according to a ratio of the first quantity to the third quantity.
结合本申请任一实施方式,所述在所述第一点显示第一摄像头覆盖指标,包括:In combination with any implementation manner of the present application, the displaying the first camera coverage indicator at the first point includes:
获取映射关系,所述映射关系表征摄像头覆盖指标与颜色之间的映射关系;Obtain a mapping relationship, the mapping relationship represents the mapping relationship between the camera coverage index and the color;
依据所述第一摄像头覆盖指标确定所述第一点的颜色;Determine the color of the first point according to the first camera coverage index;
以所述第一点的颜色显示所述第一点。The first point is displayed in the color of the first point.
结合本申请任一实施方式,所述第一摄像头位于所述第一楼层,所述方法还包括:In combination with any embodiment of the present application, the first camera is located on the first floor, and the method further includes:
在检测到显示第二楼层的指令的情况下,在所述第一三维模型中显示所述第二楼层。In case an instruction to display a second floor is detected, the second floor is displayed in the first three-dimensional model.
结合本申请任一实施方式,在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,所述方法还包括:In combination with any embodiment of the present application, before displaying the first camera in the first three-dimensional model according to the first position, the method further includes:
获取所述第一摄像头的目标朝向和所述第一摄像头的第二三维模型,所述目标朝向为所述第一摄像头在所述第一三维模型的坐标系下的朝向;Acquiring the target orientation of the first camera and the second three-dimensional model of the first camera, the target orientation being the orientation of the first camera in the coordinate system of the first three-dimensional model;
所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头,包括:The displaying the first camera in the first three-dimensional model according to the first position includes:
将所述第一位置作为所述第二三维模型在所述第一三维模型中的位置,并将所述朝向作为所述第二三维模型在所述第一三维模型中的朝向,在所述第一三维模型中显示所述第二三维模型。Taking the first position as the position of the second 3D model in the first 3D model, and taking the orientation as the orientation of the second 3D model in the first 3D model, in the The second three-dimensional model is displayed in the first three-dimensional model.
结合本申请任一实施方式,在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,所述方法还包括:In combination with any embodiment of the present application, before displaying the first camera in the first three-dimensional model according to the first position, the method further includes:
获取所述第一摄像头的目标朝向和所述第一摄像头的图像;Acquiring the target orientation of the first camera and the image of the first camera;
所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头,包括:The displaying the first camera in the first three-dimensional model according to the first position includes:
依据所述第一位置和所述目标朝向,在所述第一三维模型中显示所述第一摄像头的图像。Displaying the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
结合本申请任一实施方式,所述获取第一摄像头的第一位置,包括:In combination with any implementation manner of the present application, the acquiring the first position of the first camera includes:
获取所述第一摄像头在全球定位系统中的第二位置和坐标转换关系,所述坐标转换关系为所述全球定位系统的坐标系与所述第一三维模型的坐标系之间的转换关系;Obtaining a second position of the first camera in the global positioning system and a coordinate transformation relationship, where the coordinate transformation relationship is a transformation relationship between the coordinate system of the global positioning system and the coordinate system of the first three-dimensional model;
依据坐标转换关系对所述第二位置进行转换,得到所述第一摄像头的第一位置。The second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
结合本申请任一实施方式,所述方法还包括:In combination with any embodiment of the present application, the method further includes:
在检测到预览所述第一摄像头采集到的画面的指令的情况下,在所述第一摄像头的显示区域内显示所述第一摄像头采集到的画面。If an instruction to preview the picture captured by the first camera is detected, the picture captured by the first camera is displayed in the display area of the first camera.
第二方面,提供了一种图像处理装置,所述装置包括:In a second aspect, an image processing device is provided, the device comprising:
获取单元,配置为获取目标场景的第一三维模型以及第一摄像头的第一位置,所述第一摄像头为所述目标场景内的摄像头,所述第一位置为所述第一三维模型的坐标系下的位置;An acquisition unit configured to acquire a first three-dimensional model of the target scene and a first position of a first camera, the first camera is a camera in the target scene, and the first position is the coordinates of the first three-dimensional model position under the system;
显示单元,配置为依据所述第一位置在所述第一三维模型中显示所述第一摄像头。A display unit configured to display the first camera in the first three-dimensional model according to the first position.
结合本申请任一实施方式,所述获取单元,还配置为:In combination with any implementation manner of the present application, the acquisition unit is further configured to:
获取所述第一摄像头的摄像头参数,所述摄像头参数至少包括以下中的一个或一个以上:摄像头类型、可视角度;Obtain camera parameters of the first camera, where the camera parameters at least include one or more of the following: camera type, viewing angle;
所述显示单元,还配置为在所述第一三维模型中以可视化的方式显示所述摄像头参数。The display unit is further configured to display the camera parameters in a visual manner in the first three-dimensional model.
结合本申请任一实施方式,所述第一三维模型包括第一点和第二点,所述第一点在所述第一三维模型中的位置和所述第二点在所述第一三维模型中的位置不同,所述图像处理装置,还包括:In combination with any embodiment of the present application, the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional The position of the model is different, and the image processing means further includes:
处理单元,配置为确定第二摄像头的第一数量和第三摄像头的第二数量,所述第二 摄像头为拍摄范围包括所述第一点的摄像头,所述第三摄像头为拍摄范围包括所述第二点的摄像头;A processing unit configured to determine a first number of second cameras and a second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the The camera at the second point;
所述处理单元,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第一摄像头覆盖指标与所述第一数量呈正相关;The processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
所述处理单元,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第二摄像头覆盖指标与所述第二数量呈正相关;The processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
所述显示单元,还配置为在所述第一点显示所述第一摄像头覆盖指标,并在所述第二点显示所述第二摄像头覆盖指标。The display unit is further configured to display the first camera coverage indicator at the first point, and display the second camera coverage indicator at the second point.
结合本申请任一实施方式,所述获取单元,还配置为在所述第一点显示第一摄像头覆盖指标之前,获取第一楼层内的摄像头的第三数量;In combination with any embodiment of the present application, the acquiring unit is further configured to acquire a third number of cameras on the first floor before the first camera coverage index is displayed at the first point;
所述处理单元,还配置为依据所述第一数量与所述第三数量的比值得到所述第一摄像头覆盖指标。The processing unit is further configured to obtain the first camera coverage index according to a ratio of the first quantity to the third quantity.
结合本申请任一实施方式,所述显示单元配置为:In combination with any embodiment of the present application, the display unit is configured as:
获取映射关系,所述映射关系表征摄像头覆盖指标与颜色之间的映射关系;Obtain a mapping relationship, the mapping relationship represents the mapping relationship between the camera coverage index and the color;
依据所述第一摄像头覆盖指标确定所述第一点的颜色;Determine the color of the first point according to the first camera coverage index;
以所述第一点的颜色显示所述第一点。The first point is displayed in the color of the first point.
结合本申请任一实施方式,所述第一摄像头位于所述第一楼层,所述显示单元,还配置为:在检测到显示第二楼层的指令的情况下,在所述第一三维模型中显示所述第二楼层。In combination with any embodiment of the present application, the first camera is located on the first floor, and the display unit is further configured to: when an instruction to display the second floor is detected, in the first three-dimensional model Show the second floor.
结合本申请任一实施方式,所述获取单元,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的第二三维模型,所述目标朝向为所述第一摄像头在所述第一三维模型的坐标系下的朝向;In combination with any embodiment of the present application, the acquisition unit is further configured to acquire the target orientation of the first camera before displaying the first camera in the first three-dimensional model according to the first position and the second three-dimensional model of the first camera, the target orientation is the orientation of the first camera in the coordinate system of the first three-dimensional model;
所述显示单元,配置为:The display unit is configured as:
将所述第一位置作为所述第二三维模型在所述第一三维模型中的位置,并将所述朝向作为所述第二三维模型在所述第一三维模型中的朝向,在所述第一三维模型中显示所述第二三维模型。Taking the first position as the position of the second 3D model in the first 3D model, and taking the orientation as the orientation of the second 3D model in the first 3D model, in the The second three-dimensional model is displayed in the first three-dimensional model.
结合本申请任一实施方式,所述获取单元,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的图像;In combination with any embodiment of the present application, the acquisition unit is further configured to acquire the target orientation of the first camera before displaying the first camera in the first three-dimensional model according to the first position and images from the first camera;
所述显示单元,配置为:The display unit is configured as:
依据所述第一位置和所述目标朝向,在所述第一三维模型中显示所述第一摄像头的图像。Displaying the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
结合本申请任一实施方式,所述获取单元,配置为:In combination with any implementation mode of the present application, the acquisition unit is configured to:
获取所述第一摄像头在全球定位系统中的第二位置和坐标转换关系,所述坐标转换关系为所述全球定位系统的坐标系与所述第一三维模型的坐标系之间的转换关系;Obtaining a second position of the first camera in the global positioning system and a coordinate transformation relationship, where the coordinate transformation relationship is a transformation relationship between the coordinate system of the global positioning system and the coordinate system of the first three-dimensional model;
依据坐标转换关系对所述第二位置进行转换,得到所述第一摄像头的第一位置。The second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
结合本申请任一实施方式,所述显示单元,还配置为:In combination with any embodiment of the present application, the display unit is further configured as:
在检测到预览所述第一摄像头采集到的画面的指令的情况下,在所述第一摄像头的显示区域内显示所述第一摄像头采集到的画面。If an instruction to preview the picture captured by the first camera is detected, the picture captured by the first camera is displayed in the display area of the first camera.
第三方面,提供了一种电子设备,包括:处理器和存储器,所述存储器配置为存储计算机程序代码,所述计算机程序代码包括计算机指令,在所述处理器执行所述计算机指令的情况下,所述电子设备执行如上述第一方面及其任意一种可能实现的方式的方法。In a third aspect, an electronic device is provided, including: a processor and a memory, the memory is configured to store computer program code, the computer program code includes computer instructions, and when the processor executes the computer instructions , the electronic device executes the method according to the foregoing first aspect and any possible implementation manner thereof.
第四方面,提供了另一种电子设备,包括:处理器、发送装置、输入装置、输出装 置和存储器,所述存储器配置为存储计算机程序代码,所述计算机程序代码包括计算机指令,在所述处理器执行所述计算机指令的情况下,所述电子设备执行如上述第一方面及其任意一种可能实现的方式的方法。In a fourth aspect, another electronic device is provided, including: a processor, a sending device, an input device, an output device, and a memory, the memory is configured to store computer program codes, the computer program codes include computer instructions, and in the When the processor executes the computer instruction, the electronic device executes the method according to the above first aspect and any possible implementation manner thereof.
第五方面,提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,所述计算机程序包括程序指令,在所述程序指令被处理器执行的情况下,使所述处理器执行如上述第一方面及其任意一种可能实现的方式的方法。According to a fifth aspect, a computer-readable storage medium is provided. A computer program is stored in the computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a processor, the The processor executes the method according to the first aspect and any possible implementation manner thereof.
第六方面,提供了一种计算机程序产品,所述计算机程序产品包括计算机程序或指令,在所述计算机程序或指令在计算机上运行的情况下,使得所述计算机执行上述第一方面及其任一种可能的实现方式的方法。According to a sixth aspect, a computer program product is provided, the computer program product includes a computer program or an instruction, and when the computer program or instruction is run on a computer, the computer executes the first aspect and any of the above-mentioned aspects. A method of one possible implementation.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,而非限制本申请。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
附图说明Description of drawings
为了更清楚地说明本申请实施例或背景技术中的技术方案,下面将对本申请实施例或背景技术中所需要使用的附图进行说明。In order to more clearly illustrate the technical solutions in the embodiment of the present application or the background art, the following will describe the drawings that need to be used in the embodiment of the present application or the background art.
此处的附图被并入说明书中并构成本说明书的一部分,这些附图示出了符合本申请的实施例,并与说明书一起用于说明本申请的技术方案。The accompanying drawings here are incorporated into the specification and constitute a part of the specification. These drawings show embodiments consistent with the application, and are used together with the description to describe the technical solution of the application.
图1为本申请实施例提供的一种图像处理方法的流程示意图;FIG. 1 is a schematic flow diagram of an image processing method provided in an embodiment of the present application;
图2为本申请实施例提供的一种可视化第一摄像头的摄像头参数的示意图;FIG. 2 is a schematic diagram of camera parameters of a visualized first camera provided in an embodiment of the present application;
图3为本申请实施例提供的一种在第一三维模型内显示楼层的效果示意图;Fig. 3 is a schematic diagram of the effect of displaying floors in the first three-dimensional model provided by the embodiment of the present application;
图4为本申请实施例提供的另一种在第一三维模型内显示楼层的效果示意图;Fig. 4 is another schematic diagram showing the effect of displaying floors in the first three-dimensional model provided by the embodiment of the present application;
图5为本申请实施例提供的一种图像处理装置的结构示意图;FIG. 5 is a schematic structural diagram of an image processing device provided in an embodiment of the present application;
图6为本申请实施例提供的一种图像处理装置的硬件结构示意图。FIG. 6 is a schematic diagram of a hardware structure of an image processing device provided by an embodiment of the present application.
具体实施方式detailed description
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。The terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or devices.
应当理解,在本申请中,“至少一个(项)”是指一个或者多个,“多个”是指两个或两个以上,“至少两个(项)”是指两个或三个及三个以上,“和/或”,用于描述关联对象的关联关系,表示可以存在三种关系,例如,“A和/或B”可以表示:只存在A,只存在B以及同时存在A和B三种情况,其中A,B可以是单数或者复数。字符“/”可表示前后关联对象是一种“或”的关系,是指这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,“a和b”,“a和c”,“b和c”,或“a和b和c”,其中a,b,c可以是单个,也可以是多个。字符“/”还可表示数学运算中的除号,例如,a/b=a除以b;6/3=2。“以下至少 一项(个)”或其类似表达。It should be understood that in this application, "at least one (item)" means one or more, "multiple" means two or more, and "at least two (items)" means two or three And three or more, "and/or", is used to describe the association relationship of associated objects, indicating that there can be three types of relationships, for example, "A and/or B" can mean: only A exists, only B exists, and A exists at the same time and B, where A and B can be singular or plural. The character "/" can indicate that the contextual objects are an "or" relationship, which refers to any combination of these items, including any combination of single items (items) or plural items (items). For example, at least one item (piece) of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c ", where a, b, c can be single or multiple. The character "/" can also represent a division sign in mathematical operations, for example, a/b=a divided by b; 6/3=2. "At least one of the following" or similar expressions.
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.
随着科技的发展,成像设备的应用场景越来越多,如越来越多的场所内安装了摄像头,以便根据摄像头采集到的视频流信息进行安全防护。而为了查看摄像头的安装效果、布局效果,通常会在二维地图上显示摄像头的位置。但该种显示方式带来的显示效果不佳,进而导致通过查看二维地图获知安装效果、布局效果的体验和效果均不佳。基于此,本申请实施例提供了一种图像处理方法,以提高摄像头在场所内的位置的显示效果。With the development of science and technology, there are more and more application scenarios of imaging devices. For example, cameras are installed in more and more places, so as to perform security protection based on the video stream information collected by the cameras. In order to check the installation effect and layout effect of the camera, the location of the camera is usually displayed on a two-dimensional map. However, the display effect brought by this display method is not good, which leads to poor experience and effect of knowing the installation effect and layout effect by viewing the two-dimensional map. Based on this, an embodiment of the present application provides an image processing method to improve the display effect of the position of the camera in the venue.
为表述方便,下文将用[a,b]表示大于或等于a且小于或等于b的取值区间,用(c,d]表示大于c且小于或等于d的取值区间,用[e,f)表示大于或等于e且小于f的取值区间。For the convenience of expression, [a, b] will be used below to represent the value interval greater than or equal to a and less than or equal to b, and (c, d) will be used to represent the value interval greater than c and less than or equal to d, and [e, f) represents the value interval greater than or equal to e and less than f.
本申请实施例的执行主体为图像处理装置,其中,图像处理装置可以是任意一种可执行本申请方法实施例所公开的技术方案的电子设备。可选的,图像处理装置可以是以下中的一种:手机、计算机、平板电脑、可穿戴智能设备。The execution subject of the embodiment of the present application is an image processing device, wherein the image processing device may be any electronic device capable of executing the technical solutions disclosed in the method embodiments of the present application. Optionally, the image processing device may be one of the following: a mobile phone, a computer, a tablet computer, and a wearable smart device.
应理解,本申请方法实施例还可以通过处理器执行计算机程序代码的方式实现。下面结合本申请实施例中的附图对本申请实施例进行描述。请参阅图1,图1是本申请实施例提供的一种图像处理方法的流程示意图。It should be understood that the method embodiments of the present application may also be implemented in a manner in which a processor executes computer program codes. Embodiments of the present application are described below with reference to the drawings in the embodiments of the present application. Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of an image processing method provided in an embodiment of the present application.
101、获取目标场景的第一三维模型以及第一摄像头的第一位置,上述第一摄像头为上述目标场景内的摄像头,上述第一位置为上述第一三维模型的坐标系下的位置。101. Acquire a first 3D model of a target scene and a first position of a first camera, where the first camera is a camera in the target scene, and the first position is a position in a coordinate system of the first 3D model.
本申请实施例中,目标场景可以是任意场景。例如,目标场景为楼宇内部;又例如,目标场景为地下停车场;再例如,目标场景为校园;再例如,目标场景是商场内的场景。In this embodiment of the present application, the target scene may be any scene. For example, the target scene is inside a building; for another example, the target scene is an underground parking lot; for another example, the target scene is a campus; for another example, the target scene is a scene in a shopping mall.
本申请实施例中,三维模型(包括第一三维模型,以及下文将要提及的第二三维模型)可以是计算机辅助设计(computer aided design,CAD)三维模型,三维模型也可以是三维凸包,三维模型也可以是三维点云。In the embodiment of the present application, the three-dimensional model (including the first three-dimensional model and the second three-dimensional model to be mentioned below) may be a computer-aided design (computer aided design, CAD) three-dimensional model, and the three-dimensional model may also be a three-dimensional convex hull, A 3D model can also be a 3D point cloud.
本申请实施例中,第一摄像头为目标场景内的摄像头。第一位置为第一摄像头在第一三维模型的坐标系下的位置。In the embodiment of the present application, the first camera is a camera in the target scene. The first position is the position of the first camera in the coordinate system of the first three-dimensional model.
在一种获取目标场景的第一三维模型的实现方式中,图像处理装置将用户通过输入组件输入的目标场景的三维模型作为第一三维模型。上述输入组件包括:键盘、鼠标、触控屏、触控板和音频输入器。In an implementation manner of acquiring the first 3D model of the target scene, the image processing device uses the 3D model of the target scene input by the user through the input component as the first 3D model. The above-mentioned input components include: a keyboard, a mouse, a touch screen, a touch pad and an audio input device.
在另一种获取目标场景的第一三维模型的实现方式中,图像处理装置接收终端发送的目标场景的三维模型作为第一三维模型。上述终端可以是以下任意一种:手机、计算机、平板电脑、服务器。In another implementation manner of acquiring the first 3D model of the target scene, the image processing apparatus receives the 3D model of the target scene sent by the terminal as the first 3D model. The above-mentioned terminal can be any of the following: mobile phone, computer, tablet computer, server.
在又一种获取目标场景的第一三维模型的实现方式中,图像处理装置包括激光雷达。图像处理装置通过激光雷达扫描目标场景,得到目标场景的三维模型作为第一三维模型。In yet another implementation manner of acquiring the first three-dimensional model of the target scene, the image processing device includes a laser radar. The image processing device scans the target scene through the laser radar, and obtains a 3D model of the target scene as a first 3D model.
在一种获取第一摄像头的第一位置的实现方式中,图像处理装置将用户通过输入组件输入的第一摄像头的位置作为第一位置。In an implementation manner of acquiring the first position of the first camera, the image processing apparatus uses the position of the first camera input by the user through the input component as the first position.
在另一种获取第一摄像头的第一位置的实现方式中,图像处理装置接收终端发送的第一摄像头的位置作为第一位置。In another implementation manner of acquiring the first position of the first camera, the image processing apparatus receives the position of the first camera sent by the terminal as the first position.
在又一种获取第一摄像头的第一位置的实现方式中,图像处理装置获取第一摄像头在全球定位系统中的第二位置和坐标转换关系,其中,坐标转换关系为全球定位系统的坐标系与第一三维模型的坐标系之间的转换关系。图像处理装置依据坐标转换关系对第二位置进行转换,得到第一摄像头的第一位置。In yet another implementation of acquiring the first position of the first camera, the image processing device acquires the second position of the first camera in the global positioning system and the coordinate transformation relationship, wherein the coordinate transformation relationship is the coordinate system of the global positioning system The conversion relationship with the coordinate system of the first 3D model. The image processing device converts the second position according to the coordinate transformation relationship to obtain the first position of the first camera.
应理解,在本申请实施例中,获取目标场景的第一三维模型和获取第一摄像头的第一位置可以分开执行,也可以同时执行。It should be understood that, in this embodiment of the present application, acquiring the first three-dimensional model of the target scene and acquiring the first position of the first camera may be performed separately, or may be performed simultaneously.
102、依据上述第一位置在上述第一三维模型中显示上述第一摄像头。102. Display the first camera in the first three-dimensional model according to the first position.
本申请实施例中,图像处理装置依据第一位置在第一三维模型中显示第一摄像头,可更直观的展示第一摄像头在目标场景中的位置。In the embodiment of the present application, the image processing device displays the first camera in the first three-dimensional model according to the first position, so as to more intuitively display the position of the first camera in the target scene.
应理解,本申请实施例中的第一摄像头仅为示例,在实际应用中,图像处理装置可在第一三维模型中显示目标场景中任意一个摄像头。It should be understood that the first camera in this embodiment of the present application is only an example, and in practical applications, the image processing apparatus may display any camera in the target scene in the first three-dimensional model.
作为一种可选的实施方式,图像处理装置还执行以下步骤:As an optional implementation manner, the image processing device also performs the following steps:
1、获取上述第一摄像头的摄像头参数。1. Obtain the camera parameters of the above-mentioned first camera.
本步骤中,摄像头参数包括以下中的一个或一个以上:朝向、摄像头类型、可视角度。朝向可以是摄像头在第一三维模型的坐标系下的朝向,朝向也可以是摄像头在全球定位系统坐标系下的坐标。摄像头类型包括球机、枪机、半球机。可视角度可以是摄像头在第一三维模型的坐标系下的拍摄范围,拍摄范围也可以是摄像头在全球定位系统坐标系下的坐标。In this step, the camera parameters include one or more of the following: orientation, camera type, and viewing angle. The orientation may be the orientation of the camera in the coordinate system of the first three-dimensional model, or the coordinates of the camera in the coordinate system of the global positioning system. Camera types include dome cameras, bolt cameras, and dome cameras. The viewing angle may be the shooting range of the camera in the coordinate system of the first three-dimensional model, and the shooting range may also be the coordinates of the camera in the global positioning system coordinate system.
在一种获取第一摄像头的摄像头参数的实现方式中,图像处理装置将用户通过输入组件输入的摄像头参数作为第一摄像头的摄像头参数。In an implementation manner of acquiring the camera parameters of the first camera, the image processing device uses the camera parameters input by the user through the input component as the camera parameters of the first camera.
在另一种获取第一摄像头的摄像头参数的实现方式中,图像处理装置接收终端发送的摄像头参数作为第一摄像头的摄像头参数。In another implementation manner of acquiring the camera parameters of the first camera, the image processing apparatus receives the camera parameters sent by the terminal as the camera parameters of the first camera.
2、在上述第一三维模型中以可视化的方式显示上述摄像头参数。2. Visually display the camera parameters in the first three-dimensional model.
本步骤中,可视化指将数据转换成图形或图像在屏幕上进行显示。图像处理装置以可视化的方式将摄像头参数显示于第一三维模型中,可使第一摄像头的显示效果更直观。In this step, visualization refers to converting data into graphics or images for display on the screen. The image processing device displays the camera parameters in the first three-dimensional model in a visualized manner, which can make the display effect of the first camera more intuitive.
例如,以可使化的方式显示摄像头参数可以得到图2所示的效果,其中,第一摄像头所拍摄的扇形区域为摄像头的拍摄范围。依据图2可知,第一摄像头为球机,即第一摄像头为球型摄像头。通过图2也可直观的感受到第一摄像头的朝向。For example, the effect shown in FIG. 2 can be obtained by displaying camera parameters in a scalable manner, wherein the fan-shaped area captured by the first camera is the shooting range of the camera. It can be known from FIG. 2 that the first camera is a dome camera, that is, the first camera is a dome camera. The orientation of the first camera can also be intuitively felt through FIG. 2 .
图像处理装置通过执行步骤1和步骤2,可提升第一摄像头的摄像头参数的显示效果The image processing device can improve the display effect of the camera parameters of the first camera by performing step 1 and step 2
作为一种可选的实施方式,图像处理装置还执行以下步骤:As an optional implementation manner, the image processing device also performs the following steps:
3、在检测到预览上述第一摄像头所采集到的画面的指令的情况下,在上述第一摄像头的显示区域内显示上述第一摄像头采集到的画面,上述第一摄像头的显示区域属于上述第一三维模型所覆盖的显示区域。3. When an instruction to preview the picture captured by the above-mentioned first camera is detected, display the picture captured by the above-mentioned first camera in the display area of the above-mentioned first camera, and the display area of the above-mentioned first camera belongs to the above-mentioned first camera. A display area covered by a 3D model.
本步骤中,预览第一摄像头所采集到的画面可以是,显示第一摄像头采集到的图像或视频流。In this step, previewing the picture captured by the first camera may be displaying the image or video stream captured by the first camera.
预览第一摄像头所采集到的画面的指令可以是用户通过输入组件向图像处理装置输入的指令。例如,在图像处理装置将第一三维模型显示于触摸显示屏的情况下,当用户通过触摸第一三维模型中的第一摄像头时,图像处理装置生成预览第一摄像头所采集到的画面的指令。又例如,在图像处理装置将第一三维模型通过屏幕进行显示,用户通过鼠标光标点击第一三维模型中的第一摄像头时,图像处理装置生成预览第一摄像头所采集到的画面的指令。The instruction to preview the picture captured by the first camera may be an instruction input by the user to the image processing device through the input component. For example, when the image processing device displays the first three-dimensional model on the touch screen, when the user touches the first camera in the first three-dimensional model, the image processing device generates an instruction to preview the picture captured by the first camera . For another example, when the image processing device displays the first 3D model on the screen, and the user clicks the first camera in the first 3D model with a mouse cursor, the image processing device generates an instruction to preview the image captured by the first camera.
预览第一摄像头所采集到的画面的指令也可以是在满足预览第一摄像头所采集到的画面的条件的情况下生成的指令。The instruction to preview the image captured by the first camera may also be an instruction generated when a condition for previewing the image captured by the first camera is met.
例如,预览第一摄像头所采集到的画面的条件为目标对象出现在第一摄像头的拍摄范围内。图像处理装置在通过将第一摄像头采集的图像与包含目标对象的图像进行比对确定第一摄像头采集的图像包含目标对象的情况下,确定目标对象出现在第一摄像头的拍摄范围内,即确定满足预览第一摄像头所采集到的画面的条件。For example, the condition for previewing the picture captured by the first camera is that the target object appears within the shooting range of the first camera. When the image processing device determines that the image captured by the first camera contains the target object by comparing the image captured by the first camera with the image containing the target object, it determines that the target object appears within the shooting range of the first camera, that is, determines Meet the conditions for previewing the images captured by the first camera.
如,图像处理在通过将第一摄像头采集的图像与张三的人脸图像进行人脸比对确定第一摄像头采集的图像包含张三的情况下,确定张三出现在第一摄像头的拍摄范围内,进而确定满足预览第一摄像头所采集到的画面的条件。For example, image processing determines that Zhang San appears in the shooting range of the first camera when the image captured by the first camera is compared with Zhang San's face image to determine that the image captured by the first camera contains Zhang San Then, it is determined that the conditions for previewing the picture captured by the first camera are satisfied.
又例如,预览第一摄像头所采集到的画面的条件为目标对象出现在第一摄像头的拍摄范围内的持续时长超过时长阈值。图像处理装置在通过将第一摄像头采集的图像与包含目标对象的图像进行比对确定目标对象出现在第一摄像头的拍摄范围内的持续时长超过时长阈值的情况下,即确定满足预览第一摄像头所采集到的画面的条件。For another example, the condition for previewing the picture captured by the first camera is that the duration of the target object appearing in the shooting range of the first camera exceeds a duration threshold. When the image processing device compares the image captured by the first camera with the image containing the target object and determines that the duration of the target object appearing in the shooting range of the first camera exceeds the duration threshold, it determines that the first camera meets the preview requirement. The condition of the captured picture.
本步骤中,第一摄像头的显示区域用于显示第一摄像头采集到的画面,且第一摄像头的显示区域位于第一三维模型的显示区域内。In this step, the display area of the first camera is used to display the picture captured by the first camera, and the display area of the first camera is located in the display area of the first three-dimensional model.
在一种可能实现的方式中,在第一三维模型的显示区域内,第一摄像头的显示区域指向第一摄像头,表征第一摄像头的显示区域内所显示的画面为第一摄像头所采集到的画面。In a possible implementation manner, in the display area of the first three-dimensional model, the display area of the first camera points to the first camera, indicating that the picture displayed in the display area of the first camera is captured by the first camera screen.
在另一种可能实现的方式中,第一摄像头的显示区域为在第一摄像头所在的位置的抬头显示(head up display,HUD)层。In another possible implementation manner, the display area of the first camera is a head up display (head up display, HUD) layer where the first camera is located.
由于第一摄像头的显示区域用于显示第一摄像头所采集到的画面,图像处理装置通过将第一摄像头所采集到的画面显示于第一摄像头的显示区域中,可使第一摄像头所采集的画面的显示更直观,使用户更直观的感受到第一摄像头的显示区域所显示的画面为第一摄像头所采集到的画面。第一摄像头的显示区域位于第一三维模型所覆盖的区域内,则可进一步提升第一摄像头所采集的画面的显示效果。Since the display area of the first camera is used to display the pictures captured by the first camera, the image processing device can display the pictures captured by the first camera in the display area of the first camera to make the pictures captured by the first camera The display of the picture is more intuitive, so that the user can feel more intuitively that the picture displayed in the display area of the first camera is the picture collected by the first camera. If the display area of the first camera is located in the area covered by the first three-dimensional model, the display effect of the picture captured by the first camera can be further improved.
作为一种可选的实施方式,上述第一三维模型包括第一点和第二点,上述第一点在第一三维模型中的位置和上述第二点在第一三维模型中的位置不同。在该种实施方式中,图像处理装置还执行以下步骤:As an optional implementation manner, the first three-dimensional model includes a first point and a second point, and a position of the first point in the first three-dimensional model is different from a position of the second point in the first three-dimensional model. In this embodiment, the image processing device also performs the following steps:
4、确定第二摄像头的第一数量和第三摄像头的第二数量,上述第二摄像头为拍摄范围包括上述第一点的摄像头,上述第三摄像头为拍摄范围包括上述第二点的摄像头。4. Determine the first number of second cameras and the second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the second point.
5、依据上述第一数量得到第一摄像头覆盖指标,上述第一摄像头覆盖指标与上述第一数量呈正相关。5. The first camera coverage index is obtained according to the first quantity, and the first camera coverage index is positively correlated with the first quantity.
6、依据上述第一数量得到第一摄像头覆盖指标,上述第二摄像头覆盖指标与上述第二数量呈正相关。6. The first camera coverage index is obtained according to the above-mentioned first quantity, and the above-mentioned second camera coverage index is positively correlated with the above-mentioned second quantity.
本申请实施例中,某点的摄像头覆盖指标用于表征拍摄范围覆盖该点的摄像头数量。假设第一数量为n 1,第二数量为n 2,第一摄像头覆盖指标为i 1,第二摄像头覆盖指标为i 2In the embodiment of the present application, the camera coverage index of a certain point is used to represent the number of cameras whose shooting range covers the point. Suppose the first number is n 1 , the second number is n 2 , the coverage index of the first camera is i 1 , and the coverage index of the second camera is i 2 .
在一种可能实现方式中,n 1、n 2、i 1、i 2满足下式: In a possible implementation manner, n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
Figure PCTCN2021134884-appb-000001
Figure PCTCN2021134884-appb-000001
其中,k 1、k 2均为正数,c 1、c 2均为实数。 Wherein, k 1 and k 2 are positive numbers, and c 1 and c 2 are real numbers.
在另一种可能实现方式中,n 1、n 2、i 1、i 2满足下式: In another possible implementation manner, n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
Figure PCTCN2021134884-appb-000002
Figure PCTCN2021134884-appb-000002
其中,k 1、k 2均为正数,c 1、c 2均为实数。 Wherein, k 1 and k 2 are positive numbers, and c 1 and c 2 are real numbers.
在又一种可能实现方式中,n 1、n 2、i 1、i 2满足下式: In yet another possible implementation manner, n 1 , n 2 , i 1 , and i 2 satisfy the following formula:
Figure PCTCN2021134884-appb-000003
Figure PCTCN2021134884-appb-000003
其中,k 1、k 2均为正数,c 1、c 2均为实数。 Wherein, k 1 and k 2 are positive numbers, and c 1 and c 2 are real numbers.
由于不同摄像头采集到的画面不同,不同摄像头获取的信息不同。因此,拍摄范围包括某一点的摄像头的数量越多,通过摄像头获取到的该点的信息的准确度越高,这样, 基于摄像头获取到的信息得到的处理结果的准确度也就越高。Since different cameras capture different images, different cameras obtain different information. Therefore, the greater the number of cameras whose shooting range includes a certain point, the higher the accuracy of the information obtained by the cameras at the point, and thus the higher the accuracy of the processing result obtained based on the information obtained by the cameras.
例如,摄像头a的拍摄范围和摄像头b的拍摄范围均包括A点,即拍摄范围包括A点的摄像头的数量为2。摄像头c的拍摄范围包括B点,即拍摄范围包括B点的摄像头的数量为1。由于拍摄范围包括A点的摄像头的数量大于拍摄范围包括B点的摄像头的数量,通过摄像头(包括摄像头a和摄像头b)获取到的A点的信息比通过摄像头(即摄像头c)获取到的B点的信息准确。For example, the shooting range of camera a and the shooting range of camera b both include point A, that is, the number of cameras whose shooting range includes point A is 2. The shooting range of camera c includes point B, that is, the number of cameras whose shooting range includes point B is 1. Since the number of cameras whose shooting range includes point A is greater than the number of cameras whose shooting range includes point B, the information of point A obtained through the camera (including camera a and camera b) is greater than the information of point B obtained through the camera (ie, camera c). Point information is accurate.
若人物C出现在A点时,摄像头a采集到包含人物C的图像d。人物C出现在A点时,摄像头b采集到包含人物C的图像e。人物D出现在B点时,摄像头c采集到包含人物D的图像f。If person C appears at point A, camera a captures image d containing person C. When person C appears at point A, camera b captures image e containing person C. When person D appears at point B, camera c captures image f containing person D.
基于图像d和图像e确定的人物C的属性信息(包括服饰属性和外形属性)比基于图像f确定的人物C的属性信息更准确。The attribute information of person C determined based on image d and image e (including clothing attributes and appearance attributes) is more accurate than the attribute information of person C determined based on image f.
7、在上述第一点显示上述第一摄像头覆盖指标,并在上述第二点显示上述第二摄像头覆盖指标。7. Display the above-mentioned first camera coverage indicator at the above-mentioned first point, and display the above-mentioned second camera coverage indicator at the above-mentioned second point.
在本步骤中,图像处理装置通过在第一点显示第一摄像头覆盖指标,可直观的显示通过摄像头获取到的第一点的信息的准确度。同理,图像处理装置通过在第二点显示第二摄像头覆盖指标,可直观的显示通过摄像头获取到的第二点的信息的准确度。In this step, the image processing device can intuitively display the accuracy of the information of the first point acquired through the camera by displaying the coverage index of the first camera at the first point. Similarly, by displaying the coverage index of the second camera at the second point, the image processing device can visually display the accuracy of the information of the second point acquired through the camera.
在第一点和第二点分属不同楼层时,图像处理装置基于步骤4~步骤7可通过显示不同楼层,分别显示不同楼层的摄像头覆盖指标,从而提升摄像头覆盖指标的显示效果。When the first point and the second point belong to different floors, the image processing device may display the camera coverage indicators of different floors based on steps 4 to 7 to improve the display effect of the camera coverage indicators.
其中,图像处理装置在第一三维模型中显示不同楼层的显示效果可参见图3和图4。图3所示的大厦和图4所示的大厦相同,目标场景为该大厦的内部。图3所示的楼层为目标场景的A楼层,图4所示的楼层为目标场景的B楼层,即图像处理装置在第一三维模型中显示A楼层的显示效果可参见图3,图像处理装置在第一三维模型中显示B楼层的显示效果可参见图4。Wherein, the display effect of the image processing device displaying different floors in the first three-dimensional model can be referred to FIG. 3 and FIG. 4 . The building shown in Figure 3 is the same as the building shown in Figure 4, and the target scene is the interior of the building. The floor shown in Figure 3 is the A floor of the target scene, and the floor shown in Figure 4 is the B floor of the target scene, that is, the display effect of the image processing device displaying the A floor in the first three-dimensional model can be referred to in Figure 3, the image processing device Refer to FIG. 4 for the display effect of displaying the B floor in the first three-dimensional model.
在一种可能实现的方式中,第一点属于第一楼层,第二点属于第二楼层,其中,第一楼层和第二楼层不同。图像处理装置可在显示第一楼层时显示第一点的摄像头覆盖指标,在显示第二楼层时显示第二点的摄像头覆盖指标。In a possible implementation manner, the first point belongs to the first floor, and the second point belongs to the second floor, wherein the first floor and the second floor are different. The image processing device may display the camera coverage index of the first point when displaying the first floor, and display the camera coverage index of the second point when displaying the second floor.
应理解,在该种实施方式中,第一点和第二点仅为示例,不应理解为只能显示第一三维模型中任意两个点的摄像头覆盖指标。在实际应用中,图像处理装置可显示第一三维模型中所有点的摄像头覆盖指标。It should be understood that in this implementation manner, the first point and the second point are only examples, and should not be understood as only displaying the camera coverage indicators of any two points in the first three-dimensional model. In practical applications, the image processing device may display camera coverage indicators of all points in the first three-dimensional model.
在第一点属于第一楼层,第二点属于第二楼层时,不应理解为只能在第一楼层中的一个点显示摄像头覆盖指标,也不应理解为只能在第二楼层中的一个点显示摄像头覆盖指标。在实际应用中,可在第一楼层中的一个点或一个以上点显示摄像头覆盖指标,也可在第二楼层中的一个点或一个以上点显示摄像头覆盖指标。When the first point belongs to the first floor and the second point belongs to the second floor, it should not be understood that the camera coverage indicator can only be displayed at one point in the first floor, nor that it can only be displayed in the second floor A dot shows the camera coverage indicator. In practical applications, the camera coverage index can be displayed at one or more points on the first floor, and the camera coverage index can also be displayed at one or more points on the second floor.
作为一种可选的实施方式,图像处理装置在第一点显示第一摄像头覆盖指标之前,还执行以下步骤:As an optional implementation manner, before the image processing device displays the coverage index of the first camera at the first point, the following steps are further performed:
8、获取上述第一楼层内的摄像头的第三数量。8. Obtain the third number of cameras on the first floor above.
本申请实施例中,第三数量为第一楼层内摄像头的数量。In this embodiment of the present application, the third number is the number of cameras on the first floor.
在一种获取上述第一楼层内的摄像头的第三数量的实现方式中,图像处理装置将用户通过输入组件输入的第一楼层内的摄像头数量作为第三数量。In an implementation manner of acquiring the third number of cameras on the first floor, the image processing device uses the number of cameras on the first floor input by the user through the input component as the third number.
在另一种获取上述第一楼层内的摄像头的第三数量的实现方式中,图像处理装置接收终端发送的第一楼层内的摄像头数量作为第三数量。In another implementation manner of acquiring the third number of cameras on the first floor, the image processing device receives the number of cameras on the first floor sent by the terminal as the third number.
9、依据上述第一数量与上述第三数量的比值得到上述第一摄像头覆盖指标。9. Obtain the coverage index of the first camera according to the ratio of the first quantity to the third quantity.
本申请实施例中,第一数量与第三数量的比值=第一数量/第三数量。例如,第一数量为10,第三数量为30,那么第一数量与第三数量的比值为1/3。In the embodiment of the present application, the ratio of the first quantity to the third quantity=the first quantity/the third quantity. For example, if the first quantity is 10 and the third quantity is 30, then the ratio of the first quantity to the third quantity is 1/3.
假设第一数量与第三数量的比值为n 3,第一摄像头覆盖指标为i 1。在一种可能实现方式中,n 3、i 1满足下式: Assume that the ratio of the first quantity to the third quantity is n 3 , and the coverage index of the first camera is i 1 . In a possible implementation, n 3 and i 1 satisfy the following formula:
i 1=k 3×n 3+c 3           (4) i 1 =k 3 ×n 3 +c 3 (4)
其中,k 3为正数,c 3为实数。 Among them, k 3 is a positive number, and c 3 is a real number.
在另一种可能实现方式中,n 3、i 1满足下式: In another possible implementation, n 3 and i 1 satisfy the following formula:
Figure PCTCN2021134884-appb-000004
Figure PCTCN2021134884-appb-000004
其中,k 3为正数,c 3为实数。 Among them, k 3 is a positive number, and c 3 is a real number.
在又一种可能实现方式中,n 3、i 1满足下式: In yet another possible implementation, n 3 and i 1 satisfy the following formula:
i 1=(k 3×n 3+c 3) 2             (6) i 1 =(k 3 ×n 3 +c 3 ) 2 (6)
其中,k 3为正数,c 3为实数。 Among them, k 3 is a positive number, and c 3 is a real number.
可选的,图像处理装置获取第二楼层内的摄像头的第四数量,并依据第二数量与第四数量之间的比值得到第二摄像头覆盖指标。Optionally, the image processing device acquires the fourth number of cameras on the second floor, and obtains the second camera coverage index according to a ratio between the second number and the fourth number.
作为一种可选的实施方式,图像处理装置通过执行以下步骤在第一点显示第一摄像头覆盖指标:As an optional implementation manner, the image processing device displays the first camera coverage index at the first point by performing the following steps:
10、获取映射关系,上述映射关系表征摄像头覆盖指标与颜色之间的映射关系。10. Obtain a mapping relationship, the above mapping relationship represents the mapping relationship between the camera coverage index and the color.
在一种可能实现方式中,绿色所表征的摄像头覆盖指标比红色所表征的摄像头覆盖指标大。In a possible implementation manner, the camera coverage index represented by green is larger than the camera coverage index represented by red.
在另一种可能实现方式中,颜色越深表征摄像头覆盖指标越大。In another possible implementation manner, the darker the color, the greater the coverage index of the camera.
在又一种可能实现方式中,图像处理装置通过执行步骤8得到第一摄像头覆盖指标。映射关系可参见下表:In yet another possible implementation manner, the image processing apparatus obtains the first camera coverage index by performing step 8. The mapping relationship can be seen in the table below:
摄像头覆盖指标Camera Coverage Metrics 像素值Pixel values
[0,0.1)[0,0.1) 4040
[0.1,0.3)[0.1, 0.3) 8080
[0.3,0.5)[0.3, 0.5) 100100
[0.5,0.7)[0.5, 0.7) 140140
[0.7,0.8)[0.7, 0.8) 170170
[0.8,0.9)[0.8, 0.9) 200200
[0.9,1][0.9, 1] 240240
表1Table 1
在一种获取映射关系的实现方式中,图像处理装置获取用户通过输入组件输入的映射关系。In an implementation manner of acquiring the mapping relationship, the image processing apparatus acquires the mapping relationship input by the user through the input component.
在另一种获取映射关系的实现方式中,图像处理装置接收终端发送的映射关系获取映射关系。In another implementation manner of acquiring the mapping relationship, the image processing apparatus receives the mapping relationship sent by the terminal to acquire the mapping relationship.
11、依据上述第一摄像头覆盖指标确定上述第一点的颜色。11. Determine the color of the first point according to the coverage index of the first camera.
12、以上述第一点的颜色显示上述第一点。12. Display the above-mentioned first point in the color of the above-mentioned first point.
作为一种可能实现方式中,第一摄像头位于第一楼层。在该种实施方式中,由于第一摄像头位于第一楼层,图像处理装置在第一三维模型中显示第一摄像头即图像处理装置在第一三维模型中显示第一楼层。As a possible implementation manner, the first camera is located on the first floor. In this embodiment, since the first camera is located on the first floor, the image processing device displays the first camera in the first three-dimensional model, that is, the image processing device displays the first floor in the first three-dimensional model.
在一种可能实现方式中,图像处理装置通过将第一三维模型中除第一楼层之外的楼层隐藏,在第一三维模型中显示第一楼层。In a possible implementation manner, the image processing apparatus displays the first floor in the first three-dimensional model by hiding floors in the first three-dimensional model except the first floor.
例如,第一三维模型共有五层,第一楼层是第一三维模型中的第三层。图像处理装置可将第一三维模型中的第四层和第五层隐藏,进而在显示第一三维模型的外形的同时,显示第一楼层。由于第一楼层为第三层,在显示第一楼层时将遮挡住第一层和第二层,这样,可避免在显示第一三维模型时,第一层和第二层对第一楼层的显示所带来的干扰, 从而提升第一楼层的显示效果。For example, the first three-dimensional model has five floors in total, and the first floor is the third floor in the first three-dimensional model. The image processing device can hide the fourth floor and the fifth floor in the first three-dimensional model, and then display the first floor while displaying the appearance of the first three-dimensional model. Since the first floor is the third floor, the first floor and the second floor will be covered when the first floor is displayed. In this way, when the first 3D model is displayed, the first floor and the second floor will be avoided. Display the resulting interference, thereby improving the display effect of the first floor.
可选的,图像处理装置获取第一楼层的路网信息,依据该路网信息确定第一点是否属于可行区域。在确定第一点属于可行区域的情况下,执行在第一点显示第一摄像头覆盖指标的步骤,其中,可行区域指可供人行走的区域。Optionally, the image processing device acquires road network information of the first floor, and determines whether the first point belongs to the feasible area according to the road network information. When it is determined that the first point belongs to the feasible area, the step of displaying the coverage indicator of the first camera at the first point is performed, wherein the feasible area refers to an area where people can walk.
在该种实施方式中,图像处理装置还执行以下步骤:In this embodiment, the image processing device also performs the following steps:
13、在检测到显示上述第二楼层的指令的情况下,在上述第一三维模型中显示上述第二楼层。13. When an instruction to display the second floor is detected, display the second floor in the first three-dimensional model.
在本步骤中,图像处理装置在检测到显示第二楼层的指令的情况下,将在第一三维模型中所显示的楼层切换为第二楼层。In this step, the image processing device switches the floor displayed on the first three-dimensional model to the second floor when an instruction to display the second floor is detected.
显示第二楼层的指令可以是用户通过输入组件向图像处理装置输入的指令。例如,在图像处理装置将第一三维模型以及第一三维模型的楼层信息显示于显示页面中,当用户通过触摸屏触摸楼层信息中的第二楼层时,图像处理装置生成显示第二楼层的指令。又例如,在图像处理装置将第一三维模型以及第一三维模型的楼层信息通过屏幕进行显示,用户通过鼠标光标点击楼层信息中的第二楼层时,图像处理装置生成显示第二楼层的指令。The instruction to display the second floor may be an instruction input by the user to the image processing device through the input component. For example, when the image processing device displays the first 3D model and the floor information of the first 3D model on the display page, when the user touches the second floor in the floor information through the touch screen, the image processing device generates an instruction to display the second floor. For another example, when the image processing device displays the first 3D model and the floor information of the first 3D model on the screen, and the user clicks the second floor in the floor information with the mouse cursor, the image processing device generates an instruction to display the second floor.
显示上述第二楼层的指令也可以是在满足显示第二楼层的条件的情况下生成的指令。例如,显示第二楼层的条件为目标对象出现在第二楼层内。图像处理装置在通过将第二楼层内的摄像头采集的图像与包含目标对象的图像进行比对确定第二楼层的摄像头采集的图像包含目标对象的情况下,确定目标对象出现在第二楼层内,即确定满足显示第二楼层的条件。The command to display the second floor may be a command generated when a condition for displaying the second floor is satisfied. For example, the condition for displaying the second floor is that the target object is present in the second floor. The image processing device determines that the target object appears on the second floor when determining that the image collected by the camera on the second floor contains the target object by comparing the image captured by the camera on the second floor with the image containing the target object, That is, it is determined that the condition for displaying the second floor is satisfied.
如,图像处理在通过将第二楼层内的摄像头采集的图像与张三的人脸图像进行人脸比对确定第二楼层内的摄像头采集的图像包含张三的情况下,确定张三出现在第二楼层内,进而确定满足显示第二楼层的条件。For example, image processing compares the image captured by the camera on the second floor with the face image of Zhang San and determines that the image captured by the camera on the second floor contains Zhang San, and determines that Zhang San appears in In the second floor, it is further determined that the condition for displaying the second floor is satisfied.
又例如,显示第二楼层的条件为第二楼层出现失火事件。图像处理装置在通过对第二楼层内的摄像头采集的图像进行处理确定第二楼层出现失火事件的情况下,确定满足显示第二楼层的条件。For another example, the condition for displaying the second floor is that a fire event occurs on the second floor. The image processing device determines that the condition for displaying the second floor is met when the image processing device determines that a fire event occurs on the second floor by processing the image collected by the camera in the second floor.
在一种可能实现方式中,图像处理装置通过将第一三维模型中除第二楼层之外的楼层隐藏,在第一三维模型中显示第二楼层。In a possible implementation manner, the image processing device displays the second floor in the first three-dimensional model by hiding floors in the first three-dimensional model except the second floor.
例如,第一三维模型共有五层,第二楼层是第一三维模型中的第四层。图像处理装置可将第一三维模型中的第五层隐藏,进而在显示第一三维模型的外形的同时,显示第二楼层。由于第二楼层为第四层,在显示第二楼层时将遮挡住第一层、第二层和第三层,这样,可避免在显示第一三维模型时,第一层、第二层和第三层对第二楼层的显示所带来的干扰,从而提升第二楼层的显示效果。For example, the first three-dimensional model has five floors, and the second floor is the fourth floor in the first three-dimensional model. The image processing device can hide the fifth floor in the first three-dimensional model, and then display the second floor while displaying the appearance of the first three-dimensional model. Since the second floor is the fourth floor, the first, second and third floors will be covered when the second floor is displayed, so that when the first 3D model is displayed, the first, second and third floors The interference caused by the third floor to the display of the second floor, thereby improving the display effect of the second floor.
作为一种可选的实施方式,图像处理装置在执行步骤102之前还执行以下步骤:As an optional implementation manner, the image processing device further performs the following steps before performing step 102:
14、获取上述第一摄像头的目标朝向和上述第一摄像头的第二三维模型,上述目标朝向为上述第一摄像头在上述全球定位系统坐标系下的朝向。14. Obtain the target orientation of the first camera and the second three-dimensional model of the first camera, where the target orientation is the orientation of the first camera in the global positioning system coordinate system.
本申请实施例中,目标朝向为第一摄像头的朝向,目标朝向表征第一摄像头的拍摄方向。第二三维模型即为第一摄像头的三维模型。In the embodiment of the present application, the target orientation is the orientation of the first camera, and the target orientation represents the shooting direction of the first camera. The second 3D model is the 3D model of the first camera.
在一种获取第一摄像头的目标朝向的实现方式中,图像处理装置将用户通过输入组件输入的第一摄像头的朝向作为目标朝向。In an implementation manner of acquiring the target orientation of the first camera, the image processing apparatus takes the orientation of the first camera input by the user through the input component as the target orientation.
在另一种获取第一摄像头的目标朝向的实现方式中,图像处理装置接收终端发送的第一摄像头的朝向作为目标朝向。In another implementation manner of acquiring the target orientation of the first camera, the image processing apparatus receives the orientation of the first camera sent by the terminal as the target orientation.
在又一种获取第一摄像头的目标朝向的实现方式中,图像处理装置获取第一摄像头在目标场景中的朝向和坐标转换关系,其中,坐标转换关系为全球定位系统坐标系与第 一三维模型的坐标系之间的转换关系。图像处理装置依据坐标转换关系将第一摄像头在目标场景中的朝向转换为第一摄像头在第一三维模型中的朝向,得到目标朝向。In yet another implementation of acquiring the target orientation of the first camera, the image processing device acquires the orientation and coordinate transformation relationship of the first camera in the target scene, wherein the coordinate transformation relationship is the global positioning system coordinate system and the first three-dimensional model The conversion relationship between the coordinate systems. The image processing device converts the orientation of the first camera in the target scene into the orientation of the first camera in the first three-dimensional model according to the coordinate transformation relationship to obtain the orientation of the target.
在一种获取第一摄像头的第二三维模型的实现方式中,图像处理装置将用户通过输入组件输入的第一摄像头的三维模型作为第二三维模型。In an implementation manner of acquiring the second 3D model of the first camera, the image processing apparatus uses the 3D model of the first camera input by the user through the input component as the second 3D model.
在另一种获取第一摄像头的第二三维模型的实现方式中,图像处理装置接收终端发送的第一摄像头的三维模型作为第二三维模型。In another implementation manner of acquiring the second 3D model of the first camera, the image processing apparatus receives the 3D model of the first camera sent by the terminal as the second 3D model.
在又一种获取第一摄像头的第二三维模型的实现方式中,图像处理装置包括激光雷达。图像处理装置使用激光雷达对第一摄像头进行扫描,得到第一摄像头的三维模型作为第二三维模型。In yet another implementation manner of acquiring the second three-dimensional model of the first camera, the image processing device includes a laser radar. The image processing device uses the laser radar to scan the first camera to obtain the 3D model of the first camera as the second 3D model.
应理解,在本申请实施例中,获取第一摄像头的第二三维模型和获取第一摄像头的目标朝向可以分开执行,也可以同时执行。It should be understood that, in this embodiment of the present application, acquiring the second three-dimensional model of the first camera and acquiring the target orientation of the first camera may be performed separately, or may be performed simultaneously.
在执行完步骤14后,图像处理装置在执行步骤102的过程中执行以下步骤:After step 14 is executed, the image processing device executes the following steps in the process of executing step 102:
15、将上述第一位置作为上述第二三维模型在上述第一三维模型中的位置,并将上述目标朝向作为上述第二三维模型在上述第一三维模型中的朝向,在上述第一三维模型中显示上述第二三维模型。15. Taking the above-mentioned first position as the position of the above-mentioned second three-dimensional model in the above-mentioned first three-dimensional model, and taking the above-mentioned target orientation as the orientation of the above-mentioned second three-dimensional model in the above-mentioned first three-dimensional model, in the above-mentioned first three-dimensional model The above second 3D model is shown in .
在步骤15中,图像处理装置依据第一位置确定第二三维模型在第一三维模型中的位置,并依据目标朝向确定第二三维模型在第一三维模型中的朝向,进而依据第二三维模型在第一三维模型中的位置和第二三维模型在第一三维模型中的朝向在第一三维模型中显示第二三维模型,从而取得更好的显示效果,使在第一三维模型中显示第二三维模型的显示效果更逼真。此外,由于第二三维模型可精确显示第一位置(即第一摄像头在第一三维模型中的横坐标、纵坐标和竖坐标),通过在第一三维模型中显示第二三维模型,可提升所显示的第一摄像头的位置的准确度。In step 15, the image processing device determines the position of the second 3D model in the first 3D model according to the first position, and determines the orientation of the second 3D model in the first 3D model according to the orientation of the target, and then according to the second 3D model The position in the first three-dimensional model and the orientation of the second three-dimensional model in the first three-dimensional model display the second three-dimensional model in the first three-dimensional model, so as to achieve better display effect, so that the second three-dimensional model is displayed in the first three-dimensional model The display effect of the 2D and 3D models is more realistic. In addition, since the second 3D model can accurately display the first position (ie, the abscissa, ordinate and vertical coordinate of the first camera in the first 3D model), by displaying the second 3D model in the first 3D model, the The accuracy of the displayed position of the first camera.
可选的,图像处理装置通过执行步骤15得到的显示效果可参见图2。Optionally, the display effect obtained by the image processing device by performing step 15 can be referred to in FIG. 2 .
作为一种可选的实施方式,图像处理装置在执行步骤102之前还执行以下步骤:As an optional implementation manner, the image processing device further performs the following steps before performing step 102:
16、获取上述第一摄像头的目标朝向和上述第一摄像头的图像。16. Obtain the target orientation of the first camera and the image of the first camera.
在一种可能实现的方式中,第一摄像头的图像可通过对第一摄像头进行拍摄得到。In a possible implementation manner, the image of the first camera may be obtained by shooting the first camera.
在执行完步骤16后,图像处理装置在执行步骤102的过程中执行以下步骤:After performing step 16, the image processing device performs the following steps in the process of performing step 102:
17、依据上述第一位置和上述目标朝向,在上述第一三维模型中显示上述第一摄像头的图像。17. Display the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
在该种实施方式中,由于得到第一摄像头的图像的成本低,且在第一三维模型中显示第一摄像头的图像的难度低、数据处理量低,通过执行步骤16和步骤17在第一三维模型中显示第一摄像头,可降低成本,减少数据处理量。In this embodiment, because the cost of obtaining the image of the first camera is low, and the difficulty of displaying the image of the first camera in the first 3D model is low, and the amount of data processing is low, by performing step 16 and step 17 in the first The first camera is displayed in the 3D model, which can reduce the cost and reduce the amount of data processing.
基于本申请实施例提供的技术方案,本申请实施例还提供了一种可能的应用场景。Based on the technical solution provided by the embodiment of the present application, the embodiment of the present application also provides a possible application scenario.
为了增强工作、生活或者社会环境中的安全性,会在各个区域场所内安装监控摄像头,以便根据监控摄像头采集到的视频流信息进行安全防护,如从视频流确定目标人物的行踪。因此,如何合理布局场所内的监控摄像头对提高安全防护具有非常重要的意义。其中,监控摄像头的布局包括:监控摄像头的安装高度、监控摄像头的朝向、监控摄像头的拍摄范围、场所内各地点的摄像头覆盖指标。In order to enhance the safety in work, life or social environment, surveillance cameras will be installed in various areas, so as to carry out security protection based on the video stream information collected by the surveillance cameras, such as determining the whereabouts of target persons from the video stream. Therefore, how to reasonably arrange the monitoring cameras in the place is of great significance to improve security protection. Among them, the layout of the surveillance cameras includes: the installation height of the surveillance cameras, the orientation of the surveillance cameras, the shooting range of the surveillance cameras, and the coverage indicators of the cameras at various locations within the site.
目前,为确定监控摄像头的布局是否合理,以及确定调整监控摄像头布局,均需要相关人员到场所内观察监控摄像头的布局,并通过人工调整监控摄像头的布局以确定监控摄像头的布局是否合理。该种方法不仅需要耗费较高的人力成本和时间成本,而且相关人员观察场所内监控摄像头的布局的效率较低。At present, in order to determine whether the layout of the surveillance cameras is reasonable, and to determine whether to adjust the layout of the surveillance cameras, relevant personnel are required to observe the layout of the surveillance cameras in the site, and manually adjust the layout of the surveillance cameras to determine whether the layout of the surveillance cameras is reasonable. This method not only requires high labor costs and time costs, but also has low efficiency for relevant personnel to observe the layout of surveillance cameras in the site.
基于本申请实施例提供的技术方案,可在场所的三维模型中显示监控摄像头,且可可视化显示监控摄像头的摄像头参数和监控摄像头的位置,从而使相关人员无需到场所 内即可观察监控摄像头的布局,由此降低观察场所内监控摄像头的布局的人力成本和时间成本,并提高相关人员观察场所内监控摄像头的布局的效率。Based on the technical solution provided by the embodiment of the present application, the monitoring camera can be displayed in the three-dimensional model of the place, and the camera parameters of the monitoring camera and the position of the monitoring camera can be visually displayed, so that relevant personnel can observe the location of the monitoring camera without going to the place Layout, thereby reducing the labor cost and time cost of observing the layout of the monitoring cameras in the place, and improving the efficiency of relevant personnel observing the layout of the monitoring cameras in the place.
而且通过调整监控摄像头的摄像头参数或调整监控摄像头的位置,可改变监控摄像头在场所内的三维模型的显示效果,这样相关人员通过图像处理装置即可观察到调整监控摄像头的布局后的效果,从而降低相关人员去场所内调整监控摄像头的布局所耗费的人力成本和时间成本,由此提高相关人员的工作效率。And by adjusting the camera parameters of the monitoring camera or adjusting the position of the monitoring camera, the display effect of the three-dimensional model of the monitoring camera in the place can be changed, so that relevant personnel can observe the effect after adjusting the layout of the monitoring camera through the image processing device, thereby Reduce the labor cost and time cost of relevant personnel to adjust the layout of surveillance cameras in the site, thereby improving the work efficiency of relevant personnel.
例如,A公司的大厦内多处均安装有监控摄像头,但依据实际监控效果可确定,A大厦内的B处存在监控死角。此时,A公司的相关人员通过在大厦的三维模型中增加一个监控摄像头,并合理布局该监控摄像头的高度、朝向,使B处的死角处于该监控摄像头的拍摄范围内,从而达到去除B处的监控死角。这样,相关人员在确定可去除B的监控死角后,调整监控摄像头布局,可降低人力成本和时间成本,并提高相关人员的工作效率。For example, surveillance cameras are installed in many places in the building of Company A, but according to the actual monitoring effect, it can be determined that there is a dead spot in surveillance at B in Building A. At this time, the relevant personnel of company A added a surveillance camera to the 3D model of the building, and reasonably arranged the height and orientation of the surveillance camera, so that the dead angle at point B was within the shooting range of the surveillance camera, so as to remove the monitoring blind spots. In this way, after the relevant personnel determine that the monitoring dead angle of B can be removed, they can adjust the layout of the surveillance cameras, which can reduce labor costs and time costs, and improve the work efficiency of relevant personnel.
本领域技术人员可以理解,在具体实施方式的上述方法中,各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定,各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。Those skilled in the art can understand that in the above method of specific implementation, the writing order of each step does not mean a strict execution order and constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possible The inner logic is OK.
上述详细阐述了本申请实施例的方法,下面提供了本申请实施例的装置。The method of the embodiment of the present application has been described in detail above, and the device of the embodiment of the present application is provided below.
请参阅图5,图5为本申请实施例提供的一种图像处理装置的结构示意图,该图像处理装置1包括获取单元11、显示单元12。可选的,该图像处理装置1还包括处理单元13。其中:Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the present application. The image processing device 1 includes an acquisition unit 11 and a display unit 12 . Optionally, the image processing device 1 further includes a processing unit 13 . in:
获取单元11,配置为获取目标场景的第一三维模型以及第一摄像头的第一位置,所述第一摄像头为所述目标场景内的摄像头,所述第一位置为所述第一三维模型的坐标系下的位置;The acquisition unit 11 is configured to acquire a first three-dimensional model of the target scene and a first position of a first camera, the first camera is a camera in the target scene, and the first position is a position of the first three-dimensional model position in the coordinate system;
显示单元12,配置为依据所述第一位置在所述第一三维模型中显示所述第一摄像头。The display unit 12 is configured to display the first camera in the first three-dimensional model according to the first position.
结合本申请任一实施方式,所述获取单元11,还配置为:In combination with any embodiment of the present application, the acquisition unit 11 is further configured to:
获取所述第一摄像头的摄像头参数,所述摄像头参数至少包括以下中的一个或一个以上:摄像头类型、可视角度;Obtain camera parameters of the first camera, where the camera parameters at least include one or more of the following: camera type, viewing angle;
所述显示单元12,还配置为在所述第一三维模型中以可视化的方式显示所述摄像头参数。The display unit 12 is further configured to display the camera parameters in a visual manner in the first three-dimensional model.
结合本申请任一实施方式,所述第一三维模型包括第一点和第二点,所述第一点在所述第一三维模型中的位置和所述第二点在所述第一三维模型中的位置不同,所述图像处理装置1还包括:In combination with any embodiment of the present application, the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional The positions in the model are different, and the image processing device 1 also includes:
处理单元13,配置为确定第二摄像头的第一数量和第三摄像头的第二数量,所述第二摄像头为拍摄范围包括所述第一点的摄像头,所述第三摄像头为拍摄范围包括所述第二点的摄像头;The processing unit 13 is configured to determine a first number of second cameras and a second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the first point The camera mentioned in the second point;
所述处理单元13,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第一摄像头覆盖指标与所述第一数量呈正相关;The processing unit 13 is further configured to obtain a first camera coverage index according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
所述处理单元13,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第二摄像头覆盖指标与所述第二数量呈正相关;The processing unit 13 is further configured to obtain a first camera coverage index according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
所述显示单元12,还配置为在所述第一点显示所述第一摄像头覆盖指标,并在所述第二点显示所述第二摄像头覆盖指标。The display unit 12 is further configured to display the first camera coverage indicator at the first point, and display the second camera coverage indicator at the second point.
结合本申请任一实施方式,所述获取单元11,还配置为在所述第一点显示第一摄像头覆盖指标之前,获取第一楼层内的摄像头的第三数量;In combination with any embodiment of the present application, the acquiring unit 11 is further configured to acquire a third number of cameras on the first floor before the first camera coverage indicator is displayed at the first point;
所述处理单元13,还配置为依据所述第一数量与所述第三数量的比值得到所述第一摄像头覆盖指标。The processing unit 13 is further configured to obtain the first camera coverage index according to a ratio of the first number to the third number.
结合本申请任一实施方式,所述显示单元12配置为:In combination with any embodiment of the present application, the display unit 12 is configured as:
获取映射关系,所述映射关系表征摄像头覆盖指标与颜色之间的映射关系;Obtain a mapping relationship, the mapping relationship represents the mapping relationship between the camera coverage index and the color;
依据所述第一摄像头覆盖指标确定所述第一点的颜色;Determine the color of the first point according to the first camera coverage index;
以所述第一点的颜色显示所述第一点。The first point is displayed in the color of the first point.
结合本申请任一实施方式,所述第一摄像头位于所述第一楼层,所述显示单元12,还配置为:在检测到显示第二楼层的指令的情况下,在所述第一三维模型中显示所述第二楼层。In combination with any embodiment of the present application, the first camera is located on the first floor, and the display unit 12 is further configured to: when an instruction to display the second floor is detected, the first three-dimensional model The second floor is shown in .
结合本申请任一实施方式,所述获取单元11,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的第二三维模型,所述目标朝向为所述第一摄像头在所述第一三维模型的坐标系下的朝向;In combination with any embodiment of the present application, the acquisition unit 11 is further configured to acquire the target of the first camera before displaying the first camera in the first three-dimensional model according to the first position orientation and a second three-dimensional model of the first camera, the target orientation being the orientation of the first camera in the coordinate system of the first three-dimensional model;
所述显示单元12,配置为:The display unit 12 is configured as:
将所述第一位置作为所述第二三维模型在所述第一三维模型中的位置,并将所述朝向作为所述第二三维模型在所述第一三维模型中的朝向,在所述第一三维模型中显示所述第二三维模型。Taking the first position as the position of the second 3D model in the first 3D model, and taking the orientation as the orientation of the second 3D model in the first 3D model, in the The second three-dimensional model is displayed in the first three-dimensional model.
结合本申请任一实施方式,所述获取单元11,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的图像;In combination with any embodiment of the present application, the acquisition unit 11 is further configured to acquire the target of the first camera before displaying the first camera in the first three-dimensional model according to the first position Heading and the image of the first camera;
所述显示单元12,配置为:The display unit 12 is configured as:
依据所述第一位置和所述目标朝向,在所述第一三维模型中显示所述第一摄像头的图像。Displaying the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
结合本申请任一实施方式,所述获取单元11,配置为:In combination with any implementation manner of the present application, the acquisition unit 11 is configured to:
获取所述第一摄像头在全球定位系统中的第二位置和坐标转换关系,所述坐标转换关系为所述全球定位系统的坐标系与所述第一三维模型的坐标系之间的转换关系;Obtaining a second position of the first camera in the global positioning system and a coordinate transformation relationship, where the coordinate transformation relationship is a transformation relationship between the coordinate system of the global positioning system and the coordinate system of the first three-dimensional model;
依据坐标转换关系对所述第二位置进行转换,得到所述第一摄像头的第一位置。The second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
结合本申请任一实施方式,所述显示单元12,还配置为:In combination with any embodiment of the present application, the display unit 12 is further configured as:
在检测到预览所述第一摄像头采集到的画面的指令的情况下,在所述第一摄像头的显示区域内显示所述第一摄像头采集到的画面。If an instruction to preview the picture captured by the first camera is detected, the picture captured by the first camera is displayed in the display area of the first camera.
本实施例中,图像处理装置依据第一位置在第一三维模型中显示第一摄像头,可更直观的展示第一摄像头在目标场景中的位置。In this embodiment, the image processing device displays the first camera in the first three-dimensional model according to the first position, which can more intuitively show the position of the first camera in the target scene.
在一些实施例中,本申请实施例提供的装置具有的功能或包含的模块可以配置为执行上文方法实施例描述的方法,其具体实现可以参照上文方法实施例的描述,为了简洁,这里不再赘述。In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be configured to execute the methods described in the above method embodiments, and its specific implementation can refer to the descriptions of the above method embodiments. For brevity, here No longer.
图6为本申请实施例提供的一种图像处理装置的硬件结构示意图。该图像处理装置2包括处理器21,存储器22,输入装置23,输出装置24。该处理器21、存储器22、输入装置23和输出装置24通过连接器相耦合,该连接器包括各类接口、传输线或总线等等,本申请实施例对此不作限定。应当理解,本申请的各个实施例中,耦合是指通过特定方式的相互联系,包括直接相连或者通过其他设备间接相连,例如可以通过各类接口、传输线、总线等相连。FIG. 6 is a schematic diagram of a hardware structure of an image processing device provided by an embodiment of the present application. The image processing device 2 includes a processor 21 , a memory 22 , an input device 23 and an output device 24 . The processor 21, the memory 22, the input device 23 and the output device 24 are coupled through connectors, and the connectors include various interfaces, transmission lines or buses, etc., which are not limited in this embodiment of the present application. It should be understood that in various embodiments of the present application, coupling refers to interconnection in a specific way, including direct connection or indirect connection through other devices, for example, connection through various interfaces, transmission lines, and buses.
处理器21可以是一个或多个图形处理器(graphics processing unit,GPU),在处理器21是一个GPU的情况下,该GPU可以是单核GPU,也可以是多核GPU。可选的,处理器21可以是多个GPU构成的处理器组,多个处理器之间通过一个或多个总线彼此耦合。可选的,该处理器还可以为其他类型的处理器等等,本申请实施例不作限定。The processor 21 may be one or more graphics processing units (graphics processing unit, GPU), and in the case where the processor 21 is a GPU, the GPU may be a single-core GPU or a multi-core GPU. Optionally, the processor 21 may be a processor group composed of multiple GPUs, and the multiple processors are coupled to each other through one or more buses. Optionally, the processor may also be other types of processors, etc., which are not limited in this embodiment of the present application.
存储器22可配置为存储计算机程序指令,以及配置为执行本申请方案的程序代码 在内的各类计算机程序代码。可选地,存储器包括但不限于是随机存储记忆体(random access memory,RAM)、只读存储器(read-only memory,ROM)、可擦除可编程只读存储器(erasable programmable read only memory,EPROM)、或便携式只读存储器(compact disc read-only memory,CD-ROM),该存储器配置为存储相关指令及数据。The memory 22 can be configured to store computer program instructions, and various computer program codes configured to execute the program codes of the solutions of the present application. Optionally, the memory includes but is not limited to random access memory (random access memory, RAM), read-only memory (read-only memory, ROM), erasable programmable read-only memory (erasable programmable read only memory, EPROM ), or a portable read-only memory (compact disc read-only memory, CD-ROM), which is configured to store relevant instructions and data.
输入装置23配置为输入数据和/或信号,以及输出装置24配置为输出数据和/或信号。输入装置23和输出装置24可以是独立的器件,也可以是一个整体的器件。The input device 23 is configured to input data and/or signals, and the output device 24 is configured to output data and/or signals. The input device 23 and the output device 24 can be independent devices, or an integrated device.
可理解,本申请实施例中,存储器22不仅可配置为存储相关指令,还可配置为存储相关数据,如该存储器22可配置为存储通过输入装置23获取的第一三维模型和第一位置等等,本申请实施例对于该存储器中具体所存储的数据不作限定。It can be understood that in the embodiment of the present application, the memory 22 can be configured not only to store relevant instructions, but also to store relevant data, for example, the memory 22 can be configured to store the first three-dimensional model and the first position obtained through the input device 23, etc. etc., the embodiment of the present application does not limit the specific data stored in the memory.
可以理解的是,图6仅仅示出了一种图像处理装置的简化设计。在实际应用中,图像处理装置还可以分别包含必要的其他元件,包含但不限于任意数量的输入/输出装置、处理器、存储器等,而所有可以实现本申请实施例的图像处理装置都在本申请的保护范围之内。It can be understood that FIG. 6 only shows a simplified design of an image processing device. In practical applications, the image processing device may also include other necessary components, including but not limited to any number of input/output devices, processors, memories, etc., and all image processing devices that can implement the embodiments of the present application are included in this within the scope of the application.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。所属领域的技术人员还可以清楚地了解到,本申请各个实施例描述各有侧重,为描述的方便和简洁,相同或类似的部分在不同实施例中可能没有赘述,因此,在某一实施例未描述或未详细描述的部分可以参见其他实施例的记载。Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here. Those skilled in the art can also clearly understand that the descriptions of each embodiment of the present application have their own emphases. For the convenience and brevity of description, the same or similar parts may not be repeated in different embodiments. Therefore, in a certain embodiment For parts not described or not described in detail, reference may be made to the descriptions of other embodiments.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个显示单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present application may be integrated into one display unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者通过所述计算机可读存储介质进行传输。所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的 任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,数字通用光盘(digital versatile disc,DVD))、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted via a computer-readable storage medium. The computer instructions can be sent from a web site, computer, server, or data center via wired (e.g. coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g. infrared, wireless, microwave, etc.) Another website site, computer, server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device including a server, a data center, and the like integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a digital versatile disc (digital versatile disc, DVD)), or a semiconductor medium (for example, a solid state disk (solid state disk, SSD) )Wait.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:只读存储器(read-only memory,ROM)或随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments are realized. The processes can be completed by computer programs to instruct related hardware. The programs can be stored in computer-readable storage media. When the programs are executed , may include the processes of the foregoing method embodiments. The aforementioned storage medium includes: various media capable of storing program codes such as read-only memory (ROM) or random access memory (RAM), magnetic disk or optical disk.
工业实用性Industrial Applicability
本公开实施例提供了一种图像处理方法及装置、电子设备、计算机可读存储介质及计算机程序产品,其中,方法包括:获取目标场景的第一三维模型以及第一摄像头的第一位置,第一摄像头为目标场景内的摄像头,第一位置为第一三维模型的坐标系下的位置;依据第一位置在第一三维模型中显示第一摄像头。本公开实施例提供的技术方案,提高了摄像头在场所内的位置的显示效果。Embodiments of the present disclosure provide an image processing method and device, electronic equipment, a computer-readable storage medium, and a computer program product, wherein the method includes: acquiring a first three-dimensional model of a target scene and a first position of a first camera, and the second A camera is a camera in the target scene, and the first position is a position in the coordinate system of the first 3D model; the first camera is displayed in the first 3D model according to the first position. The technical solutions provided by the embodiments of the present disclosure improve the display effect of the position of the camera in the venue.

Claims (23)

  1. 一种图像处理方法,所述方法包括:An image processing method, the method comprising:
    获取目标场景的第一三维模型以及第一摄像头的第一位置,所述第一摄像头为所述目标场景内的摄像头,所述第一位置为所述第一三维模型的坐标系下的位置;Acquiring the first three-dimensional model of the target scene and the first position of the first camera, the first camera is a camera in the target scene, and the first position is the position under the coordinate system of the first three-dimensional model;
    依据所述第一位置在所述第一三维模型中显示所述第一摄像头。displaying the first camera in the first three-dimensional model according to the first position.
  2. 根据权利要求1所述的方法,其中,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    获取所述第一摄像头的摄像头参数,所述摄像头参数至少包括以下中的一个或一个以上:摄像头类型、可视角度;Obtain camera parameters of the first camera, where the camera parameters at least include one or more of the following: camera type, viewing angle;
    在所述第一三维模型中以可视化的方式显示所述摄像头参数。The camera parameters are displayed in a visual manner in the first three-dimensional model.
  3. 根据权利要求1或2所述的方法,其中,所述第一三维模型包括第一点和第二点,所述第一点在所述第一三维模型中的位置和所述第二点在所述第一三维模型中的位置不同,所述方法还包括:The method according to claim 1 or 2, wherein the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the first three-dimensional model The positions in the first three-dimensional model are different, and the method further includes:
    确定第二摄像头的第一数量和第三摄像头的第二数量,所述第二摄像头为拍摄范围包括所述第一点的摄像头,所述第三摄像头为拍摄范围包括所述第二点的摄像头;Determining the first number of second cameras and the second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the second point ;
    依据所述第一数量得到第一摄像头覆盖指标,所述第一摄像头覆盖指标与所述第一数量呈正相关;A first camera coverage index is obtained according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
    依据所述第一数量得到第一摄像头覆盖指标,所述第二摄像头覆盖指标与所述第二数量呈正相关;A first camera coverage index is obtained according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
    在所述第一点显示所述第一摄像头覆盖指标,并在所述第二点显示所述第二摄像头覆盖指标。The first camera coverage indicator is displayed at the first point, and the second camera coverage indicator is displayed at the second point.
  4. 根据权利要求3所述的方法,其中,所述在所述第一点显示第一摄像头覆盖指标之前,所述方法还包括:The method according to claim 3, wherein, before displaying the first camera coverage indicator at the first point, the method further comprises:
    获取第一楼层内的摄像头的第三数量;Get the third number of cameras in the first floor;
    依据所述第一数量与所述第三数量的比值得到所述第一摄像头覆盖指标。The first camera coverage index is obtained according to a ratio of the first quantity to the third quantity.
  5. 根据权利要求3或4所述的方法,其中,所述在所述第一点显示第一摄像头覆盖指标,包括:The method according to claim 3 or 4, wherein the displaying the first camera coverage indicator at the first point comprises:
    获取映射关系,所述映射关系表征摄像头覆盖指标与颜色之间的映射关系;Obtain a mapping relationship, the mapping relationship represents the mapping relationship between the camera coverage index and the color;
    依据所述第一摄像头覆盖指标确定所述第一点的颜色;Determine the color of the first point according to the first camera coverage index;
    以所述第一点的颜色显示所述第一点。The first point is displayed in the color of the first point.
  6. 根据权利要求3至5中任意一项所述的方法,其中,所述第一摄像头位于所述第一楼层,所述方法还包括:The method according to any one of claims 3 to 5, wherein the first camera is located on the first floor, the method further comprising:
    在检测到显示第二楼层的指令的情况下,在所述第一三维模型中显示所述第二楼层。In case an instruction to display a second floor is detected, the second floor is displayed in the first three-dimensional model.
  7. 根据权利要求1至6中任意一项所述的方法,其中,在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,所述方法还包括:The method according to any one of claims 1 to 6, wherein, before displaying the first camera in the first three-dimensional model according to the first position, the method further comprises:
    获取所述第一摄像头的目标朝向和所述第一摄像头的第二三维模型,所述目标朝向为所述第一摄像头在所述第一三维模型的坐标系下的朝向;Acquiring the target orientation of the first camera and the second three-dimensional model of the first camera, the target orientation being the orientation of the first camera in the coordinate system of the first three-dimensional model;
    所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头,包括:The displaying the first camera in the first three-dimensional model according to the first position includes:
    将所述第一位置作为所述第二三维模型在所述第一三维模型中的位置,并将所述朝向作为所述第二三维模型在所述第一三维模型中的朝向,在所述第一三维模型中显示所述第二三维模型。Taking the first position as the position of the second 3D model in the first 3D model, and taking the orientation as the orientation of the second 3D model in the first 3D model, in the The second three-dimensional model is displayed in the first three-dimensional model.
  8. 根据权利要求1至6中任意一项所述的方法,其中,在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,所述方法还包括:The method according to any one of claims 1 to 6, wherein, before displaying the first camera in the first three-dimensional model according to the first position, the method further comprises:
    获取所述第一摄像头的目标朝向和所述第一摄像头的图像;Acquiring the target orientation of the first camera and the image of the first camera;
    所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头,包括:The displaying the first camera in the first three-dimensional model according to the first position includes:
    依据所述第一位置和所述目标朝向,在所述第一三维模型中显示所述第一摄像头的图像。Displaying the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
  9. 根据权利要求1至8中任意一项所述的方法,其中,所述获取第一摄像头的第一位置,包括:The method according to any one of claims 1 to 8, wherein said acquiring the first position of the first camera comprises:
    获取所述第一摄像头在全球定位系统中的第二位置和坐标转换关系,所述坐标转换关系为所述全球定位系统的坐标系与所述第一三维模型的坐标系之间的转换关系;Obtaining a second position of the first camera in the global positioning system and a coordinate transformation relationship, where the coordinate transformation relationship is a transformation relationship between the coordinate system of the global positioning system and the coordinate system of the first three-dimensional model;
    依据坐标转换关系对所述第二位置进行转换,得到所述第一摄像头的第一位置。The second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
  10. 根据权利要求1至8中任意一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 8, wherein the method further comprises:
    在检测到预览所述第一摄像头采集到的画面的指令的情况下,在所述第一摄像头的显示区域内显示所述第一摄像头采集到的画面。If an instruction to preview the picture captured by the first camera is detected, the picture captured by the first camera is displayed in the display area of the first camera.
  11. 一种图像处理装置,所述装置包括:An image processing device, the device comprising:
    获取单元,配置为获取目标场景的第一三维模型以及第一摄像头的第一位置,所述第一摄像头为所述目标场景内的摄像头,所述第一位置为所述第一三维模型的坐标系下的位置;An acquisition unit configured to acquire a first three-dimensional model of the target scene and a first position of a first camera, the first camera is a camera in the target scene, and the first position is the coordinates of the first three-dimensional model position under the system;
    显示单元,配置为依据所述第一位置在所述第一三维模型中显示所述第一摄像头。A display unit configured to display the first camera in the first three-dimensional model according to the first position.
  12. 根据权利要求11所述的装置,其中,The apparatus of claim 11, wherein,
    所述获取单元,还配置为:The acquisition unit is also configured as:
    获取所述第一摄像头的摄像头参数,所述摄像头参数至少包括以下中的一个或一个以上:摄像头类型、可视角度;Obtain camera parameters of the first camera, where the camera parameters at least include one or more of the following: camera type, viewing angle;
    所述显示单元,还配置为在所述第一三维模型中以可视化的方式显示所述摄像头参数。The display unit is further configured to display the camera parameters in a visual manner in the first three-dimensional model.
  13. 根据权利要求11或12所述的装置,其中,所述第一三维模型包括第一点和第二点,所述第一点在所述第一三维模型中的位置和所述第二点在所述第一三维模型中的位置不同,所述图像处理装置,还包括:The device according to claim 11 or 12, wherein the first three-dimensional model includes a first point and a second point, the position of the first point in the first three-dimensional model and the position of the second point in the The positions in the first three-dimensional model are different, and the image processing device further includes:
    处理单元,配置为确定第二摄像头的第一数量和第三摄像头的第二数量,所述第二摄像头为拍摄范围包括所述第一点的摄像头,所述第三摄像头为拍摄范围包括所述第二点的摄像头;A processing unit configured to determine a first number of second cameras and a second number of third cameras, the second camera is a camera whose shooting range includes the first point, and the third camera is a camera whose shooting range includes the The camera at the second point;
    所述处理单元,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第一摄像头覆盖指标与所述第一数量呈正相关;The processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the first camera coverage index is positively correlated with the first quantity;
    所述处理单元,还配置为依据所述第一数量得到第一摄像头覆盖指标,所述第二摄像头覆盖指标与所述第二数量呈正相关;The processing unit is further configured to obtain a first camera coverage index according to the first quantity, and the second camera coverage index is positively correlated with the second quantity;
    所述显示单元,还配置为在所述第一点显示所述第一摄像头覆盖指标,并在所述第二点显示所述第二摄像头覆盖指标。The display unit is further configured to display the first camera coverage indicator at the first point, and display the second camera coverage indicator at the second point.
  14. 根据权利要求13所述的装置,其中,The apparatus of claim 13, wherein,
    所述获取单元,还配置为在所述第一点显示第一摄像头覆盖指标之前,获取第一楼层内的摄像头的第三数量;The acquiring unit is further configured to acquire a third number of cameras on the first floor before the first point displays the first camera coverage index;
    所述处理单元,还配置为依据所述第一数量与所述第三数量的比值得到所述第一摄像头覆盖指标。The processing unit is further configured to obtain the first camera coverage index according to a ratio of the first quantity to the third quantity.
  15. 根据权利要求13或14所述的装置,其中,所述显示单元配置为:The device according to claim 13 or 14, wherein the display unit is configured as:
    获取映射关系,所述映射关系表征摄像头覆盖指标与颜色之间的映射关系;Obtain a mapping relationship, the mapping relationship represents the mapping relationship between the camera coverage index and the color;
    依据所述第一摄像头覆盖指标确定所述第一点的颜色;Determine the color of the first point according to the first camera coverage index;
    以所述第一点的颜色显示所述第一点。The first point is displayed in the color of the first point.
  16. 根据权利要求13至15任一项所述的装置,其中,所述第一摄像头位于所述第 一楼层,所述显示单元,还配置为:在检测到显示第二楼层的指令的情况下,在所述第一三维模型中显示所述第二楼层。The device according to any one of claims 13 to 15, wherein the first camera is located on the first floor, and the display unit is further configured to: when an instruction to display the second floor is detected, The second floor is displayed in the first three-dimensional model.
  17. 根据权利要求11至16任一项所述的装置,其中,Apparatus according to any one of claims 11 to 16, wherein,
    所述获取单元,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的第二三维模型,所述目标朝向为所述第一摄像头在所述第一三维模型的坐标系下的朝向;The acquiring unit is further configured to, before displaying the first camera in the first three-dimensional model according to the first position, acquire a target orientation of the first camera and a second position of the first camera. A three-dimensional model, the orientation of the target being the orientation of the first camera in the coordinate system of the first three-dimensional model;
    所述显示单元,配置为:The display unit is configured as:
    将所述第一位置作为所述第二三维模型在所述第一三维模型中的位置,并将所述朝向作为所述第二三维模型在所述第一三维模型中的朝向,在所述第一三维模型中显示所述第二三维模型。Taking the first position as the position of the second 3D model in the first 3D model, and taking the orientation as the orientation of the second 3D model in the first 3D model, in the The second three-dimensional model is displayed in the first three-dimensional model.
  18. 根据权利要求11至16任一项所述的装置,其中,Apparatus according to any one of claims 11 to 16, wherein,
    所述获取单元,还配置为在所述依据所述第一位置在所述第一三维模型中显示所述第一摄像头之前,获取所述第一摄像头的目标朝向和所述第一摄像头的图像;The acquisition unit is further configured to acquire the target orientation of the first camera and the image of the first camera before displaying the first camera in the first three-dimensional model according to the first position ;
    所述显示单元,配置为:The display unit is configured as:
    依据所述第一位置和所述目标朝向,在所述第一三维模型中显示所述第一摄像头的图像。Displaying the image of the first camera in the first three-dimensional model according to the first position and the orientation of the target.
  19. 根据权利要求11至18任一项所述的装置,其中,Apparatus according to any one of claims 11 to 18, wherein,
    所述获取单元,配置为:The acquisition unit is configured as:
    获取所述第一摄像头在全球定位系统中的第二位置和坐标转换关系,所述坐标转换关系为所述全球定位系统的坐标系与所述第一三维模型的坐标系之间的转换关系;Obtaining a second position of the first camera in the global positioning system and a coordinate transformation relationship, where the coordinate transformation relationship is a transformation relationship between the coordinate system of the global positioning system and the coordinate system of the first three-dimensional model;
    依据坐标转换关系对所述第二位置进行转换,得到所述第一摄像头的第一位置。The second position is transformed according to the coordinate transformation relationship to obtain the first position of the first camera.
  20. 根据权利要求11至18任一项所述的装置,其中,Apparatus according to any one of claims 11 to 18, wherein,
    所述显示单元,还配置为:The display unit is further configured as:
    在检测到预览所述第一摄像头采集到的画面的指令的情况下,在所述第一摄像头的显示区域内显示所述第一摄像头采集到的画面。If an instruction to preview the picture captured by the first camera is detected, the picture captured by the first camera is displayed in the display area of the first camera.
  21. 一种电子设备,包括:处理器和存储器,所述存储器配置为存储计算机程序代码,所述计算机程序代码包括计算机指令,在所述处理器执行所述计算机指令的情况下,所述电子设备执行如权利要求1至10中任意一项所述的方法。An electronic device, comprising: a processor and a memory configured to store computer program code, the computer program code including computer instructions, when the processor executes the computer instructions, the electronic device executes A method as claimed in any one of claims 1 to 10.
  22. 一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,所述计算机程序包括程序指令,在所述程序指令被处理器执行的情况下,使所述处理器执行权利要求1至10中任意一项所述的方法。A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a processor, the processor is caused to perform the claims The method described in any one of 1 to 10.
  23. 一种计算机程序产品,所述计算机程序产品包括计算机程序或指令,在所述计算机程序或指令在计算机上运行的情况下,使所述计算机执行权利要求1至10中任意一项所述的方法。A computer program product, said computer program product comprising a computer program or instructions, when said computer program or instructions run on a computer, causes said computer to perform the method described in any one of claims 1 to 10 .
PCT/CN2021/134884 2021-06-29 2021-12-01 Image processing method and apparatus, and electronic device, computer-readable storage medium and computer program product WO2023273155A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110730285.4 2021-06-29
CN202110730285.4A CN113436317B (en) 2021-06-29 2021-06-29 Image processing method and device, electronic equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
WO2023273155A1 true WO2023273155A1 (en) 2023-01-05

Family

ID=77757885

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/134884 WO2023273155A1 (en) 2021-06-29 2021-12-01 Image processing method and apparatus, and electronic device, computer-readable storage medium and computer program product

Country Status (2)

Country Link
CN (1) CN113436317B (en)
WO (1) WO2023273155A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113436317B (en) * 2021-06-29 2023-11-03 西安商汤智能科技有限公司 Image processing method and device, electronic equipment and computer readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103400409A (en) * 2013-08-27 2013-11-20 华中师范大学 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera
CN107111664A (en) * 2016-08-09 2017-08-29 深圳市瑞立视多媒体科技有限公司 A kind of video camera collocation method and device
US20190034056A1 (en) * 2017-07-26 2019-01-31 Adobe Systems Incorporated Manipulating a camera perspective within a three-dimensional space
US20190037147A1 (en) * 2016-08-09 2019-01-31 Shenzhen Realis Multimedia Technology Co., Ltd Camera configuration method and apparatus
CN111696216A (en) * 2020-06-16 2020-09-22 浙江大华技术股份有限公司 Three-dimensional augmented reality panorama fusion method and system
CN111737518A (en) * 2020-06-16 2020-10-02 浙江大华技术股份有限公司 Image display method and device based on three-dimensional scene model and electronic equipment
CN113436317A (en) * 2021-06-29 2021-09-24 西安商汤智能科技有限公司 Image processing method and device, electronic equipment and computer readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7164968B2 (en) * 2018-05-07 2022-11-02 キヤノン株式会社 IMAGE PROCESSING DEVICE, CONTROL METHOD AND PROGRAM OF IMAGE PROCESSING DEVICE
CN112197708B (en) * 2020-08-31 2022-04-22 深圳市慧鲤科技有限公司 Measuring method and device, electronic device and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103400409A (en) * 2013-08-27 2013-11-20 华中师范大学 3D (three-dimensional) visualization method for coverage range based on quick estimation of attitude of camera
CN107111664A (en) * 2016-08-09 2017-08-29 深圳市瑞立视多媒体科技有限公司 A kind of video camera collocation method and device
US20190037147A1 (en) * 2016-08-09 2019-01-31 Shenzhen Realis Multimedia Technology Co., Ltd Camera configuration method and apparatus
US20190034056A1 (en) * 2017-07-26 2019-01-31 Adobe Systems Incorporated Manipulating a camera perspective within a three-dimensional space
CN111696216A (en) * 2020-06-16 2020-09-22 浙江大华技术股份有限公司 Three-dimensional augmented reality panorama fusion method and system
CN111737518A (en) * 2020-06-16 2020-10-02 浙江大华技术股份有限公司 Image display method and device based on three-dimensional scene model and electronic equipment
CN113436317A (en) * 2021-06-29 2021-09-24 西安商汤智能科技有限公司 Image processing method and device, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN113436317A (en) 2021-09-24
CN113436317B (en) 2023-11-03

Similar Documents

Publication Publication Date Title
JP6798094B2 (en) Methods and devices for marking and displaying space sizes in virtual 3D house models
JP6627861B2 (en) Image processing system, image processing method, and program
US9443353B2 (en) Methods and systems for capturing and moving 3D models and true-scale metadata of real world objects
CN108347657B (en) Method and device for displaying bullet screen information
JP5961249B2 (en) Color channel and light marker
US20220319139A1 (en) Multi-endpoint mixed-reality meetings
WO2010027193A2 (en) Spatially correlated rendering of three-dimensional content on display components having arbitrary positions
US20140313228A1 (en) Image processing device, and computer program product
EP2814000B1 (en) Image processing apparatus, image processing method, and program
WO2023093217A1 (en) Data labeling method and apparatus, and computer device, storage medium and program
Kido et al. Assessing future landscapes using enhanced mixed reality with semantic segmentation by deep learning
KR101181967B1 (en) 3D street view system using identification information.
WO2023029969A1 (en) Image processing method and apparatus, and electronic device and computer-readable storage medium
US20130050483A1 (en) Apparatus, method, and program for video surveillance system
JPWO2017017790A1 (en) Image generation apparatus, image generation system, and image generation method
EP3005300A1 (en) Combining a digital image with a virtual entity
WO2023273155A1 (en) Image processing method and apparatus, and electronic device, computer-readable storage medium and computer program product
JP6686547B2 (en) Image processing system, program, image processing method
CN112530021A (en) Method, apparatus, device and storage medium for processing data
WO2023273154A1 (en) Image processing method and apparatus, and device, medium and program
JP7341736B2 (en) Information processing device, information processing method and program
WO2023005659A1 (en) Image processing method and apparatus, electronic device, computer-readable storage medium, computer program, and computer program product
KR102049235B1 (en) Space sharing service apparatus
TWI735367B (en) Speed measurement method, electronic equipment and storage medium
KR101850134B1 (en) Method and apparatus for generating 3d motion model

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21948081

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE