CN114895792A

CN114895792A - Spraying method, intelligent terminal and storage medium

Info

Publication number: CN114895792A
Application number: CN202210655467.4A
Authority: CN
Inventors: 徐保仑
Original assignee: Shanghai Chuanying Information Technology Co Ltd
Current assignee: Shanghai Chuanying Information Technology Co Ltd
Priority date: 2022-06-10
Filing date: 2022-06-10
Publication date: 2022-08-12

Abstract

The application provides a spraying method, an intelligent terminal and a storage medium, wherein the method comprises the following steps: acquiring a preset operation; and controlling the fluid material to be sprayed in the virtual scene according to the preset operation, and outputting a spraying picture. Through the technical scheme, the fluid material is controlled to be sprayed according to the preset operation, so that the fluid material and the depth grid can be fused, the spraying content in the spraying picture is attached to the surface of an object, and the spraying effect in the AR scene is effectively improved.

Description

Spraying method, intelligent terminal and storage medium

Technical Field

The application relates to the technical field of human-computer interaction, in particular to a spraying method, an intelligent terminal and a storage medium.

Background

The AR (Augmented Reality) technology is a technology in which virtual viewpoint information is applied to the real world, and a real environment and a virtual object are superimposed on the same picture or space by a computer technology. With the development of the technology, the AR technology is widely applied to various fields with its unique combination of virtuality and reality, and drawing in the AR space has become an important part of the user's needs.

In the course of conceiving and implementing the present application, the inventors found that at least the following problems existed: in some implementations, the AR space is usually sprayed by fixing the depth distance of the AR camera, but such spraying methods often have the defects that the surface of an object cannot be attached, the spraying distance cannot be dynamically adjusted, and collision interaction with the object in the AR scene cannot be performed, so that the spraying effect is poor.

Therefore, there is a need to propose a solution to improve the painting effect in AR scenes.

The foregoing description is provided for general background information and is not admitted to be prior art.

Disclosure of Invention

In view of the above technical problems, the present application provides a spraying method, an intelligent terminal, and a storage medium, which aim to improve a spraying effect in an AR scene.

In order to solve the above technical problem, the present application provides a spraying method, where the spraying method is applicable to a terminal device (such as an intelligent terminal), and the spraying method includes:

s10: acquiring a preset operation;

s20: and controlling the fluid material to be sprayed in the virtual scene according to the preset operation, and outputting a spraying picture.

Optionally, step S20 is preceded by:

acquiring a current picture frame;

calculating or determining depth information of at least one picture point in the current picture frame.

Optionally, the step of acquiring the current picture frame further includes:

judging whether the terminal equipment supports depth information calculation;

if the terminal equipment does not support the depth information calculation, determining or generating first prompt information; and/or the presence of a gas in the gas,

and if the terminal equipment supports the depth information calculation, executing the step of acquiring the current picture frame.

Optionally, after the step of calculating or determining the depth information of at least one picture point in the current picture frame, the method further includes:

selecting a preset position point in the current picture frame;

and caching the depth information of the picture points by taking preset position points as mark points to obtain the depth information of the picture frame.

Optionally, step S20 includes:

determining or generating spraying parameter information according to preset operation;

forming a depth grid according to the depth information of the picture points of the picture frame;

spraying the fluid material according to the spraying parameter information, and fusing the fluid material with the depth grid to obtain spraying points;

and determining or generating the spraying picture according to the spraying points.

Optionally, the step of determining or generating the painting screen according to the painting point includes:

fitting the spraying points to the current picture frame based on the depth information to obtain spraying point information;

and determining or generating a spraying picture according to the spraying point information and anchor point information stored in advance.

Optionally, before the step of determining or generating a painting picture according to the painting point information and anchor point information stored in advance, the method further includes:

and identifying the characteristic points in the current picture frame, and storing the characteristic points as the anchor point information.

Optionally, step S10 is preceded by:

identifying whether a screen of the terminal equipment is in a click state;

if the screen of the terminal equipment is in a click state, acquiring preset operation; and/or the presence of a gas in the gas,

and if the screen of the terminal equipment is not in a click state, judging whether spraying is carried out in the virtual scene, and if so, stopping spraying.

The application also provides an intelligent terminal, including: the spraying device comprises a memory and a processor, wherein the memory stores a spraying program, and the spraying program realizes the steps of any one of the spraying methods when being executed by the processor.

The present application also provides a computer-readable storage medium, which stores a computer program that, when executed by a processor, implements the steps of any of the above-described spray coating methods.

As described above, the spraying method of the present application includes obtaining a preset operation; and controlling the fluid material to be sprayed in the virtual scene according to the preset operation, and outputting a spraying picture. Through the technical scheme, the fluid material is controlled to be sprayed according to the preset operation, so that the fluid material and the depth grid can be fused, the spraying content in the spraying picture is attached to the surface of an object, and the spraying effect in the AR scene is effectively improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application;

fig. 2 is a communication network system architecture diagram according to an embodiment of the present application;

FIG. 3 is a schematic flow diagram of a spray coating method according to a first embodiment;

FIG. 4 is a schematic flow diagram of a spray coating method according to a second embodiment;

FIG. 5 is a schematic flow diagram of a spray coating method according to a third embodiment;

FIG. 6 is a schematic diagram illustrating the effect of spraying in an outdoor scene in the embodiment of the present application;

FIG. 7 is a schematic diagram illustrating the effect of spraying in an indoor scene in the embodiment of the present application;

FIG. 8 is a schematic flow chart of a spray coating method according to a fourth embodiment;

fig. 9 is a schematic flow chart of spraying in the embodiment of the present application.

The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings. With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, or apparatus that comprises the element, and further, where similarly-named elements, features, or elements in different embodiments of the disclosure may have the same meaning, or may have different meanings, that particular meaning should be determined by their interpretation in the embodiment or further by context with the embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or," "and/or," "including at least one of the following," and the like, as used herein, are to be construed as inclusive or mean any one or any combination. For example, "includes at least one of: A. b, C "means" any of the following: a; b; c; a and B; a and C; b and C; a and B and C ", again for example," A, B or C "or" A, B and/or C "means" any of the following: a; b; c; a and B; a and C; b and C; a and B and C'. An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.

It should be noted that step numbers such as S10 and S20 are used herein for the purpose of more clearly and briefly describing the corresponding contents, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S20 first and then perform S10 in the specific implementation, which should be within the scope of the present application.

It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for the convenience of description of the present application, and have no specific meaning in themselves. Thus, "module", "component" or "unit" may be used mixedly.

The smart terminal may be implemented in various forms. For example, the smart terminal described in the present application may include smart terminals such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and fixed terminals such as a Digital TV, a desktop computer, and the like.

While the following description will be given by way of example of a smart terminal, those skilled in the art will appreciate that the configuration according to the embodiments of the present application can be applied to a fixed type terminal in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of an intelligent terminal for implementing various embodiments of the present application, the intelligent terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the intelligent terminal architecture shown in fig. 1 does not constitute a limitation of the intelligent terminal, and that the intelligent terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.

The following specifically introduces each component of the intelligent terminal with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex-Long Term Evolution), TDD-LTE (Time Division duplex-Long Term Evolution, Time Division Long Term Evolution), 5G, and so on.

WiFi belongs to short-distance wireless transmission technology, and the intelligent terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the smart terminal, and can be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the smart terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the smart terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor, the ambient light sensor may adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1061 and/or the backlight when the smart terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the intelligent terminal. Alternatively, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, can collect touch operations of a user (e.g., operations of a user on the touch panel 1071 or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory) thereon or nearby and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Optionally, the touch detection device detects a touch orientation of a user, detects a signal caused by a touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Optionally, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited thereto.

Alternatively, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the smart terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the smart terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the smart terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the smart terminal 100 or may be used to transmit data between the smart terminal 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a program storage area and a data storage area, and optionally, the program storage area may store an operating system, an application program (such as a sound playing function, an image playing function, and the like) required by at least one function, and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the intelligent terminal, connects various parts of the entire intelligent terminal using various interfaces and lines, and performs various functions of the intelligent terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the intelligent terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, optionally, the application processor mainly handles operating systems, user interfaces, application programs, etc., and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The intelligent terminal 100 may further include a power supply 111 (such as a battery) for supplying power to each component, and preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

Although not shown in fig. 1, the smart terminal 100 may further include a bluetooth module or the like, which is not described herein.

In order to facilitate understanding of the embodiments of the present application, a communication network system on which the intelligent terminal of the present application is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present disclosure, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Optionally, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Alternatively, the eNodeB2021 may be connected with other enodebs 2022 through a backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. Optionally, the MME2031 is a control node that handles signaling between the UE201 and the EPC203, providing bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present application is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems (e.g. 5G), and the like.

Based on the above intelligent terminal hardware structure and communication network system, various embodiments of the present application are provided.

First embodiment

In the first embodiment of the spraying method, the spraying method of the application may use an intelligent terminal as an execution subject, and the intelligent terminal may use a smart phone as an example. Referring to fig. 3, fig. 3 is a schematic flow diagram of a spray coating method according to a first embodiment, the spray coating method including the steps of:

s10, acquiring preset operation;

in this embodiment, after the AR application in the smartphone is started, the user may obtain the preset operation from the AR application in a manner of voice information, gesture information, touch information, and the like, which is not specifically limited in this embodiment. In order to clearly illustrate the technical solution of the present embodiment, the present embodiment will be described by taking an example in which a user clicks a screen to generate touch information.

Optionally, the preset operation may be analyzed after the preset operation of the user is obtained, so as to determine or generate information such as material, color, and effect of the fluid material used for spraying, and determine or generate spraying parameter information for spraying, and different spraying parameters may obtain different spraying effects, for example, spraying effects such as mist, smoke, ink and the like are simulated, so as to meet different needs of the user.

In this embodiment, optionally, the pre-calculated Depth information refers to Depth information of each point in a current AR picture frame determined or calculated, and the spraying is performed based on the Depth information of each picture point, so that the spraying content and an object in an AR scene can be fused and interacted, thereby generating a vivid spraying effect.

Optionally, in the spraying process, the Depth information may be input into the relevant script as an input parameter, a spray gun or a spray barrel or the like is adopted to spray the fluid material, and the spraying content is fused with the Depth mesh by the vertex shader. Optionally, related anchor point information, spraying point information, material information and the like can be stored in the spraying process, and the material is attached to the AR space by using the region depth information, so that a spraying effect of attaching a curved surface can be formed, and a spraying picture can be obtained.

In the embodiment, the preset operation is acquired; and controlling the fluid material to be sprayed in the virtual scene according to the preset operation, and outputting a spraying picture. Through the technical scheme, the fluid material is controlled to be sprayed according to the preset operation, so that the fluid material and the depth grid can be fused, the spraying content in the spraying picture is attached to the surface of an object, and the spraying effect in the AR scene is effectively improved.

Second embodiment

With reference to fig. 4, fig. 4 shows a schematic flow chart of a spraying method according to a second embodiment, which, on the basis of the first embodiment of the present application, further comprises the following steps:

step S11: acquiring a current picture frame;

optionally, after starting the AR application of the intelligent terminal, it is necessary to first determine whether the current device supports the AR Depth function, and if the current device supports the AR Depth function, the AR frame may be read, so as to determine or calculate Depth information in the read frame, which specifically includes:

judging whether the terminal equipment supports depth information calculation;

Optionally, judging whether the current terminal device supports Depth information calculation, that is, whether the current terminal device supports an AR Depth function, and if the current device does not support the AR Depth function, determining or generating first prompt information for prompting the user that the current device does not support the Depth function; and/or if the current device supports the reading of the AR picture frame, the AR picture frame can be read, so that the current picture frame of the terminal device can be obtained for depth information determination or calculation and spraying.

Step S12: calculating or determining depth information of at least one picture point in the current picture frame.

Optionally, in this embodiment of the present application, depth information of all points in a picture of a current picture frame is calculated or determined, and in other embodiments, a part of feature points may be selected according to an actual situation to determine or calculate depth information. In addition, in order to improve system performance, in the embodiment of the present application, a mark point is selected for information storage, which specifically includes:

selecting a preset position point in the current picture frame;

Optionally, in the embodiment of the present application, a focus aperture (default screen center) in an AR picture frame picture is selected as a preset position point, and then the depth information of each picture point is cached with the preset position point as a mark point. The spraying process is often a dynamic adjustment process, so that each read picture frame can be cached by using the mark points, the depth information can be quickly called in the spraying process, the spraying effect can be adjusted, in the process, a user does not need to walk to the position of an object and then spray, the difficulty and the operation are reduced, the spraying process is more convenient and easy to use, and the requirement of the user for dynamically adjusting the spraying distance can be met.

According to the scheme, the AR picture frame is read, and then the depth information of each point in the picture frame is determined or calculated and cached, so that the depth information is called quickly in the spraying process, the depth information is used for spraying, the collision feedback collision effect of the Mesh grid is formed, and the AR effect is more real.

Third embodiment

On the basis of the first embodiment and the second embodiment of the present application, the present embodiment discloses a method for controlling a fluid material to spray in a virtual scene according to a preset operation, and outputting a spraying picture. Fig. 5 is a flowchart illustrating a method for controlling a fluid material to spray in a virtual scene according to a preset operation and outputting a spraying picture, referring to fig. 5, the method includes the following specific steps:

step S201, determining or generating spraying parameter information according to preset operation;

optionally, by analyzing the preset operation, information such as material, color, and effect of the fluid material used for spraying may be determined or generated to determine or generate spraying parameter information for spraying, and different spraying parameters may obtain different spraying effects, for example, spraying effects such as simulated fog, smoke, and ink may be obtained, so as to meet different needs of the user.

Step S202, forming a depth grid according to the depth information of the picture points of the picture frame;

optionally, after the Depth information of the current frame is determined or calculated, a Depth grid may be formed according to the Depth information of each picture point in the frame, and the formed grid is equivalent to an object in the AR space, so that the Depth grid may have a fusion effect with the fluid material sprayed from the spray gun or the spray tub.

Step S203, the fluid material is sprayed out according to the spraying parameter information, so that the fluid material is fused with the depth grid to obtain spraying points;

optionally, after determining or generating information such as material, color, effect, and the like, spraying parameter information can be obtained, Depth information is input into a relevant script as an input parameter, and a corresponding fluid material is sprayed out by a spray gun or a spray barrel or other appliances according to the spraying parameter information, so that the fluid material can simulate various complex spraying effects such as smoke, fog, ink and wash, chalk, oil paint, crayon, and the like. Alternatively, after the fluid material is sprayed out, the fluid material generates an interactive collision effect with a Depth grid of a similar space object, so that a plurality of spraying points are generated. Referring to fig. 6 and 7, fig. 6 is a schematic diagram illustrating an effect of performing spraying in an outdoor scene in the embodiment of the present application, and fig. 7 is a schematic diagram illustrating an effect of performing spraying in an indoor scene in the embodiment of the present application.

And step S204, determining or generating the spraying picture according to the spraying points.

Optionally, after the spraying material collides with the Depth grid interactively to generate a spraying point, a spraying effect is obtained preliminarily, in order to further improve the authenticity of the spraying effect, the spraying point may be attached to the picture frame, and the spraying picture is determined or generated by combining the anchor point information, which specifically includes:

Optionally, after the spraying material and the Depth mesh interactively collide to generate spraying points, Depth information corresponding to the picture points of each region in the picture can be used for being attached to the object in the AR space, so that a user can place the liquid coating or other materials on the curved object, and the materials are attached to the curved object more really along with the curved object.

Optionally, before determining or generating the painting picture, related anchor point information may be stored for making the painting picture more stable, including:

In this embodiment, it should be noted that the storage of the anchor point information is not limited to before or after the spraying, when it is recognized that the picture frame has high picture quality, the feature point may be selected from the picture as the anchor point to store the anchor point information, and when the spraying point information is obtained, the spraying point information may be added to the anchor point and stored to form a complete data structure, so that the obtained spraying picture is more stable.

According to the scheme, the spraying parameter information is determined or generated according to the preset operation; forming a depth grid according to the depth information of the picture points of the picture frame; spraying the fluid material according to the spraying parameter information, and fusing the fluid material with the depth grid to obtain spraying points; and determining or generating the spraying picture according to the spraying points. The corresponding spraying effect is obtained according to different preset operations, so that different requirements of users are met; can make spraying material and AR scene in the object produce mutual collision effect through the degree of depth information, make spraying content and space object laminate more simultaneously, the picture is more stable to improve the effect of AR spraying.

Fourth embodiment

Referring to fig. 8, fig. 8 is a schematic flow chart of a spraying method according to a fourth embodiment, and based on the first, second and third embodiments of the present application, the spraying method further includes the following steps:

step S01: identifying whether a screen of the terminal equipment is in a click state;

step S02: if the screen of the terminal equipment is in a click state, acquiring preset operation; and/or the presence of a gas in the gas,

step S03: if the screen of the terminal equipment is not in a click state, judging whether spraying is carried out in the virtual scene;

step S04: and if the spraying is performed, stopping the spraying.

Referring to fig. 9, fig. 9 is a schematic flow diagram of spraying in the embodiment of the present application, as shown in fig. 7, optionally, in this embodiment, when the AR application of the terminal device is in an operating process, whether the user needs to perform spraying may be determined by judging whether the screen is in a click state, and if the screen of the terminal device is in the click state, it indicates that the user needs to perform spraying, so that a preset operation may be obtained to perform spraying; if the screen is not in a clicking state, the user does not need to perform spraying at the moment, whether spraying is performed or not needs to be further judged, and if the spraying is performed, the spraying is stopped, so that the spraying process is controlled, and the requirements of the user are met.

In the embodiment, whether the screen of the terminal device is in a click state is identified; if the screen of the terminal equipment is in a click state, acquiring preset operation; if the screen of the terminal equipment is not in a click state, judging whether spraying is carried out in the virtual scene; and if the spraying is performed, stopping the spraying. Therefore, the spraying process is effectively controlled, and different spraying requirements of users are met.

The embodiment of the present application further provides an intelligent terminal, the intelligent terminal includes: a memory, a processor, a communication bus, and/or a spray program stored on the memory:

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is configured to execute the spraying program to implement the steps of the embodiments of the spraying method, which are not described herein again.

Embodiments of the present application also provide a computer-readable storage medium, which stores one or more programs, where the one or more programs are further executable by one or more processors for implementing the steps of the embodiments of the spraying method described above.

The specific implementation of the storage medium of the present application is substantially the same as that of the foregoing embodiments of the spraying method, and is not described herein again.

Embodiments of the present application also provide a computer program product, which includes computer program code, when the computer program code runs on a computer, the computer is caused to execute the method in the above various possible embodiments.

Embodiments of the present application further provide a chip, which includes a memory and a processor, where the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device in which the chip is installed executes the method in the above various possible embodiments.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The units in the device in the embodiment of the application can be merged, divided and deleted according to actual needs.

In the present application, the same or similar descriptions of terms, technical solutions and/or application scenarios will generally be described in detail only when they occur for the first time, and when they occur repeatedly later, they will not be repeated again for brevity, and in understanding the technical solutions and the like of the present application, reference may be made to the related detailed descriptions and the like before the same or similar descriptions of terms, technical solutions and/or application scenarios and the like which are not described in detail later.

In the present application, each embodiment is described with emphasis, and reference may be made to the description of other embodiments for parts that are not described or illustrated in any embodiment.

The technical features of the technical solution of the present application may be arbitrarily combined, and for brevity of description, all possible combinations of the technical features in the embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, the scope of the present application should be considered as being described in the present application.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, a controlled terminal, or a network device) to execute the method of each embodiment of the present application.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the embodiments of the present application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, memory Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.

Claims

1. A method of spraying, comprising the steps of:

s10: acquiring a preset operation;

2. The method of claim 1, wherein step S20 is preceded by:

acquiring a current picture frame;

3. The method of claim 2, wherein the step of obtaining the current picture frame further comprises, prior to:

judging whether the terminal equipment supports depth information calculation;

4. The method of claim 2, wherein the step of calculating or determining the depth information for at least one picture point in the current picture frame is followed by further comprising:

selecting a preset position point in the current picture frame;

5. The method according to any one of claims 1 to 4, wherein step S20 includes:

and determining or generating the spraying picture according to the spraying point.

6. The method of claim 5, wherein the step of determining or generating the painting view based on the painting points comprises:

7. The method of claim 6, wherein the step of determining or generating a painted picture based on the painted point information and anchor point information stored in advance further comprises:

8. The method according to any one of claims 1 to 4, wherein step S10 is preceded by:

identifying whether a screen of the terminal equipment is in a click state;

9. An intelligent terminal, characterized in that, intelligent terminal includes: memory, a processor, wherein the memory has stored thereon a spray program which when executed by the processor implements the steps of the spray coating method of any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that the storage medium has stored thereon a spray coating program which, when being executed by a processor, carries out the steps of the spray coating method according to one of claims 1 to 8.