CN111416971B - Control method, control system, electronic device and readable storage medium - Google Patents
Control method, control system, electronic device and readable storage medium Download PDFInfo
- Publication number
- CN111416971B CN111416971B CN202010239691.6A CN202010239691A CN111416971B CN 111416971 B CN111416971 B CN 111416971B CN 202010239691 A CN202010239691 A CN 202010239691A CN 111416971 B CN111416971 B CN 111416971B
- Authority
- CN
- China
- Prior art keywords
- image
- electronic device
- special effect
- effect request
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/15—Processing image signals for colour aspects of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/167—Synchronising or controlling image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a control method, a control system, electronic equipment and a readable storage medium, wherein when the control method is applied to first electronic equipment, the control method comprises the following steps: acquiring parameter information of an Augmented Reality (AR) image under the condition of displaying the AR image; and sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute special effect response. The technical scheme provided by the invention solves the problem that the existing electronic equipment can feel the special effect of the AR image only when the user stares at the screen of the electronic equipment or is close to the electronic equipment, so that the user experience effect is poor.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a control method, a control system, an electronic device, and a readable storage medium.
Background
An Augmented Reality (AR) technology is a new internet technology developed on the basis of a virtual Reality technology, and as better sensory experience can be brought to users, more and more internet AR applications based on image recognition begin to emerge, such as a shooting application and a video playing application capable of realizing AR image display. At present, AR applications mostly implement AR images by means of displaying bright color contrast and dynamic effects in a screen of an electronic device or playing special-effect related background sounds through the electronic device, and users need to stare at the screen of the electronic device or feel special effects of the AR images only when the users are close to the electronic device, which results in poor user experience effects.
Disclosure of Invention
Embodiments of the present invention provide a control method, a control system, an electronic device, and a readable storage medium, so as to solve a problem of poor user experience effect caused by that a user needs to stare at a screen of the electronic device or feel a special effect of an AR image only near the electronic device in an existing electronic device.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a control method, which is applied to a first electronic device, and the method includes:
acquiring parameter information of an Augmented Reality (AR) image under the condition of displaying the AR image;
and sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute special effect response.
Optionally, before the obtaining of the parameter information of the AR image, the method further includes:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
Optionally, the determining that the change of the color value of the display interface exceeds a preset value includes:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
Optionally, before the obtaining of the parameter information of the AR image, the method further includes:
acquiring a first target area in a first image frame and a second target area corresponding to the first target area in a second image frame in a display interface;
determining that the color value change of the second target area and the first target area exceeds a preset value.
Optionally, the acquiring parameter information of the AR image includes:
acquiring at least one item of image size, image color and image type of the AR image and sound information matched with the AR image;
in a case that the second electronic device is a lighting device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic device to control the second electronic device to execute lighting response according to the lighting parameter;
in a case that the second electronic device is an audio playing device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
and determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameter.
In a second aspect, an embodiment of the present invention further provides a control method, which is applied to a second electronic device, where the method includes:
receiving a special effect request sent by first electronic equipment; the special effect request is generated based on parameter information of an Augmented Reality (AR) image when the first electronic device displays the AR image;
in response to the special effect request, a special effect response is executed.
Optionally, the second electronic device is a lighting device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, acquiring a light parameter contained in the special effect request, and executing light response based on the light parameter;
or, the second electronic device is an audio playing device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
In a third aspect, an embodiment of the present invention further provides a control system, where the control system includes a first electronic device and a second electronic device, where the first electronic device is configured to execute the steps of the control method according to any one of the first aspect, and the second electronic device is configured to execute the steps of the control method according to any one of the second aspect.
In a fourth aspect, an embodiment of the present invention further provides an electronic device, including a processor, a memory, and a computer program stored on the memory and being executable on the processor, where the computer program, when executed by the processor, implements the steps of the control method according to any one of the first aspect, or the computer program, when executed by the processor, implements the steps of the control method according to any one of the second aspect.
In a fifth aspect, the present invention also provides a readable storage medium, on which a computer program is stored, the computer program, when being executed by a processor, implementing the steps of the control method according to any one of the first aspect, or the computer program, when being executed by the processor, implementing the steps of the control method according to any one of the second aspect.
In the embodiment of the invention, under the condition that the AR image is displayed, the first electronic device sends the special effect request to the second electronic device based on the parameter information after acquiring the parameter information of the AR image, so that the second electronic device can execute the special effect response after receiving the special effect request. Like this, also make first electronic equipment when showing the AR image, can also link the second electronic equipment and carry out the special effect response, further render the sensory experience of AR image, need not the user and stares at the electronic equipment screen or can feel the special effect of AR image near from electronic equipment, build more immersive experience for the user, promoted electronic equipment's user and used experience.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.
Fig. 1 is a flowchart of a control method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another control method provided by an embodiment of the present invention;
FIG. 3 is a block diagram of an electronic device according to an embodiment of the present invention;
FIG. 4 is a block diagram of another electronic device provided by an embodiment of the invention;
FIG. 5 is a block diagram of a control system provided by an embodiment of the present invention;
fig. 6 is a block diagram of another electronic device provided in an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a control method according to an embodiment of the present invention, where the control method is applied to a first electronic device. As shown in fig. 1, the control method includes the steps of:
It should be noted that, in this embodiment, the first electronic device and the second electronic device are not limited to be used specifically, the first electronic device may also be a second electronic device in other application scenarios, and the second electronic device may also be a first electronic device in other application scenarios. The first electronic device and the second electronic device can establish wireless connection or wired connection.
Understandably, augmented Reality (AR) technology is widely applied to electronic devices such as mobile phones, tablet computers, notebook computers and the like. The electronic equipment can display the AR image on a shooting interface, a video playing interface or a video chatting interface based on preset operation of a user when executing application functions such as shooting, video playing, video chatting and the like, so that the user has better sensory experience.
In this embodiment, the first electronic device acquires parameter information of the AR image when displaying the AR image. Optionally, the parameter information may refer to an image size, an image color, display brightness, a dynamic frequency, and sound information corresponding to the AR image of the AR image.
Optionally, the acquiring the parameter information of the AR image may further include:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
In this embodiment, the first electronic device and the second electronic device may be wirelessly connected via bluetooth, WIFI, 3G, 4G, 5G, or the like.
In one embodiment, when a first electronic device and a second electronic device establish wireless connection, a change of a color value of a display interface of the first electronic device is obtained in real time, if the change of the color value of the display interface exceeds a preset value, it is determined that the first electronic device displays an AR image, and at this time, the first electronic device obtains parameter information of the AR image.
Or, in another embodiment, when the first electronic device establishes wireless connection with the second electronic device and the display interface of the first electronic device displays the AR image, a change in a color value of the display interface is obtained in real time, and if the change in the color value of the display interface exceeds a preset value, the parameter information of the AR image is obtained. In this case, the change in the color value of the display interface is due to a change in a display parameter of the AR image, for example, a change in the display color of the AR image.
It should be noted that the color value of the display interface may refer to the pixel value and the distribution ratio of all the pixels in the display interface, or may refer to the average pixel value of the display interface. For example, when the electronic device starts a shooting application, the electronic device displays a shooting interface, and when a preset operation of a user is received, an AR image may be displayed on the shooting interface. It can be understood that before displaying the AR image and after displaying the AR image, the color value in the shooting interface may change, or the change of the display parameter of the AR image may also cause the color value in the shooting interface to change, and then by determining whether the change of the color value of the shooting interface exceeds a preset value, it may be determined whether to acquire the parameter information of the AR image.
Specifically, the determining that the change of the color value of the display interface exceeds a preset value includes:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
It is understood that the electronic device is displayed in the form of an image frame in the case of a shooting scene, a video playing scene, or a video chat scene. The first electronic device may determine whether a change in color values is greater than a preset value by comparing color values of two previous and subsequent image frames, so as to determine when to acquire the parameter information of the AR image.
For example, taking a shooting scene as an example, when a first electronic device starts a shooting application program and displays a shooting interface (or referred to as a preview interface), the first-end electronic device can acquire, in real time, image frames forming the shooting interface and compare color values of two adjacent front and back image frames, that is, acquire a first color value corresponding to a first image frame and a second color value corresponding to a second image frame, so as to determine whether a difference value between the first color value and the second color value is greater than a preset value.
For example, even if the user moves the first electronic device, there is a certain continuity of the color values of the shooting interface, that is, the color values show smooth transition, the color values of the two previous and next image frames change within a certain range, and the difference between the first color value and the second color value is smaller than the preset value, so that it may be determined that the AR image is not displayed in the shooting interface. If the AR image appears suddenly in the shooting interface, the color values of a second image frame of the AR image and a first image frame of a previous frame are greatly different, the difference value between a first color value corresponding to the first image frame and a second color value corresponding to the second image frame is larger than a preset value, and then the first electronic device can determine that the AR image is displayed in the shooting interface, and then the parameter information of the AR image is obtained.
Or, in the case that the first electronic device displays the AR image, if the display color of the AR image changes, the color values of the second image frame, in which the display color changes just start, and the first image frame of the previous frame may be different, and if the difference between the first color value corresponding to the first image frame and the second color value corresponding to the second image frame is greater than the preset value, the parameter information of the AR image is obtained.
Therefore, the first electronic device determines whether to acquire the parameter information of the AR image or not by acquiring the color values of the front and rear image frames of the display interface in real time and comparing the difference value of the color values of the front and rear image frames, so that the first electronic device can acquire the parameter information of the AR image in time under the condition of displaying the AR image.
Optionally, the obtaining of the parameter information of the AR image may further include:
acquiring a first target area in a first image frame in a display interface and a second target area corresponding to the first target area in a second image frame;
determining that the color value change of the second target area and the first target area exceeds a preset value.
In this embodiment, when the color value changes of the first image frame and the second image frame exceed the preset value, the color value of each area in the first image frame and the second image frame may be compared to determine the target area with the color value change exceeding the preset value. Wherein the first image frame and the second image frame are two adjacent image frames.
Specifically, a first image frame is divided into a plurality of areas, a second image frame is also divided into a plurality of areas with the same number and size, the areas of the first image frame are compared with the areas corresponding to the second image frame one by one, when the color value change of a second target area of the second image frame and a first target area of the first image frame exceeds a preset value, the second target area is determined to be an AR image, and parameter information of the AR image is acquired. Therefore, when the AR image is displayed in the display interface of the first electronic device, the AR image in the display interface is defined, so that the parameter information of the AR image can be accurately acquired.
Or, in the case that the AR image is already displayed and determined, color value changes of a first target area in the first image frame and a corresponding second target area in the second image frame are compared, in this case, both the first target area and the second target area represent the AR image, and if the color value changes of the second target area and the first target area exceed a preset value, which indicates that parameter information of the AR image changes when the second image frame is displayed, the parameter information of the AR image is acquired, that is, the parameter information of the second target area is acquired.
Optionally, the special effect response may include at least one of a sound response and a light response.
It should be noted that the second electronic device may be an electronic device having a lighting function and/or an audio playing function, such as an intelligent lamp, a sound device, a mobile phone, and the like.
In this embodiment, the first electronic device sends a special effect request to the second electronic device based on the parameter information after acquiring the parameter information of the AR image and displaying the AR image, so that the second electronic device responds to the special effect request and executes a sound response and/or a light response after receiving the special effect request. Like this, also make first electronic equipment when showing the AR image, can also link the second electronic equipment and carry out special effect response, carry out light and/or sound response through the second electronic equipment, further render the visual experience and the sense of hearing of AR image and experience, need not that the user stares at the electronic equipment screen or can feel the special effect of AR image near apart from electronic equipment, build the seeing and hearing impression of more being personally on the scene for the user, promoted electronic equipment's user and used experience.
Specifically, the acquiring parameter information of the AR image includes:
and acquiring at least one item of image size, image color, image type and sound information matched with the AR image of the AR image.
For example, the first electronic device may acquire an image size and an image color of the AR image and sound information corresponding to the AR image when displaying the AR image, and may be capable of generating a corresponding special effect request based on the parameter information.
Optionally, in an implementation manner of this embodiment, the second electronic device is a lighting device, such as an intelligent light fixture, and the step 102 may include:
and determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic equipment so as to control the second electronic equipment to execute lighting response according to the lighting parameter.
It should be noted that, the first electronic device may be pre-established with a mapping relationship between an image size of the AR image and the light parameter, and/or a mapping relationship between an image color of the AR image and the light parameter. Optionally, the light parameters include light brightness and light color.
For example, the light brightness may be four levels, i.e., strongest, stronger, weaker, and weaker, when the image size of the AR image is greater than 50% of the display interface area, the corresponding light brightness is strongest, when the image size of the AR image is 30-50% of the display interface area, the corresponding light brightness is stronger, when the image size of the AR image is 10-30% of the display interface area, the corresponding light brightness is weaker, and when the image size of the AR image is less than 10% of the display interface area, the corresponding light brightness is weaker.
Optionally, the light color may include cool light and warm light, when the image color of the AR image is cool tone, the corresponding light color is cool light, and when the image color of the AR image is warm tone, the corresponding light color is warm light.
The image type of the AR image may refer to image content of the AR image, for example, when the image type is blue sky, white cloud, or sun, the corresponding light color is warm light, and the corresponding light intensity is strongest; when the image types are black cloud, rain water and moon, the corresponding light color is cold light, and the corresponding light intensity is weak. Of course, the image type, the corresponding light color and the light intensity may have other embodiments, which are not described herein.
It should be noted that, after the first electronic device is connected to the lighting device, the lighting parameters of the lighting device can be acquired, so as to determine the lighting parameters that the lighting device can respond to, and establish a mapping relationship between at least one of an image size, an image color, and an image type of the AR image and the lighting parameters.
In this embodiment, under the condition that the first electronic device is connected to the lighting device, if the first electronic device displays an AR image, at least one of an image size, an image color, and an image type of the AR image is obtained to determine a corresponding lighting parameter, for example, determine a lighting brightness and a lighting color, and send a special effect request including the lighting brightness and the lighting color to the lighting device, so that the lighting device can perform a lighting response after receiving the special effect request, that is, adjust lighting to the lighting brightness and the lighting color. Therefore, when the first electronic device displays the AR image, the lighting device connected with the first electronic device can be controlled to adjust to the corresponding lamplight brightness and lamplight color according to the parameter information of the AR image, so that the surrounding environment of the user can be matched with the AR image, the special effect of the AR image can be felt without the user staring at the screen of the electronic device or being close to the electronic device, the user experience is further enhanced, and the user experience is further enhanced.
Optionally, in another implementation manner of this embodiment, the second electronic device is an audio playing device, such as a sound, and the step 102 may include:
and determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameter.
It can be understood that, after the first electronic device establishes connection with the audio playing device, the first electronic device can acquire relevant parameters of the audio playing device, so as to determine audio playing parameters that the audio playing device can respond to, and establish a mapping relationship between sound information corresponding to the AR image and the audio playing parameters.
Optionally, the audio playing parameters may include volume and sound effects. For example, when the image type of the AR image is petal dancing, leaf falling, etc., the corresponding sound effect is wind sound; when the image type of the AR image is lightning, black cloud and the like, the corresponding sound effect is thunder; and so on.
The image size of the AR image may have a mapping relationship with the volume size, for example, the volume size may be divided into three levels, i.e., 3 level, 2 level, and 1 level, in order from large to small, when the image size of the AR image is greater than 50% of the area of the display interface, the corresponding volume size is 3 level, when the image size of the AR image is 10-50% of the area of the display interface, the corresponding volume size is 2 level, and when the image size of the AR image is less than 10% of the area of the display interface, the corresponding volume size is 1 level.
Understandably, the first electronic device may also play the matched sound information when displaying the AR image; for example, when the sound information matched with the AR image has the maximum volume, the corresponding volume level is 3 th gear, and when the sound information matched with the AR image has the minimum volume, the corresponding volume level is 1 st gear. Of course, there may be other embodiments for the sound information matched with the AR image and the corresponding audio playing parameter, which are not described herein again.
In this embodiment, under the condition that the first electronic device is connected to the audio playing device, if the first electronic device displays an AR image, at least one of an image size, an image type, and matched sound information of the AR image is acquired to determine a corresponding audio playing parameter, for example, a volume size and a sound effect, and a special effect request including the volume size and the sound effect is sent to the audio playing device, so that the audio playing device can respond, that is, adjust to the corresponding volume size and/or sound effect, after receiving the special effect request. Like this, first electronic equipment can come control audio playback equipment who connects rather than adjusting to corresponding volume size and/or audio according to the parameter information of AR image when showing the AR image for user's surrounding environment can cooperate with the AR image, has further strengthened the sense of hearing experience of user when watching the AR image, builds more immersive impression for the user.
It should be noted that the second electronic device may also be a device capable of responding to both the light parameter and the audio playing parameter, and then the first electronic device may send the special effect request including the light parameter and the audio playing parameter to the second electronic device, so that the second electronic device executes the light response and the audio playing at the same time, thereby further enhancing the visual and auditory experiences of the user when watching the AR image, and bringing better audio-visual experience to the user.
Referring to fig. 2, fig. 2 is a flowchart of another control method according to an embodiment of the present invention, where the control method is applied to a second electronic device. As shown in fig. 2, the control method includes the steps of:
In this embodiment, the second electronic device may be an electronic device having a lighting function and/or an audio playing function, such as an intelligent lamp, a sound device, a mobile phone, and the like.
The second electronic device may be capable of establishing a wireless connection or a wired connection with the first electronic device and receiving the special effect request sent by the first electronic device. In a case where the first electronic device displays an AR image, reference may be made to the description in the embodiment of fig. 1 for a specific implementation manner of generating a special effect request based on parameter information of the AR image, and in order to avoid repetition, this embodiment is not described again.
Optionally, the special effect response may include at least one of a sound response and a light response.
In the embodiment of the present invention, after receiving the special effect request sent by the first electronic device, the second electronic device responds to the special effect request, for example, executes a voice response and/or a light response. Therefore, when the first electronic device displays the AR image, the second electronic device can perform sound response and/or light response based on the parameter information of the AR image, the user can feel the special effect of the AR image without staring at the screen of the electronic device or being close to the first electronic device, the visual experience and the auditory experience of the user are further enhanced, and the audio-visual experience of the user is more personally on the scene is created for the user.
Optionally, in an implementation manner of this embodiment, the second electronic device is a lighting device, and the step 202 includes:
responding to the special effect request, obtaining the lighting parameters contained in the special effect request, and executing lighting response based on the lighting parameters.
Optionally, the light parameter may include a light brightness and/or a light color. The lighting brightness and/or the lighting color may be determined based on the parameter information of the AR image, and the specific determination manner may be described in the embodiment described with reference to fig. 1, which is not described in detail in this embodiment.
Understandably, lighting apparatus is establishing the back with first electronic equipment and being connected, receives the special effect request that first electronic equipment sent, and obtains the light parameter that contains in the special effect request, and then based on light parameter regulation light luminance and/or light colour to make lighting apparatus's light luminance and/or light colour cooperate with the AR image that shows on the first electronic equipment, build the experience of being more personally on the scene for the user, further strengthen user's visual experience.
In another implementation manner of this embodiment, the second electronic device is an audio playing device, and the step 202 includes:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
Optionally, the audio playing parameter may include a volume and/or a sound effect, the volume and/or the sound effect may be determined based on the parameter information of the AR image, and the specific determination manner may be the description in the embodiment described with reference to fig. 1, which is not described in detail in this embodiment.
In this embodiment, audio playback equipment is establishing the back of being connected with first electronic equipment, receives the special effect request that first electronic equipment sent, and obtains the audio playback parameter that contains in the special effect request, and then based on volume of adjusting and/or audio is played to audio playback parameter to make audio playback equipment's audio playback parameter can cooperate with the AR image that shows on the first electronic equipment, build the experience of being more personally on the scene for the user, further strengthen user's sense of hearing and experience.
Referring to fig. 3, fig. 3 is a structural diagram of an electronic device according to an embodiment of the present invention, where the electronic device is a first electronic device. As shown in fig. 3, the electronic device 300 includes:
an obtaining module 301, configured to obtain parameter information of an Augmented Reality (AR) image when the AR image is displayed;
a control module 302, configured to send a special effect request to a second electronic device based on the parameter information, so as to control the second electronic device to respond to the special effect request and execute a special effect response.
Optionally, the electronic device 300 further includes:
and the first determining module is used for determining that the change of the color value of the display interface exceeds a preset value under the condition of establishing connection with the second electronic equipment.
Optionally, the first determining module is further configured to:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
Optionally, the electronic device 300 further includes a second determining module, where the second determining module is configured to:
acquiring a first target area in a first image frame and a second target area corresponding to the first target area in a second image frame in a display interface;
determining that the color value change of the second target area and the first target area exceeds a preset value.
Optionally, the obtaining module 301 is further configured to:
acquiring at least one of the image size, the image color and the image type of the AR image and the sound information matched with the AR image;
in the case that the second electronic device is a lighting device, the control module 302 is further configured to:
determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic device to control the second electronic device to execute lighting response according to the lighting parameter;
in a case that the second electronic device is an audio playing device, the control module 302 is further configured to:
and determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameter.
It should be noted that the electronic device 300 can implement each process of the control method embodiment described in fig. 1, and can achieve the same technical effect, and for avoiding repetition, the details are not described here again. The electronic equipment 300 that this embodiment provided can also link the second electronic equipment and carry out special effect response when showing the AR image, for example carry out light and/or sound response through the second electronic equipment, further render the visual experience and the sense of hearing of AR image, for the user builds the audiovisual experience of more being personally on the scene, has promoted electronic equipment 300's user and has used experience.
Referring to fig. 4, fig. 4 is a structural diagram of another electronic device according to an embodiment of the present invention, where the electronic device is a second electronic device. As shown in fig. 4, the electronic device 400 includes:
a receiving module 401, configured to receive a special effect request sent by a first electronic device; the special effect request is generated based on parameter information of an Augmented Reality (AR) image when the first electronic device displays the AR image;
a response module 402, configured to execute a special effect response in response to the special effect request.
Optionally, the electronic device 400 is a lighting device, and the response module 402 is further configured to:
responding to the special effect request, acquiring a light parameter contained in the special effect request, and executing light response based on the light parameter;
alternatively, the electronic device 400 is an audio playing device, and the response module 402 is further configured to:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
It should be noted that, the electronic device 400 can implement each process of the control method embodiment described in fig. 2, and can achieve the same technical effect, and for avoiding repetition, details are not repeated here. The electronic device 400 provided by this embodiment can perform special effect response, such as sound response and/or light response, based on the parameter information of the AR image when the first electronic device displays the AR image, so as to further enhance the visual experience and the auditory experience of the user when watching the AR image, and create a more immersive audiovisual experience for the user.
Referring to fig. 5, fig. 5 is a structural diagram of a control system according to an embodiment of the present invention, as shown in fig. 5, the control system 500 includes a first electronic device 501 and a second electronic device 502, where the first electronic device 501 is configured to perform the following steps:
acquiring parameter information of an Augmented Reality (AR) image under the condition of displaying the AR image;
and sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute special effect response.
Optionally, before the parameter information of the AR image is obtained, the first electronic device 501 is further configured to perform the following steps:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
Optionally, the determining that the change of the color value of the display interface exceeds a preset value includes:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
Optionally, before the parameter information of the AR image is obtained, the first electronic device 501 is further configured to perform the following steps:
acquiring a first target area in a first image frame and a second target area corresponding to the first target area in a second image frame in a display interface;
determining that the color value change of the second target area and the first target area exceeds a preset value.
Optionally, the acquiring parameter information of the AR image includes:
acquiring at least one item of image size, image color and image type of the AR image and sound information matched with the AR image;
in a case that the second electronic device is a lighting device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic device to control the second electronic device to execute lighting response according to the lighting parameter;
in a case that the second electronic device is an audio playing device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
and determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameter.
It should be noted that, the first electronic device 501 can execute all the technical features of the control method embodiment described in fig. 1, and the implementation principle and the technical effect are similar, and this embodiment is not described herein again.
In this embodiment, the second electronic device 502 is configured to execute the following steps:
receiving a special effect request sent by first electronic equipment; the special effect request is generated based on parameter information of an Augmented Reality (AR) image under the condition that the AR image is displayed by the first electronic device;
in response to the special effect request, a special effect response is executed.
Optionally, the second electronic device 502 is a lighting device, and the executing a special effect response in response to the special effect request includes:
and responding to the special effect request, acquiring the lighting parameters contained in the special effect request, and executing lighting response based on the lighting parameters.
Optionally, the second electronic device 502 is an audio playing device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
It should be noted that the second electronic device 502 can perform all the technical features of the control method embodiment described in fig. 2, and the implementation principle and the technical effect are similar, which is not described herein again.
Referring to fig. 6, fig. 6 is a structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 6, the terminal includes: a processor 600 for reading the program in the memory 620.
A transceiver 610 for receiving and transmitting data under the control of the processor 600.
Where in fig. 6, the bus architecture may include any number of interconnected buses and bridges, with various circuits being linked together, particularly one or more processors represented by processor 600 and memory represented by memory 620. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface. The transceiver 610 may be a number of elements including a transmitter and a transceiver providing a means for communicating with various other apparatus over a transmission medium. The processor 600 is responsible for managing the bus architecture and general processing, and the memory 620 may store data used by the processor 600 in performing operations.
In one embodiment, the electronic device is a first electronic device, and the processor 600 is configured to read a program stored in the memory 620 and execute the following steps:
acquiring parameter information of an Augmented Reality (AR) image under the condition of displaying the AR image;
and sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute special effect response.
Optionally, the processor 600 is further configured to read the program in the memory 620, and perform the following steps:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
Optionally, the processor 600 is further configured to read the program in the memory 620, and execute the following steps:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
Optionally, the processor 600 is further configured to read the program in the memory 620, and execute the following steps:
acquiring a first target area in a first image frame in a display interface and a second target area corresponding to the first target area in a second image frame;
determining that the color value change of the second target area and the first target area exceeds a preset value.
Optionally, the processor 600 is further configured to read the program in the memory 620, and perform the following steps:
acquiring at least one item of image size, image color and image type of the AR image and sound information matched with the AR image;
under the condition that the second electronic equipment is lighting equipment, determining corresponding lighting parameters according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameters to the second electronic equipment so as to control the second electronic equipment to execute lighting response according to the lighting parameters;
and under the condition that the second electronic equipment is audio playing equipment, determining corresponding audio playing parameters according to at least one item of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameters to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameters.
In this embodiment, the electronic device is capable of implementing all technical features of the control method embodiment described in fig. 1, and the implementation principle and technical effects are similar, which are not described herein again.
In another embodiment, the electronic device is a second electronic device, and the processor 600 is configured to read a program in the memory 620 and perform the following steps:
receiving a special effect request sent by first electronic equipment; the special effect request is generated based on parameter information of an Augmented Reality (AR) image when the first electronic device displays the AR image;
in response to the special effect request, a special effect response is executed.
Optionally, the second electronic device is a lighting device, and the processor 600 is further configured to read a program in the memory 620, and perform the following steps:
and responding to the special effect request, acquiring the lighting parameters contained in the special effect request, and executing lighting response based on the lighting parameters.
Optionally, the second electronic device is an audio playing device, and the processor 600 is further configured to read a program in the memory 620, and execute the following steps:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
In this embodiment, the electronic device is capable of implementing all technical features of the embodiment of the control method described in fig. 2, and the implementation principle and technical effects are similar, which are not described herein again.
The embodiment of the invention also provides a readable storage medium, and the readable storage medium is stored with a computer program.
In one embodiment, the computer program is applied to a first electronic device, and when executed by a processor, the computer program implements the following steps:
acquiring parameter information of an Augmented Reality (AR) image under the condition of displaying the AR image;
and sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute special effect response.
Optionally, the computer program, when executed by the processor, further implements the steps of:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
Optionally, the determining that the change of the color value of the display interface exceeds a preset value includes:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
Optionally, the computer program, when executed by the processor, further implements the steps of:
acquiring a first target area in a first image frame in a display interface and a second target area corresponding to the first target area in a second image frame;
determining that the color value change of the second target area and the first target area exceeds a preset value.
Optionally, the acquiring parameter information of the AR image includes:
acquiring at least one of the image size, the image color and the image type of the AR image and the sound information matched with the AR image;
in a case that the second electronic device is a lighting device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic device to control the second electronic device to execute lighting response according to the lighting parameter;
in a case that the second electronic device is an audio playing device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
and determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic equipment so as to control the second electronic equipment to execute audio playing according to the audio playing parameter.
In this embodiment, the readable storage medium can perform all the technical features of the control method embodiment described in fig. 1, and the implementation principle and the technical effect are similar, which are not described herein again.
In another embodiment, the computer program is applied to a second electronic device, and when executed by a processor, the computer program implements the steps of:
receiving a special effect request sent by first electronic equipment; the special effect request is generated based on parameter information of an Augmented Reality (AR) image under the condition that the AR image is displayed by the first electronic device;
in response to the special effect request, a special effect response is executed.
Optionally, the second electronic device is a lighting device, and the executing a special effect response in response to the special effect request includes:
and responding to the special effect request, acquiring the lighting parameters contained in the special effect request, and executing lighting response based on the lighting parameters.
Optionally, the second electronic device is an audio playing device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, obtaining audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters.
In this embodiment, the readable storage medium can perform all the technical features of the control method embodiment described in fig. 2, which implement the principle and the technical effect similar to each other, and this embodiment is not described herein again.
The readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one of 8230, and" comprising 8230does not exclude the presence of additional like elements in a process, method, article, or apparatus comprising the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (7)
1. A control method applied to a first electronic device is characterized by comprising the following steps: acquiring parameter information of an AR image under the condition of displaying an Augmented Reality (AR) image, wherein the parameter information comprises the image size of the AR image, and the parameter information further comprises at least two items of image color, image type and sound information matched with the AR image of the AR image;
sending a special effect request to second electronic equipment based on the parameter information so as to control the second electronic equipment to respond to the special effect request and execute a special effect response;
in a case that the second electronic device is a lighting device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
determining a corresponding lighting parameter according to at least one of the image size, the image color and the image type of the AR image, and sending a special effect request containing the lighting parameter to the second electronic device to control the second electronic device to execute lighting response according to the lighting parameter; the light parameters comprise light brightness and/or light color;
in a case that the second electronic device is an audio playing device, the sending a special effect request to the second electronic device based on the parameter information to control the second electronic device to respond to the special effect request and execute a special effect response includes:
determining a corresponding audio playing parameter according to at least one of the image size and the image type of the AR image and the sound information matched with the AR image, and sending a special effect request containing the audio playing parameter to the second electronic device so as to control the second electronic device to execute audio playing according to the audio playing parameter; the audio playing parameters comprise volume and sound effect;
before the obtaining of the parameter information of the AR image, the method further includes:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
2. The method of claim 1, wherein determining that the change in the color value of the display interface exceeds a predetermined value comprises:
acquiring a first color value corresponding to a first image frame and a second color value corresponding to a second image frame in a display interface, wherein the first image frame and the second image frame are two adjacent image frames;
determining that a difference between the first color value and the second color value is greater than a preset value.
3. The method of claim 1, wherein before the obtaining the parameter information of the AR image, the method further comprises:
acquiring a first target area in a first image frame and a second target area corresponding to the first target area in a second image frame in a display interface;
determining that the color value change of the second target area and the first target area exceeds a preset value.
4. A control method is applied to a second electronic device, and is characterized by comprising the following steps:
receiving a special effect request sent by first electronic equipment; the special effect request is a request generated by the first electronic device based on parameter information of an AR image under the condition that the AR image is displayed, wherein the parameter information comprises the image size of the AR image, and the parameter information further comprises at least two items of image color, image type and sound information matched with the AR image;
in response to the special effect request, executing a special effect response;
the second electronic device is a lighting device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, acquiring a light parameter contained in the special effect request, and executing light response based on the light parameter; the light parameters comprise light brightness and/or light color;
or, the second electronic device is an audio playing device, and the executing a special effect response in response to the special effect request includes:
responding to the special effect request, acquiring audio playing parameters contained in the special effect request, and executing audio playing based on the audio playing parameters; the audio playing parameters comprise volume and sound effect;
the method further comprises the following steps:
and under the condition of establishing connection with the second electronic equipment, determining that the change of the color value of the display interface exceeds a preset value.
5. A control system comprising a first electronic device and a second electronic device, characterized in that the first electronic device is adapted to perform the steps of the control method according to any of claims 1-3, and the second electronic device is adapted to perform the steps of the control method according to claim 4.
6. An electronic device, comprising a processor, a memory and a computer program stored on the memory and being executable on the processor, the computer program, when being executed by the processor, realizing the steps of the control method according to any one of claims 1-3, or the computer program, when being executed by the processor, realizing the steps of the control method according to claim 4.
7. A readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the control method according to any one of claims 1-3, or which, when being executed by the processor, carries out the steps of the control method according to claim 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010239691.6A CN111416971B (en) | 2020-03-30 | 2020-03-30 | Control method, control system, electronic device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010239691.6A CN111416971B (en) | 2020-03-30 | 2020-03-30 | Control method, control system, electronic device and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111416971A CN111416971A (en) | 2020-07-14 |
| CN111416971B true CN111416971B (en) | 2022-11-15 |
Family
ID=71494641
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010239691.6A Active CN111416971B (en) | 2020-03-30 | 2020-03-30 | Control method, control system, electronic device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111416971B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN206194275U (en) * | 2016-09-21 | 2017-05-24 | 沃利科技（深圳）有限公司 | Sand table 3D multi -functional display system of AR |
| CN107169430A (en) * | 2017-05-02 | 2017-09-15 | 哈尔滨工业大学深圳研究生院 | Reading environment audio strengthening system and method based on image procossing semantic analysis |
| CN208239908U (en) * | 2018-05-29 | 2018-12-14 | 沃利科技（深圳）有限公司 | A kind of museum's augmented reality AR interactive system |
| CN110084674A (en) * | 2019-04-24 | 2019-08-02 | 浙江农业商贸职业学院 | A kind of real estate's sales AR interactive exhibition system |
| CN110286773A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技（深圳）有限公司 | Information providing method, device, equipment and storage medium based on augmented reality |
| CN110673900A (en) * | 2019-08-23 | 2020-01-10 | 康佳集团股份有限公司 | Light effect adjusting method, intelligent terminal and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109215413A (en) * | 2018-09-21 | 2019-01-15 | 福州职业技术学院 | A kind of mold design teaching method, system and mobile terminal based on mobile augmented reality |
-
2020
- 2020-03-30 CN CN202010239691.6A patent/CN111416971B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN206194275U (en) * | 2016-09-21 | 2017-05-24 | 沃利科技（深圳）有限公司 | Sand table 3D multi -functional display system of AR |
| CN107169430A (en) * | 2017-05-02 | 2017-09-15 | 哈尔滨工业大学深圳研究生院 | Reading environment audio strengthening system and method based on image procossing semantic analysis |
| CN208239908U (en) * | 2018-05-29 | 2018-12-14 | 沃利科技（深圳）有限公司 | A kind of museum's augmented reality AR interactive system |
| CN110084674A (en) * | 2019-04-24 | 2019-08-02 | 浙江农业商贸职业学院 | A kind of real estate's sales AR interactive exhibition system |
| CN110286773A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技（深圳）有限公司 | Information providing method, device, equipment and storage medium based on augmented reality |
| CN110673900A (en) * | 2019-08-23 | 2020-01-10 | 康佳集团股份有限公司 | Light effect adjusting method, intelligent terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111416971A (en) | 2020-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9558591B2 (en) | Method of providing augmented reality and terminal supporting the same | |
| CN107948733B (en) | Video image processing method and device and electronic equipment | |
| CN110149550B (en) | Image data processing method and device and storage medium | |
| Melo et al. | Evaluation of Tone‐Mapping Operators for HDR Video Under Different Ambient Luminance Levels | |
| CN114422816A (en) | Live video processing method and device, electronic equipment and storage medium | |
| CN108111897A (en) | A kind of method and device for showing displaying information in video | |
| CN113645476B (en) | Picture processing method and device, electronic equipment and storage medium | |
| CN116668656B (en) | Image processing method and electronic equipment | |
| CN111416971B (en) | Control method, control system, electronic device and readable storage medium | |
| CN109656647B (en) | Chart picture generation method, device and equipment and computer readable storage medium | |
| CN116962848A (en) | Video generation method, device, terminal, storage medium and product | |
| CN112513939A (en) | Color conversion for environmentally adaptive digital content | |
| US11817063B2 (en) | Perceptually improved color display in image sequences on physical displays | |
| WO2020011066A1 (en) | Terminal display method and device, terminal and readable medium | |
| CN107578753B (en) | Mobile terminal, display screen brightness adjusting method and storage medium | |
| CN114038370B (en) | Display parameter adjustment method and device, storage medium and display equipment | |
| CN116466855A (en) | Method, device, equipment and storage medium for viewing live-action fireworks in vehicle cabin | |
| CN116013184A (en) | Display screen processing method, device, equipment and medium | |
| CN115604887A (en) | Atmosphere lamp group control method, control console and device | |
| CN110941413B (en) | Display screen generation method and related device | |
| US20210366420A1 (en) | Display method and device, and storage medium | |
| CN114071221A (en) | Volume value adjusting method, device, equipment and storage medium | |
| CN108335362B (en) | Light control method and device in virtual scene and VR (virtual reality) equipment | |
| CN117014692A (en) | Screen projection method and related device | |
| CN115731829A (en) | Image quality adjusting method, storage medium and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |