CN111050139B

CN111050139B - Image processing method, image output equipment and electronic equipment

Info

Publication number: CN111050139B
Application number: CN201911395304.1A
Authority: CN
Inventors: 董芳菲; 郑将杰
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2019-12-30
Filing date: 2019-12-30
Publication date: 2021-10-22
Anticipated expiration: 2039-12-30
Also published as: CN111050139A

Abstract

The application provides an image processing method, image output equipment and electronic equipment, wherein association is established by controlling first image output equipment and a first image collector, a first image collected by the first image collector is continuously acquired, the first image output equipment is controlled to continuously display the first image, and the display flexibility is improved.

Description

Image processing method, image output equipment and electronic equipment

Technical Field

The present application relates to the field of image processing technologies, and in particular, to an image processing method, an image output device, and an electronic device.

Background

At present, when an image output device displays an image, the image output device can only display the image recommended by a system or in an album, and the display mode is single.

Disclosure of Invention

In view of the above, the present application provides an image processing method and an image output apparatus to solve the above technical problems.

In order to achieve the above purpose, the present application provides the following technical solutions:

an image processing method comprising:

controlling a first image output device to establish association with a first image collector;

continuously acquiring a first image acquired by the first image acquisition device;

and controlling the first image output device to continuously display the first image.

Preferably, the method further comprises the following steps:

adjusting the display scale of the first image;

correspondingly, the controlling the first image output device to continuously display the first image comprises:

controlling the first image output device to continuously display the adjusted first image; wherein the adjusted visual effect of the first image is displayed for characterizing the effect viewed in the real space exhibited by the first image.

Preferably, the method further comprises the following steps:

performing image processing on the first image, and removing privacy content in the first image;

and controlling the first image output equipment to continuously display the processed first image.

Preferably, the controlling the first image output device to establish an association with the first image collector includes:

displaying first information related to a plurality of image collectors on the first image output device;

determining a first image collector related to the triggered first information;

and after acquiring the association authority of the first image collector, establishing an association relation between the first image output device and the first image collector.

Preferably, the method further comprises the following steps:

when the change of the display direction of the first image conveying equipment is detected, the association with the first image collector is switched to the association with the second image collector, and a second image collected by the second image collector is output, wherein the first image collector and the second image collector are positioned in the same area range and have different collection directions; wherein, different display directions are matched with different acquisition directions;

or, further comprising:

determining a second image output apparatus belonging to the same group as the first image output apparatus; controlling the second image output device to establish association with a third image collector; the third image collector and the first image collector are located in the same area range, and the collection directions are different, wherein the image output equipment is located at different positions and matched with the image collectors in different collection directions.

determining accessory information of an accessory connected to the first image output device, wherein the accessory information can represent the type of the accessory;

determining a first image collector corresponding to the accessory information;

and establishing an incidence relation between the first image output device and the first image collector.

Preferably, the method further comprises the following steps:

controlling a second image output device to establish association with a second image collector;

acquiring a second image acquired by the second image acquirer;

controlling the second image output device to display the second image;

the first image collector is located on the second image output device, and the second image collector is located on the first image output device.

Preferably, the first image is a multi-frame image carrying first audio data;

the controlling the first image output device to continuously display the first image comprises:

detecting a first operation aiming at the first image output equipment, and continuously outputting a first image carrying the first audio data;

detecting a second operation for the first image output apparatus, continuously displaying the first image and prohibiting output of the first audio data.

An image output apparatus which is a first image output apparatus, comprising:

a first communication interface;

a first display;

the first processor is used for controlling the first image output device to establish association with the first image collector, continuously acquiring a first image collected by the first image collector through a first communication interface, and controlling the first display to continuously display the first image.

An electronic device, comprising:

a second communication interface;

a third communication interface;

and the second processor is used for controlling the first image output equipment to establish association with the first image collector, continuously acquiring the first image collected by the first image collector through the second communication interface, sending the first image to the first image output equipment through the third communication interface, and controlling the first image output equipment to continuously display the first image.

According to the technical scheme, the first image output device is controlled to be associated with the first image collector, the first image collected by the first image collector is continuously obtained, and the first image output device is controlled to continuously display the first image.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application;

FIG. 2 is a schematic flow chart illustrating an image processing method according to another embodiment of the present disclosure;

FIG. 3 is a schematic flow chart of an image processing method according to another embodiment of the present application;

FIG. 4a is a schematic diagram of a first image output device and a connected accessory according to the present application;

FIG. 4b is a schematic diagram of another structure of the first image output device and the connected accessory provided by the present application;

FIG. 5 is a schematic flow chart of an image processing method according to another embodiment of the present application;

FIG. 6 is a schematic flow chart of an image processing method according to another embodiment of the present application;

FIG. 7 is a flowchart illustrating an image processing method according to another embodiment of the present application;

FIG. 8 is a flowchart illustrating an image processing method according to another embodiment of the present application;

FIG. 9 is a flowchart illustrating an image processing method according to another embodiment of the present application;

FIG. 10 is a flowchart illustrating an image processing method according to another embodiment of the present application;

FIG. 11 is a schematic diagram of an image output apparatus according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

One embodiment of the present application discloses an image processing method, as shown in fig. 1, the method includes the following steps:

step 101: controlling a first image output device to establish association with a first image collector;

the image processing method provided by the application can be applied to the first image output device, and under the condition, the first image output device can be directly communicated with the first image collector or communicated with the first image collector through the server. Note that the first image output apparatus is an apparatus mainly for displaying an image. The image processing method provided by the application can also be applied to electronic equipment, such as a server, and under the condition, the electronic equipment can be respectively communicated with the first image output equipment and the first image collector.

The first image output device and the first image collector are different devices, and specifically, may be different devices located at different positions.

Step 102: continuously acquiring a first image acquired by the first image acquisition device;

the first image collector continuously collects the first image, so that the first image can be continuously acquired.

Step 103: and controlling the first image output device to continuously display the first image.

After the incidence relation between the first image output device and the first image collector is established, the first images collected by the first image collector can be displayed through the first image output device.

It should be noted that the first image continuously acquired by the first image acquirer may be a static image, or may also be a continuous multi-frame image, that is, a video image.

Specifically, the continuous collection of the first image by the first image collector may refer to that the first image collector continuously collects the first image according to the first time interval, and transmits the first image to a receiving end (e.g., a first image output device or an electronic device communicating with the first image output device) after collection. That is, the receiving end can continuously acquire the first image at the first time interval.

The first time interval is different, so that the first image is represented differently, for example, the first time interval may be 1/24s, 1/30s, or 1/120s, i.e., the first image captured by the first image capture device is a video image. The first time interval may be 1m, 10m, 1h, 1day, and then the first image captured by the first image capture device is a still image.

Alternatively, the continuous acquisition of the first image by the first image acquirer may refer to the continuous acquisition of the first image by the first image acquirer at the first time interval. And the receiving end can acquire the first image acquired by the first image acquirer according to the second time interval.

In this case, the first time interval is smaller than the second time interval. For example, the first time interval may be 1/24s, 1/30s, or 1/120s, that is, the first image captured by the first image capturing device is a video image, and the second time interval may be 1m, 10m, 1h, or 1day, that is, the first image captured by the receiving end is a still image.

Or, the continuous collection of the first image by the first image collector may refer to collection of the first image by the first image collector at a non-fixed time interval, and image analysis is performed after the first image is collected, and the collected first image is sent to the receiving end after it is determined that the characteristic difference between the first images collected before and after the collection is greater than the preset difference.

In this case, corresponding feature differences exist in the first images displayed before and after the first image output device, and the feature differences are used for representing that the space acquired by the first image acquirer has environmental changes, such as weather changes, morning and evening environmental changes, and the like.

In this embodiment, association between the first image output device and the first image collector is controlled, the first image collected by the first image collector is continuously acquired, and the first image output device is controlled to continuously display the first image, so that the first image collected by the first image collector associated with the first image output device can be continuously displayed through the first image output device.

Another embodiment of the present application further provides an image processing method, as shown in fig. 2, the method includes the following steps:

step 201: controlling a first image output device to establish association with a first image collector;

step 202: continuously acquiring a first image acquired by the first image acquisition device;

step 203: adjusting the display scale of the first image;

step 204: and controlling the first image output equipment to continuously display the adjusted first image.

And displaying the adjusted visual effect of the first image to represent the effect of the first image in the real space. That is, the first image after the display scale is adjusted is displayed on the first image output apparatus, so that a user viewing the first image on the first image output apparatus has a feeling of being personally on the scene.

The display ratio to be adjusted may be set in advance. Preferably, the display scale of the first image may be increased to a target display scale, so that the features in the first image displayed by the first image output device are larger than the features in the first image collected by the first image collector, and a user watching the first image on the first image output device is provided with an effect of watching in a real space shown by the first image.

Therefore, in this embodiment, after the association relationship between the first image output device and the first image collector is established, the first image collected by the first image collector can be continuously acquired, and the display scale of the first image can be adjusted, so that the first image output device is controlled to continuously display the adjusted first image, and the visual effect of displaying the adjusted first image is used for representing the effect of viewing the first image in the real space, thereby improving the display effect of the first image.

Yet another embodiment of the present application further provides an image processing method, as shown in fig. 3, the method includes the following steps:

step 301: controlling a first image output device to establish association with a first image collector;

step 302: continuously acquiring a first image acquired by the first image acquisition device;

step 303: performing image processing on the first image, and removing privacy content in the first image;

after the first image is acquired, image processing may be performed on the first image, and content in the first image that meets the preset feature is determined, so as to remove the private content in the first image. Alternatively, the removing of the private content in the first image may also be referred to as reducing the recognition possibility of the private content in the first image, such as reducing the definition of the private content, or mosaicing the private content. The preset features may include human body object features, character object features, at least part of traffic equipment features, and the like, so as to remove the human body object, such as a human face, the character object, and the at least part of the traffic equipment, such as a license plate of a vehicle, and the like in the first image. Step 304: and controlling the first image output equipment to continuously display the processed first image.

When the first image output device continuously displays the first image collected by the first image collector, the first image with the privacy content removed is displayed, so that even if the first image output device is associated with the first image collector, the privacy object in the collection area of the first image collector cannot be revealed. Therefore, in the embodiment, after the association relationship between the first image output device and the first image collector is established, the first image collected by the first image collector can be continuously obtained, the first image can be subjected to image processing, and the privacy content in the first image is removed, so that the first image output device is controlled to continuously display the processed first image, and the displayed first image is free of the privacy content, so that not only is the privacy information prevented from being leaked, but also the display quality of the first image is improved, and better viewing experience is provided for a user.

In this application, there are multiple implementation manners for establishing association, and as a first implementation manner, the controlling of the first image output device to establish association with the first image collector includes:

acquiring the association authority of a first image collector, and establishing and permanently maintaining the association relation between the first image output device and the first image collector.

The first image collector has an association authority, association can be established with the first image collector only when the association authority of the first image collector is acquired, and the association relationship can be maintained all the time unless the association authority of the first image collector is cancelled.

There are many ways to obtain the association authority, for example, the association authority may be applied to the first image collector or a server managing the first image collector. Or the association authority of the first image collector is obtained by inputting the unique association identifier of the first image collector, or the administrator of the first image collector starts the association authority aiming at the first image collector in the display device.

As an application example, when a user wants to always watch a picture collected by a certain image collector, the association authority of the corresponding image collector may be applied, for example, when the user wants to always watch a high-altitude picture collected by a first image collector located in a high altitude, an association authority request of the first image collector located in the high altitude may be applied by an electronic device, and after the association authority is obtained (for example, the association authority is obtained by a payment method), a first image output device associated with the first image collector may be obtained (the first image output device may be given after the payment), and the obtained first image output device may always display the high-altitude picture.

As a second implementation manner, the controlling the first image output device to establish an association with the first image collector may include the following steps:

(1) determining accessory information of an accessory connected to the first image output device;

the first image output device is connected with an accessory, and the accessory information of the accessory can represent the type of the accessory, specifically, the type of the accessory can comprise the shape of the accessory or the style of the accessory.

Note that the accessory may be connected to the first image output apparatus as a frame structure of the first image output apparatus. In one approach, the accessory may be wirelessly connected to a first image output device, which may read accessory information in the accessory. If the image processing method is applied to the electronic equipment, the electronic equipment can acquire the accessory information on the first image output equipment.

In another mode, visual accessory information is marked on the accessory, and the user inputs the accessory information on the first image output device to enable the first image output device to acquire the accessory information. If the image processing method is applied to the electronic equipment, the electronic equipment can acquire the accessory information on the first image output equipment.

For example, as shown in fig. 4a, the accessory to which the first image output device 110 is connected is 110A, and the accessory 110A is shaped like a mike, i.e. the first image output device 110 is an image output device shaped like a mike. As shown in fig. 4b, the accessory connected to the first image output device 120 is 120A, the style of the accessory 120A is airplane window, and the first image output device 120 is airplane window type image output device.

(2) Determining a first image collector corresponding to the accessory information;

different accessory information can correspond to different first image collectors, and as a mode, the corresponding relation between the different accessory information and the different image collectors can be established in advance, and the only first image collector corresponding to the accessory information can be determined directly based on the corresponding relation.

As another mode, determining a first image collector by narrowing a selection range, that is, determining a first image collector corresponding to the accessory information, includes:

(2.1) determining an image capture location corresponding to the accessory information;

the different accessory information corresponds to different image acquisition positions, and the image acquired at the image acquisition position corresponding to the accessory information can reflect the type of the accessory. If the type of attachment characterized by the attachment information is a mike shape, then the corresponding image capture location may be a disneyland. The accessory style characterized by the accessory information is an airplane window, and the corresponding image capture location may be high altitude or at a true airplane window.

(2.2) determining a target image collector set located at the image collecting position;

(2.3) determining a first image collector in the set of target collectors.

Specifically, any first image collector in the target image collector set may be determined, first information related to the image collectors in the target image collector set may also be output, and the image collector related to the triggered first information is determined to be the first image collector.

It should be noted that the first information is used to increase the user's understanding of the image collector, and characterize part of content information related to the image collector, specifically:

the first information can be characterized as the specific position of the image collector in the image collecting position; if the image acquisition location is Disney, then the first information may be characterized as on the street of Disney, within the fantasy fairy tale castle, and so on.

And/or the first information can represent partial image information currently acquired by the image acquisition device;

and/or the first information may represent identification information of an image acquired by the image acquirer, and the like.

(3) And establishing an incidence relation between the first image output device and the first image collector.

As a third implementation manner, another embodiment of the method of the present application further provides an image processing method, as shown in fig. 5, the method includes the following steps:

step 501: displaying first information related to a plurality of image collectors on a first image output device;

in one mode, a user may input a keyword in a search field of the first image output device, and the first image output device or the electronic device performs a search for an image collector based on the keyword, so that a first display related to a plurality of image collectors corresponding to a search result is displayed on the first image output device. For example, the keyword may be a location, so that a plurality of image collectors located at the location are searched, and first information related to the plurality of image collectors is displayed on the first image output device.

In another mode, the first information related to the plurality of image collectors can be automatically recommended to be displayed on the first image output device directly.

The first information is used for increasing the understanding of the user image collector, representing part of content information related to the image collector, and specifically:

the first information can be characterized as the specific position of the image collector;

and/or the first information can be represented as partial image information currently acquired by the image acquisition device;

and/or the first information can be represented as image identification information of the image collected by the image collector;

and/or the first information may be characterized as climate information, cultural information, etc. of the location where the image collector is located.

That is, by displaying the first information, it is possible to make it convenient for the user to know about the image collector to confirm with which image collector the first image output apparatus is associated.

In order to implement the targeted recommendation, optionally, the environments of the plurality of image collectors may be different from the environment of the first image output device, and specifically, the first environment information of the first image output device may be acquired by a sensor, so as to determine the plurality of image collectors corresponding to the second environment information different from the first environment information. That is, the first image output device corresponds to first environment information, the plurality of image collectors correspond to second environment information, and a first environment under the first environment information is different from a second environment under the second environment information.

Specifically, the climate corresponding to the first environment is opposite to the climate corresponding to the second environment, or the location corresponding to the first environment is far away from the location corresponding to the second environment (greater than the preset first distance), or the time difference between the first environment and the second environment is large (greater than the predicted first time difference), and so on. By recommending information in the opposite environment on the first image output device in the first environment, the user is enabled to achieve an experience effect of obtaining the opposite recommendation.

Step 502: determining a first image collector related to the triggered first information; the user finds the interested image collector by browsing the displayed plurality of first information, and triggers the first information of the corresponding image collector, so that the first image collector related to the triggered first information can be determined. For example, the first image output device is located in a home of a user in Beijing, China, and displays a plurality of positions of the first image collector located in Paris, France. For example, the first image collector is shown to be located at the Eiffel iron tower of Paris, France, the Kaiser door of Paris, France, and the san Diego of Paris, France. Obviously, the first image output device and the first image collector are located far apart, so that the user can select a desired picture without being in the neighborhood of paris, france.

Step 503: after acquiring the association authority of the first image collector, establishing an association relation between first image output equipment and the first image collector;

step 504: continuously acquiring a first image acquired by the first image acquisition device;

step 505: and controlling the first image output device to continuously display the first image.

Therefore, in the embodiment, the first information related to the plurality of image collectors is displayed on the first image output device, so that the first image collector related to the triggered first information is determined, and the purposes that the plurality of image collectors are recommended on the first image output device and the user selects the image collector of interest are achieved; furthermore, the association between the first image output device and the first image collector is controlled, the first image collected by the first image collector is continuously obtained, the first image output device is controlled to continuously display the first image, the display flexibility is improved, and under the condition that the environments of the plurality of image collectors are different from the environment of the first image output device, the user is enabled to be in the environment of the first image output device, the picture of the environment of the first image collector can be watched through the first image output device, and the experience effect of the opposite environment can be obtained.

Corresponding to the embodiment of the method, as an application example, a user can browse the first information of a plurality of image collectors corresponding to the search result in a search mode, or directly browse first information of a plurality of image collectors recommended on the first image output device, then selecting an image collector to preview the collected partial image, if the partial image collected by the first image collector at the Eiffel tower is selected to be previewed and then the partial image is wanted to be watched continuously, the associated authority corresponding to the first image collector can be applied, after the association authority with the first image collector is obtained (for example, the association authority is obtained in a payment mode), the association between the first image output device and the first image collector is established, and then the picture collected by the first image collector located at the eiffel tower can be continuously viewed on the first image output device.

Yet another embodiment of the present application further provides an image processing method, as shown in fig. 6, the method includes the following steps:

step 601: controlling a first image output device to establish association with a first image collector;

step 602: continuously acquiring a first image acquired by the first image acquisition device;

step 603: controlling the first image output device to continuously display the first image;

step 604: and when the change of the display direction of the first image output equipment is detected, switching the association with the first image collector to the association with the second image collector, and outputting a second image collected by the second image collector.

The different display directions of the first image output device may match the image collectors in different collection directions, and specifically, if the first display direction matches the first image collector in the first collection direction and the second display direction matches the second image collector in the second collection direction, then when it is determined that the user changes the display direction of the first image output device from the first display direction to the second display direction, the user may switch to the second image collector.

That is, the first image collector and the second image collector are located in the same area range, and the collection directions are different; wherein different display directions match different acquisition orientations.

For example, four image collectors are arranged at the top of the Disney castle, the collection directions of the four image collectors are respectively towards four directions of southeast, northwest and east, so that images in the four directions can be collected respectively, the first display direction of the first image output device corresponds to the first image collector with the collection direction of east, the second display direction of the first image output device corresponds to the second image collector with the collection direction of south, the third display direction of the first image output device corresponds to the third image collector with the collection direction of west, and the fourth display direction of the first image output device corresponds to the fourth image collector with the collection direction of north. When the display direction of the first image output device is changed to a second display direction, the display direction is switched to be associated with the second image collector, and therefore a second image collected by the second image collector is output.

Therefore, in the embodiment, the association between the first image output device and the first image collector is controlled, the first image collected by the first image collector is continuously obtained, and the first image output device is controlled to continuously display the first image, so that the display flexibility is improved; furthermore, when the change of the display direction of the first image output device is detected, the association with the first image collector is switched to the association with the second image collector, and the second image collected by the second image collector is output, so that the purpose of switching to output images collected by different image collectors by changing the display direction of the first image output device is realized, and then when a user wants to see images in different collection directions in the same area range, only the display direction of the image output device needs to be changed, and the operation is very convenient.

Yet another embodiment of the present application further provides an image processing method, as shown in fig. 7, the method includes the following steps:

step 701: controlling a first image output device to establish association with a first image collector;

step 702: continuously acquiring a first image acquired by the first image acquisition device;

step 703: controlling the first image output device to continuously display the first image;

step 704: determining a second image output apparatus belonging to the same group as the first image output apparatus;

specifically, the plurality of image output devices in the same group may be preset, and the current group of the first image output device and the second image output device belonging to the same group are determined by looking at the group identifier and the device identifier.

Step 705: and controlling the second image output device to establish association with a third image collector.

The third image collector and the first image collector are located in the same area range, and the collection directions are different. The image output device is arranged at different positions and matched with the image collectors with different collection orientations. After the second image output device is associated with the third image collector, the second image output device can continuously acquire and display the second image collected by the third image collector.

As a specific application scenario, the home of the user a may be provided with 3 image output devices, and the 3 image output devices all belong to a family group. The 3 image output devices are respectively located on the walls of the east, the west and the south of the living room of the user a, and by executing the image processing method provided by the embodiment, the 3 image output devices can respectively display pictures in different directions in the same area range, for example, the image output device located on the wall of the east displays the picture acquired by the image acquirer whose acquisition direction is east, the image output device located on the wall of the west displays the picture acquired by the image acquirer whose acquisition direction is west, and the image output device located on the wall of the south displays the picture acquired by the image acquirer whose acquisition direction is south.

Still another embodiment of the present application further provides an image processing method, as shown in fig. 8, the method includes the following steps:

step 801: controlling a first image output device to establish association with a first image collector;

step 802: continuously acquiring a first image acquired by the first image acquisition device;

step 803: controlling the first image output device to continuously display the first image;

step 804: controlling a second image output device to establish association with a second image collector;

step 805: acquiring a second image acquired by the second image acquirer;

step 806: controlling the second image output device to display the second image;

the first image collector is positioned on the second image output device, and the second image collector is positioned on the first image output device. That is to say, each image output device is provided with an image collector, and specifically, the image collector may be disposed on a side of the image output device for displaying an image, that is, a collecting direction is consistent with a displaying direction.

The first image output device is associated with the first image collector on the second image output device, and the second image output device is associated with the second image collector on the first image output device, so that images in the environment of the opposite side can be displayed on the two image output devices respectively.

In order to enable the user of the first image output device and the user of the second image output device to have an effect of being in close contact with the environment of the other party, in this embodiment, optionally, after continuously acquiring the first image acquired by the first image acquirer, the method may further include adjusting a display scale of the first image, so as to control the first image output device to continuously display the adjusted first image; after the second image acquired by the second image acquirer is acquired, the display scale of the second image can be adjusted, so that the second image output device is controlled to continuously display the adjusted second image.

And displaying the adjusted visual effect of the first image on the first image output device to represent the effect of the first image in the real space. That is, the first image after the display scale is adjusted is displayed on the first image output apparatus, so that a user viewing the first image on the first image output apparatus has a feeling of physically approaching a space where the second image output apparatus is located.

And displaying the adjusted visual effect of the second image on the second image output device for representing the effect of the second image in the real space. That is, the display-scaled second image is displayed on the second image output apparatus, so that a user viewing the second image on the second image output apparatus has a feeling of being physically present in the space where the first image output apparatus is located.

The display ratio to be adjusted may be set in advance. Preferably, the display scale of the first image may be increased to a target display scale, so that the features in the first image displayed by the first image output device are larger than the features in the first image acquired by the first image acquirer, and the display scale of the second image may be increased to a target scale, so that the features in the second image displayed by the second image output device are larger than the features in the second image acquired by the second image acquirer.

As a specific application scenario, the user a and the user B are respectively located at two locations, and want to pay attention to each other all the time, then a first image output device may be disposed in the room of the user a, and a second image output device may be disposed in the room of the user B, and the first image output device may be disposed thereon.

Yet another embodiment of the present application further provides an image processing method, as shown in fig. 9, the method includes the following steps:

step 901: controlling a first image output device to establish association with a first image collector;

step 902: continuously acquiring a first image acquired by the first image acquisition device;

step 903: detecting a first operation aiming at the first image output equipment, and continuously outputting a first image carrying the first audio data;

the first audio data may be sound data collected during the acquisition of the first image.

In this embodiment, the first operation may be a windowing operation performed on the first image output device, such as a first touch operation on the first image output device, a first press operation, a first translation operation in a first direction, and the like. In this case, the first audio data may be output while the first image is displayed.

Specifically, when the first operation is the first touch operation, the volume of the first audio data may be the first volume. For example, the first touch operation may be a lateral push operation, and such a scene may correspond to an operation similar to a user pushing a window laterally, so that the user can clearly hear a sound similar to that outside the window.

The first operation may also be a first proximity operation for the first image output apparatus, in which case the volume of the first audio data may be the second volume. Such a scene may correspond to a scene similar to a user approaching a window, and the user may then steganographically hear sounds similar to sounds outside the window.

It should be noted that the first touch operation and the first proximity operation may be independent or simultaneous, and when the first touch operation and the first proximity operation are simultaneous, the first volume is greater than the second volume.

Step 904: detecting a second operation for the first image output apparatus, continuously displaying the first image and prohibiting output of the first audio data.

The second operation is different from the first operation, and the second operation may be a window closing operation performed on the first image output device, such as a second touch operation for the first image output device, a second press operation, a second shift operation to a second direction, and so on. In this case, only the first image may be displayed while the output of the first audio data is prohibited, providing a quiet environment for the user.

The first image may be a plurality of frames of continuous images carrying first audio data, and is specifically characterized as a video.

As a specific application scene, a first image output device is arranged on the wall of a user, the first image output device is connected with a first image collector which is arranged in the air and used for collecting high-altitude scenery, when the user wants to listen to the sound in the air, the first image output device can be operated in a first mode, and then the first image output device not only can output high-altitude pictures collected by the first image collector, but also can output the sound carried by the high-altitude pictures, so that visual and auditory enjoyment is brought to the user. When the user wants to have a quiet environment, the second operation can be performed on the first image output device, and then the first image output device outputs the high-altitude pictures collected by the first image collector without outputting sound, so that the user is provided with the quiet environment and the visual effect is brought.

Yet another embodiment of the present application further provides an image processing method, as shown in fig. 10, the method includes the following steps:

step 1001: controlling a first image output device to establish association with a first image collector;

step 1002: acquiring a first image acquired by the first image acquisition device;

step 1003: detecting a sight line direction of a target object located within a preset range of the first image output device;

specifically, the vision of the target object located within the preset range of the first image output device may be monitored by the sensing unit, so as to determine the sight line direction of the target object. The target object may be a user viewing the first image output apparatus within a preset range of the first image output apparatus.

Step 1004: adjusting a display angle at which the first image output device displays the first image based on the gaze direction of the target object.

Wherein step 1004 is a specific implementation of step controlling the first image output device to display the first image.

In this step, the display angle at which the first image output device displays the first image may be adjusted based on the gaze direction of the target object. In effect, when the line of sight direction of the user is shifted, the first image output device may correspondingly adjust the first image to be shifted, for example, the line of sight direction of the user is shifted to the left, and the displayed first image is also shifted to the left, so as to achieve the purpose of adjusting the displayed first image in real time based on the line of sight of the user, and increase interactivity between the user and the first image output device.

Corresponding to the image processing method, the embodiment of the apparatus of the present application further provides an image output device, and several embodiments of the apparatus are separately described below.

An apparatus embodiment of the present application provides an image output apparatus, as shown in fig. 11, which is a first image output apparatus including: a first communication interface 110, a first display 120, and a first processor 130; wherein:

the first processor 130 is configured to control the first image output device to establish a relationship with the first image collector, continuously obtain the first image collected by the first image collector through the first communication interface 110, and control the first display to continuously display the first image.

It should be noted that the first image acquired by the first image acquirer may be a static image, or may be a continuous multi-frame image, and the specific representation is a video image.

Specifically, the continuous collection of the first image by the first image collector may refer to the continuous collection of the first image by the first image collector according to a first time interval, and the collected first image is transmitted to the first image output device. That is, the first image output apparatus can continuously acquire the first image at the first time interval.

Alternatively, the continuous acquisition of the first image by the first image acquirer may refer to the continuous acquisition of the first image by the first image acquirer at the first time interval. And the first image output device may acquire the first image acquired by the first image acquirer at the second time interval.

In this case, the first time interval is smaller than the second time interval. For example, the first time interval may be 1/24s, 1/30s, or 1/120s, that is, the first image captured by the first image capturing device is a video image, and the second time interval may be 1m, 10m, 1h, or 1day, that is, the first image captured by the first image output device is a still image.

Or, the continuous collection of the first image by the first image collector may refer to collection of the first image by the first image collector at a non-fixed time interval, and image analysis is performed after the first image is collected, and the collected first image is sent to the first image output device after it is determined that the characteristic difference between the first images collected before and after is greater than the preset difference.

In another embodiment of the present application, the first processor is further configured to adjust a display scale of the first image. Correspondingly, the first processor controls the first display to continuously display the first image, and comprises: and controlling the first display to continuously display the adjusted first image.

Wherein the adjusted visual effect of the first image is displayed for characterizing the effect viewed in the real space exhibited by the first image.

That is, the first image after the display scale is adjusted is displayed on the first image output apparatus, so that a user viewing the first image on the first image output apparatus has a feeling of being personally on the scene.

The display ratio to be adjusted may be set in advance.

In another embodiment of the present application, the first processor is further configured to perform image processing on the first image to remove private content in the first image. Correspondingly, the first processor controls the first display to continuously display the first image, and comprises: and controlling the first display to continuously display the processed first image.

Specifically, after the first image is acquired, the first processor may perform image processing on the first image, and determine content in the first image that meets the preset feature, so as to remove the privacy content in the first image. In this embodiment, the removing of the private content in the first image may refer to replacing the private content in the first image with other content, where the other content may be content determined based on image characteristics of an area around the private content in the first image. Alternatively, the removing of the private content in the first image may also be referred to as reducing the recognition possibility of the private content in the first image, such as reducing the definition of the private content, or mosaicing the private content.

In this application, there are various implementation manners for establishing association, and as a first implementation manner, the first processor controls the first image output device to establish association with the first image collector, including: acquiring the association authority of a first image collector, and establishing and permanently maintaining the association relation between the first image output device and the first image collector.

The first image collector has an association authority, the first processor can establish association with the first image collector only when acquiring the association authority of the first image collector, and the association relationship can be maintained all the time unless the association authority of the first image collector is cancelled.

There are many ways for the first processor to obtain the association authority, for example, the first processor may apply for the association authority from the first image collector or a server managing the first image collector. Or the association authority of the first image collector is obtained by inputting the unique association identifier of the first image collector, or the administrator of the first image collector starts the association authority aiming at the first image collector in the first image output device.

As a second implementation manner, the controlling, by the first processor, the first image output device to establish an association with the first image collector may include:

Note that the accessory may be connected to the first image output apparatus as a frame structure of the first image output apparatus. In one approach, the accessory may be wirelessly connected to a first image output device, which may read accessory information in the accessory. In another mode, visual accessory information is marked on the accessory, and the user inputs the accessory information on the first image output device to enable the first image output device to acquire the accessory information.

As another mode, the determining the first image collector by narrowing the selection range, specifically, the determining, by the first processor, the first image collector corresponding to the accessory information includes:

the different accessory information corresponds to different image acquisition positions, and the image acquired at the image acquisition position corresponding to the accessory information can reflect the type or style of the accessory.

(2.3) determining a first image collector in the set of target collectors.

As another implementation manner of establishing an association, the controlling, by the first processor, the first image output device to establish an association with the first image collector may include:

displaying first information related to a plurality of image collectors on the first display;

determining a first image collector related to the triggered first information;

It should be noted that the first information is used to increase the understanding of the user image collector and characterize part of content information related to the image collector, specifically:

In order to implement the targeted recommendation, optionally, the environments of the plurality of image collectors may be different from the environment of the first image output device, in this embodiment, the first image output device may further include a first sensor, configured to acquire first environment information of the first image output device, so that the first processor may determine the plurality of image collectors corresponding to second environment information different from the first environment information. That is, the first image output device corresponds to first environment information, the plurality of image collectors correspond to second environment information, and a first environment under the first environment information is different from a second environment under the second environment information.

In another embodiment of the apparatus of the present application, the first processor is further configured to switch the association with the first image collector to the association with the second image collector when detecting that the display direction of the first image transmission device changes, and control the first display to output the second image collected by the second image collector.

In another embodiment of the apparatus of the present application, the first processor is further configured to determine a second image output device that belongs to the same group as the first image output device, and control the second image output device to establish a relationship with a third image collector, so that the second image output device can continuously acquire and display a second image collected by the third image collector.

The third image collector and the first image collector are located in the same area range, the collection directions are different, and the image output equipment is located at different positions and matched with the image collectors in different collection directions.

In another embodiment of the apparatus of the present application, the first processor is further configured to control the second image output device to establish a relationship with the second image collector, so that the second image output device obtains the second image collected by the second image collector and displays the second image.

The first image collector is located on the second image output device, and the second image collector is located on the first image output device. That is to say, each image output device is provided with an image collector, and specifically, the image collector may be disposed on a side of the image output device for displaying an image, that is, a collecting direction is consistent with a displaying direction.

In order to enable the user of the first image output device and the user of the second image output device to have an effect of being in close proximity to the environment of the other party, in this embodiment, optionally, after continuously acquiring the first image acquired by the first image acquirer, the first processor may further be configured to adjust the display scale of the first image, so as to control the first image output device to continuously display the adjusted first image; after the second image collected by the second image collector is obtained, the display scale of the second image can be adjusted, so that the second image output device is controlled to continuously display the adjusted second image.

The display ratio to be adjusted may be set in advance. Preferably, the first processor may increase the display scale of the first image to a target display scale so that the features in the first image displayed by the first image output device are larger than the features in the first image captured by the first image capture device, and increase the display scale of the second image to the target scale so that the features in the second image displayed by the second image output device are larger than the features in the second image captured by the second image capture device.

In another embodiment of the present application, the first image output device further includes a first sound output device, and the first processor controls the first image output device to continuously display the first image, including:

detecting a first operation aiming at the first image output equipment, controlling a first display to continuously output a first image, and controlling a first sound output device to output first audio data carried by the first image; and detecting a second operation aiming at the first image output equipment, controlling the first display to continuously output the first image, and forbidding the first sound output equipment to output the first audio data carried by the first image.

The first image is a continuous multi-frame image carrying first audio data, and is specifically characterized as a video image.

In another embodiment of the present application, the first image output device further includes a line-of-sight sensor for monitoring a line-of-sight direction of a target object within a preset range of the first image output device.

The target object may be a user viewing the first image output apparatus within a preset range of the first image output apparatus.

The first processor controls the first image output device to display the first image, specifically, adjusts a display angle of the first image output device to display the first image based on the sight line direction of the target object.

The different gaze directions correspond to different display angles, and the first processor may adjust the display angle at which the first image output device displays the first image based on the gaze direction of the target object. In effect, when the line of sight direction of the user is shifted, the first image output device may correspondingly adjust the first image to be shifted, for example, the line of sight direction of the user is shifted to the left, and the displayed first image is also shifted to the left, so as to achieve the purpose of adjusting the displayed first image in real time based on the line of sight of the user, and increase interactivity between the user and the first image output device.

Corresponding to the image output method, the embodiment of the apparatus of the present application further provides an electronic device, and the following detailed description is provided through several embodiments of the apparatus.

An apparatus embodiment of the present application provides an electronic device, as shown in fig. 12, including: a second communication interface 210, a third communication interface 220, and a second processor 230; wherein:

the second processor 230 is configured to control a first image output device to establish a relationship with a first image collector, continuously obtain a first image collected by the first image collector through the second communication interface 210, send the first image to the first image output device through the third communication interface 220, and control the first image output device to continuously display the first image.

It should be noted that the first image acquired by the first image acquirer may be a static image, or may also be a continuous multi-frame image, that is, a video image.

Specifically, the continuous collection of the first image by the first image collector may refer to the continuous collection of the first image by the first image collector according to a first time interval, and the collected first image is transmitted to the electronic device. That is, the electronic device can continue to acquire the first image at the first time interval.

Alternatively, the continuous acquisition of the first image by the first image acquirer may refer to the continuous acquisition of the first image by the first image acquirer at the first time interval. And the electronic device may acquire the first image acquired by the first image acquirer at the second time interval.

In this case, the first time interval is smaller than the second time interval. For example, the first time interval may be 1/24s, 1/30s, or 1/120s, that is, the first image captured by the first image capture device is a video image, and the second time interval may be 1m, 10m, 1h, or 1day, that is, the first image captured by the electronic device is a still image.

Or, the continuous collection of the first image by the first image collector may refer to collection of the first image by the first image collector at a non-fixed time interval, and image analysis is performed after the first image is collected, and the collected first image is sent to the electronic device after it is determined that the characteristic difference between the first images collected before and after the collection is greater than a preset difference.

In another embodiment of the present application, the second processor is further configured to adjust a display scale of the first image; correspondingly, the second processor controls the first image output device to continuously display the first image, and comprises:

and controlling the first image output equipment to continuously display the adjusted first image.

The display ratio to be adjusted may be set in advance.

In an embodiment of the present application, the second processor is further configured to perform image processing on the first image to remove the private content in the first image. Correspondingly, the second processor controls the first image output device to continuously display the first image, and comprises: and controlling the first image output equipment to continuously display the processed first image.

Specifically, after the first image is acquired, the second processor may perform image processing on the first image, and determine content in the first image that meets the preset feature, so as to remove the privacy content in the first image. In this embodiment, removing the private content in the first image may refer to replacing the private content in the first image with other content, which may be content determined based on image characteristics of an area around the private content in the first image. Alternatively, the removing of the private content in the first image may also be referred to as reducing the recognition possibility of the private content in the first image, such as reducing the definition of the private content, or mosaicing the private content.

In this application, there are various implementation manners for establishing association, and as a first implementation manner, the second processor controls the first image output device to establish association with the first image collector, including: acquiring the association authority of a first image collector, and establishing and permanently maintaining the association relation between the first image output device and the first image collector.

The first image collector has an association authority, the second processor can control the first image output device to establish association with the first image collector only when the association authority of the first image collector is acquired, and the association relationship can be maintained all the time unless the association authority of the first image collector is cancelled.

There are many ways for the second processor to obtain the association authority, for example, the association authority may be applied to the first image collector or a server managing the first image collector. Or the association authority of the first image collector is obtained by inputting the unique association identifier of the first image collector, or the administrator of the first image collector starts the association authority aiming at the first image collector in the electronic equipment.

As a second implementation manner, the controlling, by the second processor, the first image output device to establish an association with the first image collector may include:

Note that the accessory may be connected to the first image output apparatus as a frame structure of the first image output apparatus. In one mode, the accessory can be wirelessly connected with the first image output device, the first image output device can read the accessory information in the accessory, and the second processor of the electronic device can obtain the accessory information on the first image output device.

In another mode, visual accessory information is marked on the accessory, and a user inputs the accessory information on the first image output device to enable the first image output device to acquire the accessory information, so that the second processor of the electronic device can acquire the accessory information on the first image output device.

As another mode, the determining the first image collector by narrowing the selection range, that is, the determining the first image collector corresponding to the accessory information by the second processor, includes:

(2.3) determining a first image collector in the set of target collectors.

As another implementation manner of establishing an association, the second processor controls the first image output device to establish an association with the first image collector, including: displaying first information related to a plurality of image collectors on the first image output device; determining a first image collector related to the triggered first information; and after acquiring the association authority of the first image collector, establishing an association relation between the first image output device and the first image collector.

In one mode, a user may input a keyword in a search field of the first image output device, and the electronic device performs a search of an image collector based on the keyword, so that the first display related to the plurality of image collectors corresponding to the search result is displayed on the first image output device. For example, the keyword may be a location, so that a plurality of image collectors located at the location are searched, and first information related to the plurality of image collectors is displayed on the first image output device.

In order to implement the targeted recommendation, optionally, the environments of the plurality of image collectors may be different from the environment of the first image output device, in this embodiment, the electronic device may further include a second sensor, configured to acquire first environment information of the first image output device, so as to determine the plurality of image collectors corresponding to second environment information different from the first environment information. That is, the first image output device corresponds to first environment information, the plurality of image collectors correspond to second environment information, and a first environment under the first environment information is different from a second environment under the second environment information.

In another embodiment of the apparatus of the present application, the second processor is further configured to switch the association with the first image collector to the association with the second image collector when detecting that the display direction of the first image transmission device changes, and output a second image collected by the second image collector.

In another embodiment of the apparatus of the present application, the second processor is further configured to determine a second image output device that belongs to the same group as the first image output device, and control the second image output device to establish a relationship with a third image collector, so that the second image output device can continuously acquire and display a second image collected by the third image collector.

In another embodiment of the apparatus of the present application, the second processor is further configured to control a second image output device to establish a relationship with a second image collector, acquire a second image collected by the second image collector, and control the second image output device to display the second image.

In order to enable the user of the first image output device and the user of the second image output device to have an effect of being in close proximity to the environment of the other party, in this embodiment, optionally, after continuously acquiring the first image acquired by the first image acquirer, the second processor may further be configured to adjust the display scale of the first image, so as to control the first image output device to continuously display the adjusted first image; after the second image collected by the second image collector is obtained, the display scale of the second image can be adjusted, so that the second image output device is controlled to continuously display the adjusted second image.

The display ratio to be adjusted may be set in advance. Preferably, the second processor may increase the display scale of the first image to a target display scale so that the features in the first image displayed by the first image output device are larger than the features in the first image captured by the first image capture device, and increase the display scale of the second image to the target scale so that the features in the second image displayed by the second image output device are larger than the features in the second image captured by the second image capture device.

In another embodiment of the present application, the controlling, by the second processor, the first image output device to continuously display the first image includes:

detecting a first operation aiming at the first image output equipment, and controlling the first image output equipment to continuously output a first image carrying the first audio data;

and detecting a second operation aiming at the first image output device, controlling the first image output device to continuously display the first image and forbidding outputting the first audio data.

The first image is a multi-frame image carrying first audio data.

In another embodiment of the apparatus of the present application, the electronic device may further include:

and the sight line sensor is used for monitoring the sight line direction of the target object positioned in the preset range of the first image output equipment.

Correspondingly, the second processor controls the first image output device to display the first image, and comprises: adjusting a display angle at which the first image output device displays the first image based on the gaze direction of the target object.

The different gaze directions correspond to different display angles, and the second processor may adjust the display angle at which the first image output device displays the first image based on the gaze direction of the target object. In effect, when the line of sight direction of the user is shifted, the first image output device may correspondingly adjust the first image to be shifted, for example, the line of sight direction of the user is shifted to the left, and the displayed first image is also shifted to the left, so as to achieve the purpose of adjusting the displayed first image in real time based on the line of sight of the user, and increase interactivity between the user and the first image output device.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An image processing method comprising:

controlling the first image output device to continuously display the first image;

wherein, the controlling the first image output device to establish the association with the first image collector comprises:

determining accessory information of an accessory connected to the first image output device, wherein the accessory information can represent the type of the accessory, and the type of the accessory comprises the shape of the accessory or the style of the accessory;

determining a first image collector corresponding to the accessory information; wherein, different annex information corresponds different image acquisition positions, the first image acquisition ware that confirms to correspond with the annex information includes: selecting a corresponding first image collector according to the image collecting position corresponding to the shape or style of the accessory;

2. The method of claim 1, further comprising:

adjusting the display scale of the first image;

3. The method of claim 1, further comprising:

4. The method of claim 1, the controlling the first image output device to establish an association with a first image collector, comprising:

determining a first image collector related to the triggered first information;

5. The method of claim 1, further comprising:

acquiring a second image acquired by the second image acquirer;

controlling the second image output device to display the second image;

6. The method of claim 1, wherein the first image is a multi-frame image carrying first audio data;

7. The method of claim 1, further comprising:

or, further comprising:

determining a second image output apparatus belonging to the same group as the first image output apparatus; controlling the second image output device to establish association with a third image collector; the third image collector and the first image collector are located in the same area range and have different collection directions, wherein the image output equipment is located at different positions and matched with images in different collection directions.

8. An image output apparatus which is a first image output apparatus, comprising:

a first communication interface;

a first display;

the first processor is used for controlling the first image output device to establish association with the first image collector, continuously acquiring a first image collected by the first image collector through a first communication interface, and controlling the first display to continuously display the first image;

9. An electronic device, comprising:

a second communication interface;

a third communication interface;

the second processor is used for controlling first image output equipment to establish association with a first image collector, continuously acquiring a first image collected by the first image collector through the second communication interface, sending the first image to the first image output equipment through the third communication interface, and controlling the first image output equipment to continuously display the first image;