CN113266975A - Vehicle-mounted refrigerator control method, device, equipment and storage medium - Google Patents
Vehicle-mounted refrigerator control method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113266975A CN113266975A CN202110423365.5A CN202110423365A CN113266975A CN 113266975 A CN113266975 A CN 113266975A CN 202110423365 A CN202110423365 A CN 202110423365A CN 113266975 A CN113266975 A CN 113266975A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- user
- user behavior
- control
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000011217 control strategy Methods 0.000 claims abstract description 126
- 238000004458 analytical method Methods 0.000 claims abstract description 24
- 230000006399 behavior Effects 0.000 claims description 274
- 230000009471 action Effects 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 22
- 238000012549 training Methods 0.000 claims description 21
- 230000033001 locomotion Effects 0.000 claims description 13
- 230000036544 posture Effects 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 6
- 230000001960 triggered effect Effects 0.000 claims description 5
- 238000013459 approach Methods 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 19
- 230000008569 process Effects 0.000 description 16
- 238000012545 processing Methods 0.000 description 11
- 210000003414 extremity Anatomy 0.000 description 8
- 230000006872 improvement Effects 0.000 description 8
- 230000014509 gene expression Effects 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008451 emotion Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000008921 facial expression Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000005057 refrigeration Methods 0.000 description 4
- 230000002996 emotional effect Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 210000003813 thumb Anatomy 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 235000019993 champagne Nutrition 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 235000014101 wine Nutrition 0.000 description 2
- CDBYLPFSWZWCQE-UHFFFAOYSA-L Sodium Carbonate Chemical compound [Na+].[Na+].[O-]C([O-])=O CDBYLPFSWZWCQE-UHFFFAOYSA-L 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 210000003811 finger Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011176 pooling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/003—Arrangement or mounting of control or safety devices for movable devices
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
- F25D29/005—Mounting of control devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2600/00—Control issues
- F25D2600/06—Controlling according to a predetermined profile
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Thermal Sciences (AREA)
- Mechanical Engineering (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Biomedical Technology (AREA)
- Combustion & Propulsion (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Chemical & Material Sciences (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
- Devices That Are Associated With Refrigeration Equipment (AREA)
Abstract
The invention discloses a vehicle-mounted refrigerator control method, which comprises the following steps: when the preset camera shooting conditions are met, controlling an in-car camera to shoot the current user behavior of the user in the car to obtain a user behavior image; based on a preset user behavior recognition analysis model, recognizing the user behavior of the user behavior image to obtain recognized user behavior; when the identified user behavior is a preset user behavior type, acquiring a preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior; and controlling the vehicle-mounted refrigerator according to the control strategy. The invention also discloses a vehicle-mounted refrigerator control device, equipment and a computer readable storage medium. By adopting the embodiment of the invention, the vehicle-mounted refrigerator can be automatically controlled based on the user behavior, and the user does not need to approach the vehicle-mounted refrigerator and manually control the vehicle-mounted refrigerator, so that the user experience is improved.
Description
Technical Field
The invention relates to the technical field of refrigerator control, in particular to a vehicle-mounted refrigerator control method, device, equipment and storage medium.
Background
At present, some vehicles are equipped with vehicle-mounted refrigerators, and vehicle users can put various cold-stored things (such as wine bottles, soda bottles, fruits and the like filled with wine) into the vehicle-mounted refrigerators, and in the process of driving the vehicles, the vehicle users can open the vehicle-mounted refrigerators to take the things in the vehicle-mounted refrigerators, so that the driving experience of the vehicle users can be improved. However, the existing vehicle-mounted refrigerator can only be operated according to a preset operation mode after being started by a user, and cannot be automatically operated according to the requirements of the current user, for example, the vehicle-mounted refrigerator is placed at the rear of the vehicle, a driver sitting in the front row of the vehicle is difficult to operate to open the vehicle-mounted refrigerator during the driving of the vehicle, and the vehicle-mounted refrigerator cannot be automatically opened according to the opening requirements of the front row of the driver.
Disclosure of Invention
The embodiment of the invention aims to provide a vehicle-mounted refrigerator control method, a vehicle-mounted refrigerator control device, vehicle-mounted refrigerator control equipment and a storage medium, which can automatically control a vehicle-mounted refrigerator based on user behaviors without the need of enabling a user to approach the vehicle-mounted refrigerator and manually control the vehicle-mounted refrigerator, and improve user experience.
In order to achieve the above object, an embodiment of the present invention provides a method for controlling a vehicle-mounted refrigerator, including:
when the preset camera shooting conditions are met, controlling an in-car camera to shoot the current user behavior of the user in the car to obtain a user behavior image;
based on a preset user behavior recognition analysis model, recognizing the user behavior of the user behavior image to obtain recognized user behavior;
when the identified user behavior is a preset user behavior type, acquiring a preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior;
and controlling the vehicle-mounted refrigerator according to the control strategy.
As an improvement of the above scheme, the obtaining of the preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior includes:
carrying out user identification on the in-vehicle user in the user behavior image, and determining the user type of the in-vehicle user; the user types comprise new users and historical users;
when the user in the vehicle is a new user, executing the following control strategy acquisition mode: acquiring a control authority preset for a new user; finding a control strategy corresponding to the user behavior from a control strategy set mapped in advance with the control authority;
when the user in the vehicle is a historical user, executing the following control strategy acquisition mode: analyzing the figure picture of the historical user and acquiring a control authority preset for the historical user; finding a control strategy corresponding to the user behavior from a control strategy set mapped with the portrait and the control authority in advance; the portrait representation includes at least one of: personality traits, control preferences for the on-board refrigerator.
As an improvement of the above solution, the finding a control policy corresponding to the user behavior from a control policy set mapped in advance with the portrait and the control authority includes:
analyzing the behavior action amplitude of the user behavior;
determining the level of the action amplitude of the behavior in a preset action amplitude step;
and finding a control strategy corresponding to the level of the action amplitude of the user action from a control strategy set mapped in advance with the portrait and the control authority.
As an improvement of the above scheme, if the user behavior identified in the same user behavior image includes user behaviors of at least two different in-vehicle users, the obtaining of the preset control policy of the vehicle-mounted refrigerator corresponding to the user behavior when the identified user behavior is of a preset user behavior type includes:
when the at least two identified user behaviors are both preset user behavior types, judging whether the at least two user behaviors have a preset conflict relationship based on preset user behavior conflict judgment logic;
if yes, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; acquiring a control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the user in the vehicle with the highest priority;
if not, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; the method comprises the steps of obtaining control strategies of the vehicle-mounted refrigerator corresponding to the user behaviors of at least two in-vehicle users, and setting execution sequences of the control strategies corresponding to the user behaviors of the at least two in-vehicle users according to the priority of the control authority of the at least two in-vehicle users.
As an improvement of the above scheme, the vehicle-mounted refrigerator comprises a refrigerator body, a shelf body arranged in the refrigerator body and used for placing articles, a driving device used for driving the shelf body to extend out of and retract into the refrigerator body, and a control device used for controlling the driving device; the control strategy then comprises a control strategy for the drive device comprising at least one of:
the driving device drives the shelf body to extend out of the refrigerator body at a speed;
the driving device drives the rack body to retract to the speed of the refrigerator body. .
As an improvement of the above, the user behavior includes a limb movement of the user; then, the recognizing the user behavior of the user behavior image based on the preset user behavior recognition analysis model includes:
preprocessing the user behavior image;
inputting the preprocessed user behavior images into a pre-trained user behavior recognition analysis model to obtain the action postures of the limbs of the user; the user behavior recognition analysis model is obtained by training based on a plurality of user behavior image training samples in advance, and the user behavior image training samples contain posture information of the body motions of the user.
As an improvement of the above scheme, the camera shooting condition includes at least one of:
the method comprises the steps of detecting a photographing voice command sent by a user, detecting that a photographing control button in a vehicle is triggered, detecting a cup touching command of the user and detecting a door opening action of the vehicle-mounted refrigerator.
As an improvement of the above, the method further comprises:
when a preset automatic door opening condition is met, controlling the door of the vehicle-mounted refrigerator to open, and controlling the driving device to drive the shelf body to extend out; wherein, the automatic opening condition of the box door meets: the current date is a preset target date, the current time is in a preset target time period, the position of the vehicle is in a preset target range, and the vehicle is in a preset gear;
and when the box door is opened, controlling a voice playing device of the vehicle to play voice information corresponding to the target date.
As an improvement of the above solution, when the door of the in-vehicle refrigerator is opened, the method further includes:
detecting scene conditions of a user in a vehicle;
acquiring corresponding works to be played according to the scene conditions;
and controlling a voice playing device in the vehicle to play the works to be played.
In order to achieve the above object, an embodiment of the present invention further provides a vehicle-mounted refrigerator control apparatus, including:
the camera starting module is used for controlling the camera in the automobile to shoot the current user behavior of the user in the automobile when the preset camera shooting condition is met, so as to obtain a user behavior image;
the user behavior recognition module is used for recognizing the user behavior of the user behavior image based on a preset user behavior recognition analysis model to obtain recognized user behavior;
the control strategy acquisition module is used for acquiring a control strategy of the vehicle-mounted refrigerator, which is preset and corresponds to the user behavior, when the identified user behavior is the preset user behavior type;
and the control module is used for controlling the vehicle-mounted refrigerator according to the control strategy.
In order to achieve the above object, an embodiment of the present invention further provides an in-vehicle refrigerator control apparatus, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the in-vehicle refrigerator control method according to any one of the above embodiments when executing the computer program.
In order to achieve the above object, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, where when the computer program runs, an apparatus where the computer-readable storage medium is located is controlled to execute the in-vehicle refrigerator control method according to any one of the above embodiments.
Compared with the prior art, the vehicle-mounted refrigerator control method, the vehicle-mounted refrigerator control device, the vehicle-mounted refrigerator control equipment and the storage medium disclosed by the embodiment of the invention analyze the behavior of the user in the vehicle based on the image recognition technology, acquire the control strategy of the corresponding vehicle-mounted refrigerator according to the recognized user behavior belonging to the preset user behavior type, and finally control the work of the vehicle-mounted refrigerator according to the control strategy. Therefore, the control requirement of the user in the vehicle on the vehicle-mounted refrigerator can be identified according to the user behavior, the work of the vehicle-mounted refrigerator is automatically controlled, the user does not need to approach the vehicle-mounted refrigerator and manually control and operate the vehicle-mounted refrigerator, and the user experience is improved.
Drawings
FIG. 1 is a flow chart of a control method for a vehicle-mounted refrigerator according to an embodiment of the present invention;
FIG. 2 is a block diagram of a control device for a vehicle-mounted refrigerator according to an embodiment of the present invention;
fig. 3 is a block diagram of a control apparatus of an in-vehicle refrigerator according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a method for controlling an on-board refrigerator according to an embodiment of the present invention, where the method includes:
s1, when the preset camera shooting condition is met, controlling the in-car camera to shoot the current user behavior of the in-car user to obtain a user behavior image;
s2, based on a preset user behavior recognition analysis model, recognizing the user behavior of the user behavior image to obtain recognized user behavior;
s3, when the identified user behavior is a preset user behavior type, acquiring a preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior;
and S4, controlling the vehicle-mounted refrigerator according to the control strategy.
It is worth to be noted that the vehicle-mounted refrigerator control method according to the embodiment of the present invention is implemented by a vehicle-mounted controller in a vehicle, where the vehicle-mounted controller is a front-end device of a vehicle monitoring and management system, integrates multiple functions such as data processing and data communication, and has a strong service scheduling function and data processing capability. The vehicle-mounted controller is in communication connection with a camera in a vehicle and the vehicle-mounted refrigerator in advance. The vehicle-mounted controller analyzes the behavior of the user in the vehicle based on an image recognition technology, acquires a control strategy of the corresponding vehicle-mounted refrigerator according to the recognized user behavior belonging to the preset user behavior type, and finally controls the work of the vehicle-mounted refrigerator according to the control strategy.
Specifically, in step S1, the camera shooting condition includes at least one of:
the method comprises the steps of detecting a photographing voice command sent by a user, detecting that a photographing control button in a vehicle is triggered, detecting a cup touching command of the user and detecting a door opening action of the vehicle-mounted refrigerator.
For example, the photographing voice instruction may be triggered by any in-vehicle user, such as a "camera start" voice instruction, a "start photographing" voice instruction, and it can be understood that when the voice photographing instruction is detected, the camera starts immediately to start acquiring the user behavior of the in-vehicle user in real time, and when the photographing end voice instruction is received, the camera is turned off. When a user exists in the vehicle, whether a cup touching instruction of the user exists or not is detected, the cup touching instruction is collision sound between cups or between the cups and other objects, when the cup touching instruction is detected, the user needs to drink water at the moment, the vehicle-mounted refrigerator possibly needs to be opened, the camera is opened at the moment, and the user behavior of the user is acquired in real time; further, the camera may be turned off after a period of time after the camera is turned on.
Specifically, in step S2, the user behavior recognition analysis model may be a CNN (Convolutional neural network) model. The CNN is a feedforward neural network, comprises a convolutional layer and a pooling layer, and has wide application in the field of image recognition. Theoretically, as long as there are enough training samples, the CNN model with the corresponding recognition function can be obtained, the training samples refer to the original data marked with the recognition result, and in the user gesture recognition scene, the training samples are images marked with the gesture information of the user body movement. For example, if the body motion is a gesture, the posture information of the body motion includes a specific gesture, such as a circle, a heart, a square, or a triangle that is made by hand.
Further, in the process of training the user behavior recognition analysis model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
Optionally, the user behavior comprises a limb movement of the user; then, the identifying the user behavior of the user behavior image based on the preset user behavior identification analysis model includes steps S21 to S22:
s21, preprocessing the user behavior image;
s22, inputting the preprocessed user behavior images into a pre-trained user behavior recognition analysis model to obtain the action posture of the user limb; the user behavior recognition analysis model is obtained by training based on a plurality of user behavior image training samples in advance, and the user behavior image training samples contain posture information of the body motions of the user.
It is understood that the preprocessing process may be an image processing operation such as grayscale processing, binarization processing, clipping, and the like, performed on the user behavior image. The user behavior may also be a facial expression of the user, e.g., smiling face, frown, etc. Similarly, the process of identifying and analyzing the facial expression of the user may refer to the process of identifying and analyzing the limb movement of the user, which is not described in detail herein.
Specifically, in step S3, each user behavior type capable of representing the control requirement of the user for the in-vehicle refrigerator may be mapped and stored with the control policy of the in-vehicle refrigerator corresponding to the user behavior type in advance, and the mapping relationship may be stored in a preset mapping list. When the user behavior type is analyzed, the control strategy of the vehicle-mounted refrigerator corresponding to the user behavior type is searched in the mapping list, and the control function of the vehicle-mounted refrigerator which needs to be executed currently is determined.
Optionally, the vehicle-mounted refrigerator comprises a refrigerator body, a shelf body arranged in the refrigerator body and used for placing articles, a driving device used for driving the shelf body to extend out of and retract into the refrigerator body, and a control device used for controlling the driving device; the control strategy then comprises a control strategy for the drive device comprising at least one of:
the driving device drives the shelf body to extend out of the refrigerator body at a speed;
the driving device drives the rack body to retract to the speed of the refrigerator body.
Furthermore, the vehicle-mounted refrigerator also comprises an atmosphere lamp arranged in the refrigerator body or outside the refrigerator body and a control device for controlling the operation of the atmosphere lamp; then, the control strategy may further include: a control strategy for the atmosphere lamp.
Optionally, the obtaining of the preset control policy of the vehicle-mounted refrigerator corresponding to the user behavior includes steps S31 to S33:
s31, carrying out user identification on the in-vehicle user in the user behavior image, and determining the user type of the in-vehicle user; the user types comprise new users and historical users;
s32, when the user in the vehicle is a new user, executing the following control strategy acquisition mode: acquiring a control authority preset for a new user; finding a control strategy corresponding to the user behavior from a control strategy set mapped in advance with the control authority;
s33, when the user in the vehicle is a historical user, executing the following control strategy acquisition mode: analyzing the figure picture of the historical user and acquiring a control authority preset for the historical user; finding a control strategy corresponding to the user behavior from a control strategy set mapped with the portrait and the control authority in advance; the portrait representation includes at least one of: personality traits, control preferences for the on-board refrigerator.
Specifically, in the process of performing recognition analysis on the user behavior, the type of the user in the vehicle needs to be determined. When the user in the vehicle is a new user, the control authority level of the new user is lower, more control functions cannot be executed, and specific functions which can be executed can be preset by a vehicle owner, which is not specifically limited by the invention. Further, the gender of the new user can be judged in the process, and when the new user is a female user, the control habit of the female user in other historical users can be combined to obtain a control strategy corresponding to the control habit; similarly, when the new user is a male user, the control habit of the male user in other historical users can be combined to obtain the control strategy corresponding to the new user.
When the user in the vehicle is a historical user, the control authority level of the historical user is higher, all control functions can be basically executed, and specific functions can be preset by a vehicle owner, which is not specifically limited by the invention. For example, since the historical user is a user who has previously analyzed user behavior, the historical user behavior of the historical user is stored, and the character and the control preference of the historical user for the refrigerator can be analyzed based on the historical user behavior, and the control strategy corresponding to the character and the control preference can be acquired.
Optionally, the step S33 of finding the control policy corresponding to the user behavior from the control policy set pre-mapped with the person representation and the control authority includes steps S331 to S333:
s331, analyzing the behavior action amplitude of the user behavior;
s332, determining the level of the action amplitude of the behavior in a preset action amplitude step;
s333, finding a control strategy corresponding to the level of the behavior action amplitude of the user behavior from a control strategy set mapped in advance with the portrait and the control authority.
As an example, the user behavior is a victory "V" gesture, and an included angle between two fingers of the "V" gesture is analyzed, and the included angle represents the motion amplitude of the "V" gesture. Three action amplitude steps corresponding to the "V" gesture are preset locally, for example, the three action amplitude steps are respectively: the included angle is less than 10 degrees, the included angle is more than or equal to 10 degrees and less than 20 degrees, and the included angle is more than 20 degrees. When the figure image is a control preference of the vehicle-mounted refrigerator, the figure image of the user in the vehicle corresponds to: the control preference of the vehicle-mounted refrigerator is that the pushing speed of the shelf of the vehicle-mounted refrigerator is high; the control authority of the user in the vehicle comprises the following steps: refrigeration control authority to the on-vehicle refrigerator and release control authority to the supporter of on-vehicle refrigerator. The control strategy set corresponding to the figure image and the control authority of the user in the vehicle comprises a refrigeration strategy set of the vehicle-mounted refrigerator and a quick push-out control strategy set of a commodity shelf of the vehicle-mounted refrigerator, the control strategy corresponding to the 'V' gesture of the user behavior is the quick push-out control strategy set of the commodity shelf of the vehicle-mounted refrigerator, and the push-out control strategy set comprises three quick push-out control strategies of the commodity shelf of the vehicle-mounted refrigerator and respectively corresponds to the included angle levels of the three 'V' gestures. The included angle level of the 'V' gesture is less than 10 degrees, and the corresponding push-out control strategy is that the push-out speed of the commodity shelf is 0.05 meters per second as an example; the included angle level of the 'V' gesture is greater than or equal to 10 degrees and less than 20 degrees, and the corresponding push-out control strategy is that the push-out speed of the commodity shelf is 0.08 meters per second as an example; the "V" gesture has an included angle level greater than 20 degrees, which corresponds to a push-out control strategy of 0.1 meters per second for an example push-out speed of the rack.
As another example, the user behavior is a smiling expression of the user facial expression, and a smiling radian of the smiling expression, which represents an action amplitude of the smiling expression, is analyzed. Two smile radian steps corresponding to the smile expressions are preset locally, for example, the smile radians are smaller than 40 degrees respectively, and the smile radians are equal to or larger than 40 degrees. Wherein, this in-car user's control authority includes: the control authority of the display screen of the vehicle-mounted refrigerator and the control authority of the atmosphere lamp of the vehicle-mounted refrigerator. The figure image comprises user characters, and the user characters of the user in the vehicle correspond to: the control strategy set corresponding to the figure image and the control authority of the user in the vehicle is provided with a control strategy set of the display screen of the vehicle-mounted refrigerator and an atmosphere lamp control strategy set of the vehicle-mounted refrigerator, the control strategy set corresponding to the smiling expression of the user is an atmosphere lamp control strategy set of the vehicle-mounted refrigerator, the atmosphere lamp control strategy set comprises atmosphere lamp control strategies of two vehicle-mounted refrigerators and corresponds to the two smiling radian steps respectively. Smile arc steps less than 40 degrees, which corresponds to an ambience light control strategy with an example of red flashing frequency of the ambience light of 5 hz per second; the smile arc step is equal to or greater than 40 degrees, which corresponds to an ambience light control strategy in which the blinking frequency of the red color of the ambience light is illustratively 10 hertz per second.
In the embodiment of the invention, the control strategy corresponding to the user behavior is found through the portrait and the control authority, so that the control on the vehicle-mounted refrigerator can better meet the user requirements of the user, and the use experience of the user is improved.
Optionally, if the user behaviors identified in the same user behavior image include user behaviors of at least two different in-vehicle users, step S3 includes steps S301 to S303:
s301, when the at least two identified user behaviors are both the preset user behavior types, judging whether the at least two user behaviors have a preset conflict relationship based on a preset user behavior conflict judgment logic;
s302, if yes, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; acquiring a control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the user in the vehicle with the highest priority;
s303, if not, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; the method comprises the steps of obtaining control strategies of the vehicle-mounted refrigerator corresponding to the user behaviors of at least two in-vehicle users, and setting execution sequences of the control strategies corresponding to the user behaviors of the at least two in-vehicle users according to the priority of the control authority of the at least two in-vehicle users.
Specifically, the user behavior conflict logic includes a set of conflict relationships between preset user behaviors. For example, the user behavior of the OK gesture and the user behavior of the gesture for holding up the thumb are preset in a conflict relationship, wherein the control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the OK gesture is to start the refrigeration function of the vehicle-mounted refrigerator, and the control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the gesture for holding up the thumb is to close the refrigeration function of the vehicle-mounted refrigerator. For another example, the user behavior of the V gesture and the user behavior of the smiling expression have a preset conflict relationship, the control policy of the on-vehicle refrigerator corresponding to the user behavior of the V gesture is to turn on an atmosphere lamp of the on-vehicle refrigerator, and the control policy of the on-vehicle refrigerator corresponding to the user behavior of the smiling expression is to turn off the atmosphere lamp of the on-vehicle refrigerator.
As an example, when two in-vehicle users make respective user behaviors in the user behavior image captured by the in-vehicle camera, the user behavior image is identified based on a preset user behavior identification analysis model, so that the two identified user behaviors can be obtained and respectively correspond to the two in-vehicle users. At the moment, judging whether the two identified user behaviors are the preset user behavior types or not; and if the two identified user behaviors are both the preset user behavior types, judging whether the two user behaviors have a preset conflict relationship or not based on a preset user behavior conflict judgment logic. If the two user behaviors are an OK gesture and a thumb-holding gesture respectively, judging that the two user behaviors have a preset conflict relationship, and identifying the in-vehicle user in the user behavior image to identify the in-vehicle user corresponding to the two user behaviors; and analyzing the priorities of the control authorities preset by the two in-vehicle users, wherein the priority of the in-vehicle user corresponding to the OK gesture is higher than the priority of the in-vehicle user holding the thumb gesture, and then acquiring the control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the in-vehicle user with the high priority, which is the OK gesture. If the two user behaviors are an OK gesture and a V gesture respectively, judging that the two user behaviors do not have a preset conflict relationship, and identifying the user in the vehicle in the user behavior image to identify the user in the vehicle corresponding to the two user behaviors; analyzing the priority of the control authority preset by the two in-vehicle users; acquiring control strategies of the vehicle-mounted refrigerator corresponding to the user behaviors of the two in-vehicle users, and setting an execution sequence of the control strategies corresponding to the user behaviors of the two in-vehicle users according to the priority of the control authority of the two in-vehicle users, for example, if the priority of the in-vehicle user corresponding to the OK gesture is higher than the priority of the in-vehicle user corresponding to the V gesture, the execution sequence of the control strategies of the two user behaviors is as follows: and executing the control strategy corresponding to the user behavior of the OK gesture, and then executing the control strategy corresponding to the user behavior of the V gesture.
The embodiment of the invention judges whether at least two user behaviors have a preset conflict relationship or not based on the preset user behavior conflict judgment logic, and only acquires the control strategy corresponding to the user behavior of the user in the vehicle with the highest priority to control the vehicle-mounted refrigerator when the preset conflict relationship is judged, so that the control logic of the vehicle-mounted refrigerator is prevented from being disordered to prevent the vehicle-mounted refrigerator from being normally controlled; and when the situation that the preset conflict relationship does not exist is judged, setting the execution sequence of the control strategies corresponding to the at least two user behaviors according to the priorities of the in-vehicle users corresponding to the at least two user behaviors, so that the normal control of the vehicle-mounted refrigerator can be realized based on the control requirements of all in-vehicle users who make the user behaviors analyzed through the user behaviors.
Further, the vehicle-mounted refrigerator control method further comprises the steps of S101-S102:
s101, when a preset automatic door opening condition is met, controlling the door of the vehicle-mounted refrigerator to be opened, and controlling the driving device to drive the shelf body to extend out; wherein, the automatic opening condition of the box door meets: the current date is a preset target date, the current time is in a preset target time period, the position of the vehicle is in a preset target range, and the vehicle is in a preset gear;
and S102, controlling a voice playing device of the vehicle to play voice information corresponding to the target date when the box door is opened.
As an example, the target date may be a particular festival, such as a day of birth, a mid-autumn festival, a christmas day, or a particular anniversary day, such as a user's birthday; the target time period can be the off-duty time of the user and can be set from five to twelve hours in the afternoon; the target range may be a parking lot in the home of the user; the preset gear may be a P gear, which indicates that the user has stopped the vehicle. When the box door is opened, the voice playing device is controlled to play voice information corresponding to the target date, for example, when the target date is the birthday of the user, the voice information of 'wish you happy birthday, champagne is ready and you please enjoy' can be played.
In the embodiment of the invention, the refrigerator can be automatically started according to the application scene preset by the user, and the voice information is played, so that the control on the vehicle-mounted refrigerator can better meet the user requirements of the user, and the use experience of the user is improved.
Furthermore, when the user in the vehicle opens the door of the vehicle-mounted refrigerator in daily life, the method also comprises S201 to S203:
s201, detecting scene conditions of a user in the vehicle;
s202, acquiring corresponding works to be played according to the scene conditions;
s203, controlling a voice playing device in the vehicle to play the works to be played.
In one embodiment, the scene condition is positioning information, and the work to be played is poetry. When a user opens the refrigerator door, the situation that the user needs to relax properly at the moment is indicated, the scene condition where the user is located in the vehicle is detected, and if the situation that the positioning information of the user in the vehicle is detected to be a certain scenic spot, poems related to the scenic spot are obtained and played, and the user can enjoy the poems while enjoying champagne.
In another embodiment, the scene condition is an emotional state, which may include sad emotion, cheerful emotion, mild emotion, etc.; the work to be played is music. The emotional state of the user in the vehicle can be obtained by analyzing the user picture acquired by the camera in the vehicle. When the user opens the refrigerator door, the user picture is analyzed, and when the emotional state of the user is in the sad emotion, relaxed music can be obtained, so that the function of relieving the emotion of the user is achieved.
In the embodiment of the invention, the user can play the corresponding works in combination with the scene condition of the user while opening the refrigerator door, so that the use experience of the user when using the vehicle-mounted refrigerator is improved.
Compared with the prior art, the vehicle-mounted refrigerator control method disclosed by the embodiment of the invention analyzes the behavior of the user in the vehicle based on the image recognition technology, acquires the corresponding control strategy of the vehicle-mounted refrigerator according to the recognized user behavior belonging to the preset user behavior type, and finally controls the work of the vehicle-mounted refrigerator according to the control strategy. Therefore, the control requirement of the user in the vehicle on the vehicle-mounted refrigerator can be identified according to the user behavior, the work of the vehicle-mounted refrigerator is automatically controlled, the user does not need to approach the vehicle-mounted refrigerator and manually control and operate the vehicle-mounted refrigerator, and the user experience is improved.
Referring to fig. 2, fig. 2 is a block diagram of a structure of an in-vehicle refrigerator control apparatus 10 according to an embodiment of the present invention, where the in-vehicle refrigerator control apparatus 10 includes:
the camera starting module 11 is used for controlling the in-vehicle camera to shoot the current user behavior of the in-vehicle user when the preset camera shooting condition is met, so as to obtain a user behavior image;
the user behavior recognition module 12 is configured to recognize a user behavior of the user behavior image based on a preset user behavior recognition analysis model, so as to obtain a recognized user behavior;
the control strategy acquisition module 13 is configured to acquire a preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior when the identified user behavior is a preset user behavior type;
and the control module 14 is used for controlling the vehicle-mounted refrigerator according to the control strategy.
It should be noted that the vehicle-mounted refrigerator control apparatus 10 according to the embodiment of the present invention is a vehicle-mounted controller in a vehicle, and the vehicle-mounted controller is a front-end device of a vehicle monitoring and management system, integrates multiple functions such as data processing and data communication, and has a strong service scheduling function and data processing capability. The vehicle-mounted controller is in communication connection with a camera in a vehicle and the vehicle-mounted refrigerator in advance. The vehicle-mounted refrigerator control device 10 analyzes the behavior of the user in the vehicle based on the image recognition technology, acquires the control strategy of the corresponding vehicle-mounted refrigerator according to the recognized user behavior belonging to the preset user behavior type, and finally controls the work of the vehicle-mounted refrigerator according to the control strategy.
Optionally, the camera shooting condition includes at least one of the following:
the method comprises the steps of detecting a photographing voice command sent by a user, detecting that a photographing control button in a vehicle is triggered, detecting a cup touching command of the user and detecting a door opening action of the vehicle-mounted refrigerator.
Alternatively, the user behavior recognition analysis model may be a CNN (convolutional neural network) model. In the process of training the user behavior recognition analysis model, in order to improve the recognition accuracy and the convergence rate of the model, the training sample may be preprocessed before being input to the model to be trained, specifically, the training sample is subjected to preliminary feature extraction, so as to improve the convergence rate of the model by reducing the calculation amount.
Optionally, the user behavior comprises a limb movement of the user; then, the user behavior recognition module 12 is configured to:
preprocessing the user behavior image;
inputting the preprocessed user behavior images into a pre-trained user behavior recognition analysis model to obtain the action postures of the limbs of the user; the user behavior recognition analysis model is obtained by training based on a plurality of user behavior image training samples in advance, and the user behavior image training samples contain posture information of the body motions of the user.
It is understood that the preprocessing process may be an image processing operation such as grayscale processing, binarization processing, clipping, and the like, performed on the user behavior image. The user behavior may also be a facial expression of the user, e.g., smiling face, frown, etc. Similarly, the process of identifying and analyzing the facial expression of the user may refer to the process of identifying and analyzing the limb movement of the user, which is not described in detail herein.
Optionally, the vehicle-mounted refrigerator comprises a refrigerator body, a shelf body arranged in the refrigerator body and used for placing articles, a driving device used for driving the shelf body to extend out of and retract into the refrigerator body, and a control device used for controlling the driving device; the control strategy then comprises a control strategy for the drive device comprising at least one of:
the driving device drives the shelf body to extend out of the refrigerator body at a speed;
the driving device drives the rack body to retract to the speed of the refrigerator body.
Furthermore, the vehicle-mounted refrigerator also comprises an atmosphere lamp arranged in the refrigerator body or outside the refrigerator body and a control device for controlling the operation of the atmosphere lamp; then, the control strategy may further include: a control strategy for the atmosphere lamp.
Optionally, the control policy obtaining module 13 is configured to:
carrying out user identification on the in-vehicle user in the user behavior image, and determining the user type of the in-vehicle user; the user types comprise new users and historical users;
when the user in the vehicle is a new user, executing the following control strategy acquisition mode: acquiring a control authority preset for a new user; finding a control strategy corresponding to the user behavior from a control strategy set mapped in advance with the control authority;
when the user in the vehicle is a historical user, executing the following control strategy acquisition mode: analyzing the figure picture of the historical user and acquiring a control authority preset for the historical user; finding a control strategy corresponding to the user behavior from a control strategy set mapped with the portrait and the control authority in advance; the portrait representation includes at least one of: personality traits, control preferences for the on-board refrigerator.
Optionally, the finding a control policy corresponding to the user behavior from a control policy set pre-mapped with the portrait and the control authority includes:
analyzing the behavior action amplitude of the user behavior;
determining the level of the action amplitude of the behavior in a preset action amplitude step;
and finding a control strategy corresponding to the level of the action amplitude of the user action from a control strategy set mapped in advance with the portrait and the control authority.
Optionally, if the user behavior identified in the same user behavior image includes user behaviors of at least two different in-vehicle users, the control policy obtaining module 13 is further configured to:
when the at least two identified user behaviors are both preset user behavior types, judging whether the at least two user behaviors have a preset conflict relationship based on preset user behavior conflict judgment logic;
if yes, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; acquiring a control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the user in the vehicle with the highest priority;
if not, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; the method comprises the steps of obtaining control strategies of the vehicle-mounted refrigerator corresponding to the user behaviors of at least two in-vehicle users, and setting execution sequences of the control strategies corresponding to the user behaviors of the at least two in-vehicle users according to the priority of the control authority of the at least two in-vehicle users.
Further, the control module 14 is further configured to:
when a preset automatic door opening condition is met, controlling the door of the vehicle-mounted refrigerator to open, and controlling the driving device to drive the shelf body to extend out; wherein, the automatic opening condition of the box door meets: the current date is a preset target date, the current time is in a preset target time period, the position of the vehicle is in a preset target range, and the vehicle is in a preset gear;
and when the box door is opened, controlling a voice playing device of the vehicle to play voice information corresponding to the target date.
Still further, the control module 14 is further configured to:
detecting scene conditions of a user in a vehicle;
acquiring corresponding works to be played according to the scene conditions;
and controlling a voice playing device in the vehicle to play the works to be played.
It should be noted that please refer to the working process of the vehicle-mounted refrigerator control method according to the above embodiment for the specific working process of each module in the vehicle-mounted refrigerator control apparatus 10, which is not described herein again.
Compared with the prior art, the vehicle-mounted refrigerator control device 10 disclosed by the embodiment of the invention analyzes the behavior of the user in the vehicle based on the image recognition technology, acquires the corresponding control strategy of the vehicle-mounted refrigerator according to the recognized user behavior belonging to the preset user behavior type, and finally controls the work of the vehicle-mounted refrigerator according to the control strategy. Therefore, the control requirement of the user in the vehicle on the vehicle-mounted refrigerator can be identified according to the user behavior, the work of the vehicle-mounted refrigerator is automatically controlled, the user does not need to approach the vehicle-mounted refrigerator and manually control and operate the vehicle-mounted refrigerator, and the user experience is improved.
Referring to fig. 3, fig. 3 is a block diagram of a structure of an in-vehicle refrigerator control apparatus 20 according to an embodiment of the present invention, the in-vehicle refrigerator control apparatus 20 including: a processor 21, a memory 22 and a computer program, such as a driving control program, stored in said memory and executable on said processor. The processor 21, when executing the computer program, implements the steps in the above-described in-vehicle refrigerator control method embodiment, such as steps S1-S4 shown in fig. 1. Alternatively, the processor implements the functions of the modules in the above device embodiments when executing the computer program.
Illustratively, the computer program may be divided into one or more modules, which are stored in the memory 22 and executed by the processor 21 to accomplish the present invention. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program in the in-vehicle refrigerator control apparatus 20. For example, the computer program may be divided into a camera activation module 11, a user behavior recognition module 12, a control policy acquisition module 13, and a control module 14. For the specific working process of each module, reference may be made to the working process of the vehicle-mounted refrigerator control device 10 described in the foregoing embodiment, and details are not repeated here.
The vehicle-mounted refrigerator control device 20 may be a desktop computer, a notebook computer, a palm computer, a cloud server, or other computing devices. The in-vehicle refrigerator control apparatus 20 may include, but is not limited to, a processor 21, a memory 22. It will be understood by those skilled in the art that the schematic diagram is merely an example of an image enhancement device and does not constitute a limitation of the in-vehicle refrigerator control device 20, and may include more or less components than those shown, or combine some components, or different components, for example, the in-vehicle refrigerator control device 20 may further include an input-output device, a network access device, a bus, etc.
The Processor 21 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general processor may be a microprocessor or the processor may be any conventional processor, etc., and the processor 21 is a control center of the in-vehicle refrigerator control apparatus 20 and connects various parts of the entire in-vehicle refrigerator control apparatus 20 by using various interfaces and lines.
The memory 22 may be used to store the computer programs and/or modules, and the processor 21 implements various functions of the in-vehicle refrigerator control apparatus 20 by operating or executing the computer programs and/or modules stored in the memory 22 and calling data stored in the memory 22. The memory 22 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory 22 may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Among them, the modules integrated by the in-vehicle refrigerator control apparatus 20 may be stored in a computer readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (12)
1. A control method for an on-vehicle refrigerator is characterized by comprising the following steps:
when the preset camera shooting conditions are met, controlling an in-car camera to shoot the current user behavior of the user in the car to obtain a user behavior image;
based on a preset user behavior recognition analysis model, recognizing the user behavior of the user behavior image to obtain recognized user behavior;
when the identified user behavior is a preset user behavior type, acquiring a preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior;
and controlling the vehicle-mounted refrigerator according to the control strategy.
2. The method for controlling the vehicle-mounted refrigerator according to claim 1, wherein the obtaining of the preset control strategy of the vehicle-mounted refrigerator corresponding to the user behavior comprises:
carrying out user identification on the in-vehicle user in the user behavior image, and determining the user type of the in-vehicle user; the user types comprise new users and historical users;
when the user in the vehicle is a new user, executing the following control strategy acquisition mode: acquiring a control authority preset for a new user; finding a control strategy corresponding to the user behavior from a control strategy set mapped in advance with the control authority;
when the user in the vehicle is a historical user, executing the following control strategy acquisition mode: analyzing the figure picture of the historical user and acquiring a control authority preset for the historical user; finding a control strategy corresponding to the user behavior from a control strategy set mapped with the portrait and the control authority in advance; the portrait representation includes at least one of: personality traits, control preferences for the on-board refrigerator.
3. The in-vehicle refrigerator control method of claim 2, wherein the finding of the control policy corresponding to the user behavior from the set of control policies pre-mapped with the portrait and the control authority comprises:
analyzing the behavior action amplitude of the user behavior;
determining the level of the action amplitude of the behavior in a preset action amplitude step;
and finding a control strategy corresponding to the level of the action amplitude of the user action from a control strategy set mapped in advance with the portrait and the control authority.
4. The method for controlling the vehicle-mounted refrigerator according to claim 1, wherein if the user behaviors identified in the same user behavior image include user behaviors of at least two different in-vehicle users, the obtaining of the preset control policy of the vehicle-mounted refrigerator corresponding to the user behaviors when the identified user behaviors are of a preset user behavior type comprises:
when the at least two identified user behaviors are both preset user behavior types, judging whether the at least two user behaviors have a preset conflict relationship based on preset user behavior conflict judgment logic;
if yes, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; acquiring a control strategy of the vehicle-mounted refrigerator corresponding to the user behavior of the user in the vehicle with the highest priority;
if not, executing the following control strategy acquisition mode: performing user identification on the in-vehicle users in the user behavior image, and identifying the in-vehicle users corresponding to the at least two user behaviors; analyzing the priorities of control authorities preset by at least two in-vehicle users; the method comprises the steps of obtaining control strategies of the vehicle-mounted refrigerator corresponding to the user behaviors of at least two in-vehicle users, and setting execution sequences of the control strategies corresponding to the user behaviors of the at least two in-vehicle users according to the priority of the control authority of the at least two in-vehicle users.
5. The method for controlling the vehicle-mounted refrigerator according to any one of claims 1 to 4, wherein the vehicle-mounted refrigerator comprises a refrigerator body, a shelf body arranged in the refrigerator body and used for placing articles, a driving device used for driving the shelf body to extend out of and retract into the refrigerator body, and a control device used for controlling the driving device; the control strategy then comprises a control strategy for the drive device comprising at least one of:
the driving device drives the shelf body to extend out of the refrigerator body at a speed;
the driving device drives the rack body to retract to the speed of the refrigerator body.
6. The in-vehicle refrigerator control method according to claim 1, wherein the user behavior includes a limb action of a user; then, the recognizing the user behavior of the user behavior image based on the preset user behavior recognition analysis model includes:
preprocessing the user behavior image;
inputting the preprocessed user behavior images into a pre-trained user behavior recognition analysis model to obtain the action postures of the limbs of the user; the user behavior recognition analysis model is obtained by training based on a plurality of user behavior image training samples in advance, and the user behavior image training samples contain posture information of the body motions of the user.
7. The in-vehicle refrigerator control method of claim 1, wherein the camera shooting condition includes at least one of:
the method comprises the steps of detecting a photographing voice command sent by a user, detecting that a photographing control button in a vehicle is triggered, detecting a cup touching command of the user and detecting a door opening action of the vehicle-mounted refrigerator.
8. The in-vehicle refrigerator control method according to claim 5, characterized by further comprising:
when a preset automatic door opening condition is met, controlling the door of the vehicle-mounted refrigerator to open, and controlling the driving device to drive the shelf body to extend out; wherein, the automatic opening condition of the box door meets: the current date is a preset target date, the current time is in a preset target time period, the position of the vehicle is in a preset target range, and the vehicle is in a preset gear;
and when the box door is opened, controlling a voice playing device of the vehicle to play voice information corresponding to the target date.
9. The method of controlling the in-vehicle refrigerator of claim 1, wherein when a door of the in-vehicle refrigerator is opened, the method further comprises:
detecting scene conditions of a user in a vehicle;
acquiring corresponding works to be played according to the scene conditions;
and controlling a voice playing device in the vehicle to play the works to be played.
10. An in-vehicle refrigerator control apparatus, characterized by comprising:
the camera starting module is used for controlling the camera in the automobile to shoot the current user behavior of the user in the automobile when the preset camera shooting condition is met, so as to obtain a user behavior image;
the user behavior recognition module is used for recognizing the user behavior of the user behavior image based on a preset user behavior recognition analysis model to obtain recognized user behavior;
the control strategy acquisition module is used for acquiring a control strategy of the vehicle-mounted refrigerator, which is preset and corresponds to the user behavior, when the identified user behavior is the preset user behavior type;
and the control module is used for controlling the vehicle-mounted refrigerator according to the control strategy.
11. An in-vehicle refrigerator control apparatus comprising a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, the processor implementing the in-vehicle refrigerator control method according to any one of claims 1 to 9 when executing the computer program.
12. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a stored computer program, wherein the apparatus in which the computer-readable storage medium is located is controlled to perform the in-vehicle refrigerator control method according to any one of claims 1 to 9 when the computer program is executed.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110423365.5A CN113266975B (en) | 2021-04-20 | 2021-04-20 | Vehicle-mounted refrigerator control method, device, equipment and storage medium |
| PCT/CN2022/073687 WO2022166678A1 (en) | 2021-02-03 | 2022-01-25 | Vehicle-mounted storage device, vehicle-mounted refrigerator and automobile |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110423365.5A CN113266975B (en) | 2021-04-20 | 2021-04-20 | Vehicle-mounted refrigerator control method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113266975A true CN113266975A (en) | 2021-08-17 |
| CN113266975B CN113266975B (en) | 2022-12-27 |
Family
ID=77229030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110423365.5A Active CN113266975B (en) | 2021-02-03 | 2021-04-20 | Vehicle-mounted refrigerator control method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113266975B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114488838A (en) * | 2022-01-26 | 2022-05-13 | 深圳美智华科智能科技研究中心有限公司 | Intelligent home control method, electronic equipment and system based on millimeter wave radar |
| WO2022166678A1 (en) * | 2021-02-03 | 2022-08-11 | 华人运通(江苏)技术有限公司 | Vehicle-mounted storage device, vehicle-mounted refrigerator and automobile |
| EP4245581A1 (en) * | 2022-03-17 | 2023-09-20 | Nio Technology (Anhui) Co., Ltd | Vehicle refrigerator control method, storage medium, and vehicle |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108020017A (en) * | 2016-11-03 | 2018-05-11 | 比亚迪股份有限公司 | Control method, the device and system of car refrigerator |
| CN108592306A (en) * | 2018-02-06 | 2018-09-28 | 珠海格力电器股份有限公司 | Electric control method, device and air-conditioning |
| CN109151185A (en) * | 2018-08-01 | 2019-01-04 | 张家港市鸿嘉数字科技有限公司 | A kind of method and device according to vehicle driving scene matching music type |
| CN110070058A (en) * | 2019-04-25 | 2019-07-30 | 信利光电股份有限公司 | A kind of vehicle-mounted gesture identifying device and system |
| CN111552368A (en) * | 2019-05-16 | 2020-08-18 | 毛文涛 | Vehicle-mounted human-computer interaction method and vehicle-mounted equipment |
| CN111625086A (en) * | 2020-04-24 | 2020-09-04 | 爱驰汽车有限公司 | Vehicle interaction method, system, device and storage medium based on user action |
| CN112017646A (en) * | 2020-08-21 | 2020-12-01 | 博泰车联网(南京)有限公司 | Voice processing method and device and computer storage medium |
| CN112307816A (en) * | 2019-07-29 | 2021-02-02 | 北京地平线机器人技术研发有限公司 | In-vehicle image acquisition method and device, electronic equipment and storage medium |
| CN112319220A (en) * | 2020-11-17 | 2021-02-05 | 珠海格力电器股份有限公司 | Vehicle control method, vehicle control device, vehicle and storage medium |
| CN112511746A (en) * | 2020-11-27 | 2021-03-16 | 恒大新能源汽车投资控股集团有限公司 | In-vehicle photographing processing method and device and computer readable storage medium |
| CN112596405A (en) * | 2020-12-17 | 2021-04-02 | 深圳市创维软件有限公司 | Control method, device and equipment of household appliance and computer readable storage medium |
-
2021
- 2021-04-20 CN CN202110423365.5A patent/CN113266975B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108020017A (en) * | 2016-11-03 | 2018-05-11 | 比亚迪股份有限公司 | Control method, the device and system of car refrigerator |
| CN108592306A (en) * | 2018-02-06 | 2018-09-28 | 珠海格力电器股份有限公司 | Electric control method, device and air-conditioning |
| CN109151185A (en) * | 2018-08-01 | 2019-01-04 | 张家港市鸿嘉数字科技有限公司 | A kind of method and device according to vehicle driving scene matching music type |
| CN110070058A (en) * | 2019-04-25 | 2019-07-30 | 信利光电股份有限公司 | A kind of vehicle-mounted gesture identifying device and system |
| CN111552368A (en) * | 2019-05-16 | 2020-08-18 | 毛文涛 | Vehicle-mounted human-computer interaction method and vehicle-mounted equipment |
| CN112307816A (en) * | 2019-07-29 | 2021-02-02 | 北京地平线机器人技术研发有限公司 | In-vehicle image acquisition method and device, electronic equipment and storage medium |
| CN111625086A (en) * | 2020-04-24 | 2020-09-04 | 爱驰汽车有限公司 | Vehicle interaction method, system, device and storage medium based on user action |
| CN112017646A (en) * | 2020-08-21 | 2020-12-01 | 博泰车联网(南京)有限公司 | Voice processing method and device and computer storage medium |
| CN112319220A (en) * | 2020-11-17 | 2021-02-05 | 珠海格力电器股份有限公司 | Vehicle control method, vehicle control device, vehicle and storage medium |
| CN112511746A (en) * | 2020-11-27 | 2021-03-16 | 恒大新能源汽车投资控股集团有限公司 | In-vehicle photographing processing method and device and computer readable storage medium |
| CN112596405A (en) * | 2020-12-17 | 2021-04-02 | 深圳市创维软件有限公司 | Control method, device and equipment of household appliance and computer readable storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022166678A1 (en) * | 2021-02-03 | 2022-08-11 | 华人运通(江苏)技术有限公司 | Vehicle-mounted storage device, vehicle-mounted refrigerator and automobile |
| CN114488838A (en) * | 2022-01-26 | 2022-05-13 | 深圳美智华科智能科技研究中心有限公司 | Intelligent home control method, electronic equipment and system based on millimeter wave radar |
| EP4245581A1 (en) * | 2022-03-17 | 2023-09-20 | Nio Technology (Anhui) Co., Ltd | Vehicle refrigerator control method, storage medium, and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113266975B (en) | 2022-12-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113266975B (en) | Vehicle-mounted refrigerator control method, device, equipment and storage medium | |
| CN108725357B (en) | Parameter control method and system based on face recognition and cloud server | |
| US9501693B2 (en) | Real-time multiclass driver action recognition using random forests | |
| US10339622B1 (en) | Systems and methods for enhancing machine vision object recognition through accumulated classifications | |
| KR20200131883A (en) | Driving condition analysis method and device, driver monitoring system and vehicle | |
| US20140152549A1 (en) | System and method for providing user interface using hand shape trace recognition in vehicle | |
| CN110481419B (en) | Human-vehicle interaction method, system, vehicle and storage medium | |
| CN112959945B (en) | Vehicle window control method and device, vehicle and storage medium | |
| CN113459943B (en) | Vehicle control method, device, equipment and storage medium | |
| CN113589938A (en) | Vehicle-mounted terminal information sharing system with bullet screen function | |
| Zobl et al. | A real-time system for hand gesture controlled operation of in-car devices | |
| CN112820072A (en) | Dangerous driving early warning method and device, computer equipment and storage medium | |
| CN109886070A (en) | A kind of apparatus control method, device, storage medium and equipment | |
| CN112558305A (en) | Control method, device and medium for display picture and head-up display control system | |
| CN111137208B (en) | Method, device and system for controlling illuminating lamp of storage box applied to automobile | |
| CN109131221A (en) | A kind of vehicle starting system and method based on voice and gesture | |
| CN112511746A (en) | In-vehicle photographing processing method and device and computer readable storage medium | |
| CN110705483B (en) | Driving reminding method, device, terminal and storage medium | |
| CN113280562B (en) | Intelligent voice control method, device and equipment for vehicle-mounted refrigerator and storage medium | |
| CN115171678A (en) | Voice recognition method, device, electronic equipment, storage medium and product | |
| CN115107672A (en) | Vehicle control method and vehicle | |
| CN115635969A (en) | Vehicle control method and device and vehicle | |
| CN114760417A (en) | Image shooting method and device, electronic equipment and storage medium | |
| CN113709954A (en) | Atmosphere lamp control method and device, electronic equipment and storage medium | |
| CN207579746U (en) | A kind of vehicular rear mirror system and intelligent automobile |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220209 Address after: Room 208, building 1, No. 69, Donghuan South Road, Yancheng Economic and Technological Development Zone, Jiangsu Province 224000 Applicant after: China Express (Jiangsu) Technology Co.,Ltd. Applicant after: China Express (Shanghai) Cloud Computing Technology Co.,Ltd. Address before: Room 208, building 1, No. 69, Donghuan South Road, Yancheng Economic and Technological Development Zone, Jiangsu Province 224000 Applicant before: China Express (Jiangsu) Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20240222 Granted publication date: 20221227 |
|
| PP01 | Preservation of patent right |