EP3427630A1 - Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine - Google Patents
Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine Download PDFInfo
- Publication number
- EP3427630A1 EP3427630A1 EP18182619.9A EP18182619A EP3427630A1 EP 3427630 A1 EP3427630 A1 EP 3427630A1 EP 18182619 A EP18182619 A EP 18182619A EP 3427630 A1 EP3427630 A1 EP 3427630A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- objects
- image
- dishwashing machine
- washing area
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005406 washing Methods 0.000 title claims abstract description 70
- 238000004851 dishwashing Methods 0.000 title claims abstract description 67
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000006073 displacement reaction Methods 0.000 title claims abstract description 16
- 230000003287 optical effect Effects 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims description 13
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 13
- 230000015654 memory Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 6
- 239000012530 fluid Substances 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 239000003599 detergent Substances 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 239000000843 powder Substances 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/0018—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
- A47L15/0049—Detection or prevention of malfunction, including accident prevention
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/0018—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
- A47L15/0021—Regulation of operational steps within the washing processes, e.g. optimisation or improvement of operational steps depending from the detergent nature or from the condition of the crockery
- A47L15/0028—Washing phases
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/0018—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
- A47L15/006—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control using wireless communication between internal components of the machine
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/14—Washing or rinsing machines for crockery or tableware with stationary crockery baskets and spraying devices within the cleaning chamber
- A47L15/18—Washing or rinsing machines for crockery or tableware with stationary crockery baskets and spraying devices within the cleaning chamber with movably-mounted spraying devices
- A47L15/22—Rotary spraying devices
- A47L15/23—Rotary spraying devices moved by means of the sprays
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
- A47L15/4214—Water supply, recirculation or discharge arrangements; Devices therefor
- A47L15/4219—Water recirculation
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
- A47L15/4295—Arrangements for detecting or measuring the condition of the crockery or tableware, e.g. nature or quantity
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/0018—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
- A47L15/0063—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control using remote monitoring or controlling of the dishwasher operation, e.g. networking systems
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2401/00—Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
- A47L2401/04—Crockery or tableware details, e.g. material, quantity, condition
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2401/00—Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
- A47L2401/24—Spray arms status, e.g. detection of spray arm rotation
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2401/00—Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
- A47L2401/30—Variation of electrical, magnetical or optical quantities
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2501/00—Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
- A47L2501/26—Indication or alarm to the controlling device or to the user
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2501/00—Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
- A47L2501/30—Regulation of machine operational steps within the washing process, e.g. performing an additional rinsing phase, shortening or stopping of the drying phase, washing at decreased noise operation conditions
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L2501/00—Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
- A47L2501/32—Stopping or disabling machine operation, including disconnecting the machine from a network, e.g. from an electrical power supply
Definitions
- the present disclosure relates to a method of automatically assessing the displacement of an object in a washing area of a dishwashing machine, as defined in the preamble of claim 1.
- the present disclosure also relates to a dishwashing machine configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 10.
- the present disclosure further relates to a system composed of a dishwashing machine and a user-handheld portable device configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 13.
- Dishwashing machines are known in the art, which are equipped with optical devices such as still cameras, video cameras or camcorders, located in a fixed or moving position relative to the washing chamber to check the dishware load or degree of cleaning.
- optical devices such as still cameras, video cameras or camcorders
- WO2016008699 and US 2012/0138092 disclose such dishwashing machines.
- the object of the present invention is to provide a method, a dishwashing machine and a system for assessing whether the objects in the washing zone have changed their position, to avoid the above described prior art problems.
- One embodiment of the present invention provides a method and a corresponding dishwashing machine as well as a system composed of a dishwashing machine and a user-handheld portable device that can be used to identify the displacement of objects inside the washing zone of a dishwashing machine, in view of taking actions and restoring the conditions for proper positioning of the obj ects, thereby reducing the need to wash part of the dishware and/or repeat the washing cycle, leading to water, detergent and power consumption.
- numeral 1 designates a dishwashing machine, e.g. of built-in type, located in a kitchen cabinet, the finishing panels being omitted for better illustration of the internal volumes.
- This dishwashing machine 1 comprises a washing area 2 and a door 3 adapted to be closingly associated with the washing area 2.
- the dishwashing machine 1 identifies a base 1A, usually designed to accommodate the mechanisms/devices required to carry out the specific operations of the machine 1.
- the washing area 2 defines the volume in which the objects S, 5 and 7 to be monitored are arranged.
- the washing area 2 is defined by a plurality of walls, such as the base wall 2A, the side walls 2B and 2C, the ceiling 2D and the bottom wall 2E and identifies an upper portion 2' and a lower portion 2".
- upper/lower shall be intended to be related to a proper installation and operation condition of the dishwashing machine 1.
- the term upper designates the portion that is farther from the base 1A
- the term lower designates the portion that is closer to the base 1A.
- the door 3 can be manually operated by the user and/or be power-assisted and has the purpose of hermetically closing the washing area 2 to avoid leakage of washing liquids while the cleaning program is being executed.
- object S, 5 and 7 shall be intended hereinafter as:
- the impellers 5 are well known in the art and will not be further described herein. It shall be simply noted that one or preferably two impellers may be located in the washing area. Namely, the first impeller is located in the lower area 2' proximate to the base 1A and the other is located in the upper area 2", preferably in the lower portion of the upper area.
- a dish rack 21 is situated in the lower area 2' and/or the upper area 2", and has the purpose to accommodate the dishware S, in a manner that is known in the art and will not be further described herein.
- the dishwashing machine 1 comprises a dispenser 6 whose shape defines a volume adapted to accommodate the products required to clean the objects, particularly the dishware.
- these products may be detergent powders or tabs, but also a gel.
- the dispenser 6 may comprise one or more compartments, each designed to receive a particular washing product.
- the dispenser 6 comprises a door 7 which is configured to move between a closed position and a position allowing free access to the internal volume of the dispenser 6.
- the door 7 is moved between the closed position and the open position by being mechanically and/or electrically controlled by the control unit 4, once the door 3 of the dishwashing machine 1 has been closed.
- the dispenser 6 is placed on the door 3, and particularly on the side facing the washing area 2, at a predetermined height. More particularly, the dispenser 6 is housed within the thickness of the door 3.
- the dishwashing machine 1 comprises a control unit 4, e.g. situated within the thickness of the door 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program.
- a control unit 4 e.g. situated within the thickness of the door 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program.
- the control unit 4 is a unit configured to control and supervise the operating functions of the dishwashing machine 1.
- the memory of the control unit 4 is designed to also permanently store a database in which the contours of the objects S, 5 and 7 are identified by means of appropriate parameters.
- the objects S, 5 and 7 are advantageously identified in the database by one or more digital parameters that can represent the contour of the objects S, 5 and 7.
- digital parameters that can represent the contour of the objects S, 5 and 7.
- the so-called mathematics that represent these devices are already known to the manufacturer of the dishwashing machine 1, but the dishware S is designed to be identified using a particular imaging process.
- the dishwashing machine 1 comprises a pump, for example arranged in the base 1A, which is adapted to be connected, in a manner that is known to a skilled person and will not be described herein, to a water mains supply.
- this pump is controlled by a solenoid valve and has the purpose of withdrawing water from the mains and supply it to the impellers 5 arranged in the washing area 2.
- the dishwashing machine 1 comprises one or more optical devices 8 that can capture digital images of the washing area 2.
- the optical devices 8 are arranged with their optical system facing the washing area 2.
- each wall 2A, 2B, 2C, 2D and/or 2E of the washing area 2 can accommodate one or more of the aforementioned optical devices 8 in its thickness
- a housing 2F for each optical device 8 is provided for this purpose.
- the housing 2F defines a volume adapted to accommodate its respective optical device and a light-transparent covering panel 8A preferably covers the optical system of the optical device.
- This covering panel 8A is made, for example, of glass or plastic or materials having similar technical properties.
- the covering panel 8A is preferably arranged substantially flush with or slightly projecting out of the surface of the wall 2A, 2B, 2C, 2D or 2E.
- the housing 2F formed in the thickness of the door 3 of the dishwashing machine 2. As shown in this Figure 5 , all the electrical and electronic parts required for the operation of the optical device 8 are accommodated in the housing 2F.
- the purpose of the optical devices 8 in the dishwashing machine 1 is to capture still and/or sequential two-dimensional digital images at predetermined capturing speeds, usually in the visible range of the electromagnetic spectrum, such as a single frame, or a burst of images, or an seamless stream of images of the washing area 2 and particularly of the objects S, 5, 7 in this washing area.
- the optical device 8 has a field of view 8B, allowing acquisition of images of the objects S, 5 and/or 7 that fall within such field of view.
- optical devices 8 are in signal communication with the control unit 4 via the I/O ports of the latter to send the acquired data to the control unit 4.
- the optical devices 8 are embodied, for example, by a still camera and/or a video camera. These devices are known in the art and will not be described in further detail herein.
- the still camera and/or the video camera as used in the dishwashing machine 1 preferably comply with the technical specifications for operation with water, i.e. the still camera and/or the video camera comply with the standard IP x(1-8).
- the housing 2F in which the optical devices 8 are placed is configured to be watertight, e.g. using sealing techniques.
- the dishwashing machine 1 comprises a user interface 9, i.e. the control and monitoring interface through which the user may control and manage the operation and functions of the dishwashing machine.
- the user interface 9 is in signal communication with the control unit 4 via the I/O ports of the latter to receive the data processed by the CPU of the control unit.
- the user interface 9 is a screen 23 which is integrated in the dishwashing machine 1 to be visible by a user during normal operation and/or with the addition of a buzzer (not shown).
- the user interface 9 is integrated in the door 3 with such an orientation that the screen faces out of the washing area 2.
- the screen of the user interface 9 is configured to display light indications, text messages and/or single or continuous images.
- the images displayed on screen may be the images of the washing area 2 and the objects therein provided acquired by the optical devices 8.
- the screen may be a touch (i.e. touch sensitive) screen.
- the user interface 9 comprises one or more analog buttons and/or a combination of analog/digital controls and/or a combination of analog/digital controls and a screen, the latter being, for instance, a touchscreen.
- the buzzer of the user interface 9 has the purpose of providing acoustic warnings of any situations or operating conditions to the user.
- the dishwashing machine 1 comprises a radio transmitting/receiving apparatus, which is configured to provide signal communication with a wired and/or wireless network.
- the wireless network may be an Internet protocol-based network that uses a WI-FI connection or a Bluetooth-based WPAN (Wireless Personal Area Network).
- the user interface 9 also comprises a portable device (i.e. a device that can be carried and held in a user's hand) 22 such as a smartphone, a tablet, a PC or similar instruments.
- a portable device i.e. a device that can be carried and held in a user's hand
- a smartphone such as a smartphone, a tablet, a PC or similar instruments.
- the user interface 9 comprises both the usual control interface of the dishwashing machine 1 and the screen of a portable device 22.
- the portable device 22 has its own radio transmitting/receiving apparatus, which is configured to establish a signal communication with the radio transmitting/receiving apparatus of the dishwashing machine 1.
- the portable device 22 is not only able to communicate with the control unit 4 of the dishwashing machine 1, but also to connect through the Internet network, for example via a GSM infrastructure, to one or more remote servers 24 to carry out storage, saving and/or data processing operations on the images that have been captured by the optical devices 8.
- the portable device 22 is adapted to connect either directly with the dishwashing machine 1 and with the Internet network via the GSM infrastructure.
- a system 25 is provided which comprises the dishwashing machine 1, the portable device 22 which are in signal communication with each other via the GSM network, a WI-FI connection and/or a WPAN.
- the screen of the portable device 22 is configured to display light indications, text messages and/or images captured by the optical devices 8.
- the database in which the contours of the objects S, 5 and 7, are identified through appropriate parameters may be stored at least partially, preferably entirely, in the memory of the portable device 22, in a mass storage of the server and/or be distributed in the memories of the dishwashing machine 1, the portable device 22 and the server 23.
- control unit 4 is in signal communication with the user interface 9 (provided either as the screen of the dishwashing machine 1 or as a screen of the portable device) to transmit changes of the operating state of the dishwashing machine 1.
- a change of the operating state is intended to designate any change of the function of the dishwashing machine 1 resulting from the displacement of one or more objects S, 5 or 7 to a position that cannot ensure proper operation, i.e. to a state in which one or more problems occur.
- these problems particularly include:
- the identification of one or more of the aforementioned problems does not affect the execution of the cleaning program, i.e. the cleaning program that has been set will be completed in spite of the detected problem/s.
- the cleaning program is designed to be stopped either automatically, i.e. by the control unit 4, or manually, i.e. by the user. This situation is restored as soon as the user solves the detected problems, for the initially selected program to be completed.
- the cleaning program may be designed to be changed, or modified automatically by the control unit 4, to account for the detected problem.
- the cleaning program being executed may be changed by the control unit 4 by increasing the water supply time (i.e. duration) to compensate for the detected problem.
- the visual indications that can be displayed on the screen of the user interface 9 in addition to the usual indications known in the art, can provide warning of possible changes of the operating states of the dishwashing machine 1.
- the method of automatically assessing the displacement of an object S, 5 and/or 7, i.e. a dishware item and/or of a component of the dishwashing machine 1 in a washing area 2 includes a step 10 of providing a plurality of objects S, 5, 7 in the washing area 2.
- the method steps as described hereinbelow i.e. the steps of acquiring, processing, filtering, comparing and dividing may be carried out either directly by the CPU of the control unit 4 or more preferably by the CPU of the portable user device via the Internet connection with the CPU of remote servers for analysis and data processing.
- the method comprises a step of acquiring a first digital image 11 representative of the plurality of objects S, 5 and/or 7.
- This acquisition step is carried out through the or optical device/s 8 located in the washing area 2.
- the first digital image is preferably acquired after closing the door 3 but before starting the cleaning program.
- control unit 4 supervises the acquisition step by controlling the or optical device/s 8 once the door 3 has been closed before the start of the cleaning program.
- the method comprises a step 12 of digitally processing the first acquired image 11 to obtain a first processed image 12A; wherein said first processed image 12A defines a first contour for each object of said plurality of objects S, 5 and/or 7.
- control unit 4 and/or the portable user device starts a process in which the first image 11 is processed to define the contour of each of the objects S, 5 and/or 7 in the washing area 2, which may be either dishware and/or components of the dishwashing machine.
- the first processed image 12A represents the initial image, i.e. an image of the initial arrangement of the objects S, 5 and/or 7 whose displacement is to be assessed.
- the method comprises a filtering step 13 that, based on the first contour of each object, filters the first processed image 12a to obtain a first filtered image 13A.
- This first filtered image 13a defines a first group of objects 13B, this first group of objects representing the objects 5 and/or 7 of the plurality of objects S, 5 and/or 7 that are movable relative to the washing area 2.
- the contours of the objects in the first processed image 12A may be distinguished to obtain a first filtered image 13A that only contains the contours of the objects that are movable relative to the washing area 2.
- the first group of objects 13b comprises the objects that are expected to move relative to the washing area 2 during the cleaning program, being these objects components of the dishwashing machine 1.
- These objects of the first group of objects 13b are, for example, the impeller/s 5 and the door 7 of the dispenser 6.
- the impeller/s 5 must move relative to the washing area to introduce an uniform flow of water and detergent products into the washing area 2
- the movement is a rotary movement about a central point, which is typically the center of gravity.
- the door 7 of the dispenser 6 is required to move from the closed configuration to the open configuration.
- the filtering step 13 may be implemented, for example, by comparing the contours that have been identified with the contours stored in a database that resides in the memory of the control unit 4 or in the memory of the portable user device or in a server remote from both the dishwashing machine 1 and the user hand-held device.
- the contours of the impellers 5 and/or the door 7 of the dispenser 6 are known to the manufacturer of the dishwashing machine 1 and can be stored beforehand and directly compared with those in the first processed image 12A.
- the other contours in the first processed image 12A i.e. the contours that are not part of the first group 13B, belong to a second group of objects 13D which, as described below, defines the objects S that are stationary relative to the washing area 2.
- the term objects that are stationary relative to the washing area 2 or movable relative to the washing area 2 is intended to indicate that:
- the method comprises the step of acquiring a second image 14 representative of the first group of objects 13B once a first preset period of time T1 has elapsed from the start of a cleaning program.
- this first period of time T1 must be greater than a few seconds, affording a check on whether the objects of the first group 13b have moved or are moving in the washing area 2.
- this first period of time T1 is greater than three seconds and not greater than four minutes. During this interval, a check may be made on whether the impeller/s 5 are rotating and that the door 7 of the dispenser 6 has been actually opened.
- the optical devices 8 that are preferably used to acquire the second image 14 are those placed in the lower portion 2' of the washing area 2.
- the method comprises a step 15 of digitally processing the second acquired image 14 to obtain a second processed image 15A, wherein this second processed image 15A defines a second contour for each object of said first group of objects 13B.
- the method comprises a step 16 of comparing the first filtered image 13A with the second processed image 15A to assess whether the first contour of each object of said first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A a critical change-of-operating-state condition through the user interface 9.
- control unit 4 will actuate the optical device/s 8 to acquire the second image 15A to check whether the contour of the objects of the first group of objects 13b has been moved or is moving.
- control unit 4 can check whether they are moved, to indicate a first critical condition 16A through the user interface 9, if an obstacle blocks their movement.
- the signal associated with the first critical condition 16A allows the user to learn through the interface 9 whether:
- the cleaning program downstream from (or possibly at the same time as) the step of indicating the first critical condition 16A, the cleaning program is designed to proceed as expected, be changed in response to this first critical condition 16A that has been detected or stopped until the normal operating conditions will be restored.
- the step of filtering 13 according to the first contour of each object can filter the first processed image 12a to additionally or alternatively obtain a second filtered image 13C, the second filtered image defining a second group of objects 13D.
- This second group of objects 13D represents the objects S of the plurality of objects S, 5 and 7 that are stationary relative to the washing area 2.
- the objects that are required to be stationary relative to the washing area 2 are the dishware S.
- the method comprises a step of acquiring a third image 18 representative of the second group of objects once a second preset period of time T2 has elapsed from the start of the cleaning program.
- this second period of time T2 must be greater than a few seconds, affording a check on whether the objects of the second group are still, i.e. do not move in the washing area 2.
- this second period of time T2 is greater than one minute.
- the optical devices 8 that are preferably used to acquire the third image 18 are those placed in the side walls 2B and 2C.
- the method comprises the step 19 of digitally processing the third acquired image 18 to obtain a third processed image 19A, wherein this third processed image 19A defines a second contour for each object of said second group of objects 13D.
- the method comprises a step 20 of comparing the second filtered image 13C with the third processed image 19A to assess whether the first contour of each object of the second group of objects 13B coincides with the respective second contour and, if it doesn't, notifying 20A a critical change-of-operating-state condition through the user interface 9.
- the method includes repeating the steps 14, 15 and 16, namely acquiring the second image representative of the first group of objects 13B, once the first preset period of time T1 from the start of the cleaning program has elapsed, at regular or random intervals, to thereby provide a plurality of second images, spaced in time, representative of the position of the first group of objects 13B relative to the washing area 2.
- a comparison may be made with the first filtered image 13A, to assess whether the first contour of each object of the first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A the change-of-operating-state condition through the user interface 9.
- control unit 4 instructs the optical device/s 8 to acquire additional second images 14, the acquisition occurring at regular or random intervals.
- These second images 14 are processed to define the new contours of the objects.
- These new contours are compared with the respective contours of the first filtered image 13A to assess whether a displacement has occurred. If the contours coincide, a change of the operating state is notified through the user interface 9.
- the method comprises the same procedure for the second group of objects 13D, with the exception that a change of the operating state is notified if the new contours do not coincide with those of the second filtered image.
- the method includes repeating the steps 18, 19 and 20 to assess, by a comparison with the second filtered image 13C, whether the first contour of each object of the second group of objects 13D coincides with the respective second contour and, if it doesn't, notifying 20A a second critical change-of-operating-state condition through the user interface 9.
- the signal associated with the second critical condition 20A allows the user to learn through the interface 9 whether the dishware S have changed their position.
- the cleaning program downstream from (or possibly at the same time as) the step of indicating the second critical condition 20A, the cleaning program is designed to proceed as expected, be changed in response to this second critical condition 20A that has been detected or stopped until the normal operating conditions will be restored.
- the processing steps 12, 15 and 19 comprise a process through which the images 13A, 13C are divided, with a reference grid being placed thereon, to compare the grid with the respective grid of the images 15A and 19A acquired at later times.
- an assessment may be made of whether the objects of the first group 13b have moved or the objects of the second group are still stationary relative to the washing area 2.
- the comparison of the contour of an object that lies within a grid of the initial image with the corresponding grid of the next image in time allows appreciation of a possible displacement (or non-displacement) of the object being captured.
- the method and the dishwashing machine 1 allow a change of the operating state of the machine to be notified through the user interface 9, allowing actions to be taken to restore the proper installation conditions of the object. This will reduce the need to wash part of the dishware and/or repeat the washing cycle, leading the water, detergent and power consumption.
Landscapes
- Engineering & Computer Science (AREA)
- Water Supply & Treatment (AREA)
- Computer Networks & Wireless Communication (AREA)
- Washing And Drying Of Tableware (AREA)
Abstract
Description
- The present disclosure relates to a method of automatically assessing the displacement of an object in a washing area of a dishwashing machine, as defined in the preamble of
claim 1. - The present disclosure also relates to a dishwashing machine configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of
claim 10. - The present disclosure further relates to a system composed of a dishwashing machine and a user-handheld portable device configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of
claim 13. - Dishwashing machines are known in the art, which are equipped with optical devices such as still cameras, video cameras or camcorders, located in a fixed or moving position relative to the washing chamber to check the dishware load or degree of cleaning.
- For example,
WO2016008699 andUS 2012/0138092 disclose such dishwashing machines. - During operation of a dishwashing machine of the above-discussed type, conditions may occur that might degrade the washing and drying performance on the entire load and/or on part of the dishware loaded in the washing area.
- This may be also caused by the fact that, in certain cases, the dishware loaded on the racks by a user might:
- be displaced due to unstable positioning thereof on the rack;
- be displaced due to the mechanical action of the washing fluid;
- be displaced due to water weight;
- block the rotation of the impellers used to distribute the fluid on the dishware;
- block the detergent dispenser door.
- The object of the present invention is to provide a method, a dishwashing machine and a system for assessing whether the objects in the washing zone have changed their position, to avoid the above described prior art problems.
- This object is fulfilled by a method, a dishwashing machine and a system for automatically assessing the displacement of an object in a washing area of a dishwashing machine as defined in the following
claims - One embodiment of the present invention provides a method and a corresponding dishwashing machine as well as a system composed of a dishwashing machine and a user-handheld portable device that can be used to identify the displacement of objects inside the washing zone of a dishwashing machine, in view of taking actions and restoring the conditions for proper positioning of the obj ects, thereby reducing the need to wash part of the dishware and/or repeat the washing cycle, leading to water, detergent and power consumption.
- The characteristics and advantages of the present disclosure will appear from the following detailed description of a possible practical embodiment, illustrated as a nonlimiting example in the set of drawings, in which:
-
Figure 1 shows a flowchart of the method of the present invention; -
Figure 2 shows a front perspective view of a built-in dishwashing machine with the omission of the finishing panels, which is configured to carry out the method ofFigure 1 ; -
Figure 3 shows a rear perspective view of the dishwashing machine ofFigure 2 with the omission of some of its parts and the dishware; -
Figure 4 shows a detail view of a zone proximate to the dispenser, when the latter is equipped with an optical device of the dishwashing machine ofFigure 2 , according to the present invention; -
Figure 5 shows a cross sectional view as taken along line V- V ofFigure 4 . - Even when this is not expressly stated, the individual features as described with reference to the particular embodiments shall be intended as auxiliary to and/or interchangeable with other features described with reference to other exemplary embodiments.
- Referring to the accompanying
figures 2 to 5 ,numeral 1 designates a dishwashing machine, e.g. of built-in type, located in a kitchen cabinet, the finishing panels being omitted for better illustration of the internal volumes. - This
dishwashing machine 1 comprises awashing area 2 and adoor 3 adapted to be closingly associated with thewashing area 2. - The
dishwashing machine 1 identifies abase 1A, usually designed to accommodate the mechanisms/devices required to carry out the specific operations of themachine 1. - The
washing area 2 defines the volume in which the objects S, 5 and 7 to be monitored are arranged. - Namely, the
washing area 2 is defined by a plurality of walls, such as thebase wall 2A, theside walls ceiling 2D and thebottom wall 2E and identifies an upper portion 2' and alower portion 2". - The terms upper/lower shall be intended to be related to a proper installation and operation condition of the dishwashing
machine 1. Here, the term upper designates the portion that is farther from thebase 1A, and the term lower designates the portion that is closer to thebase 1A. - The
door 3 can be manually operated by the user and/or be power-assisted and has the purpose of hermetically closing thewashing area 2 to avoid leakage of washing liquids while the cleaning program is being executed. - The term object S, 5 and 7 shall be intended hereinafter as:
- a dishware item S, such as a dish, a piece of cutlery, a glass, a pot, or
- a part of the dishwashing machine itself, such as an
impeller 5 for introducing washing liquid into the washing area or adoor 7 of a detergent-containingdispenser 6. - The
impellers 5 are well known in the art and will not be further described herein. It shall be simply noted that one or preferably two impellers may be located in the washing area. Namely, the first impeller is located in the lower area 2' proximate to thebase 1A and the other is located in theupper area 2", preferably in the lower portion of the upper area. - A
dish rack 21 is situated in the lower area 2' and/or theupper area 2", and has the purpose to accommodate the dishware S, in a manner that is known in the art and will not be further described herein. - The
dishwashing machine 1 comprises adispenser 6 whose shape defines a volume adapted to accommodate the products required to clean the objects, particularly the dishware. - For example, these products may be detergent powders or tabs, but also a gel.
- The
dispenser 6 may comprise one or more compartments, each designed to receive a particular washing product. - In one aspect, the
dispenser 6 comprises adoor 7 which is configured to move between a closed position and a position allowing free access to the internal volume of thedispenser 6. - For example, when the
door 7 is in the closed position, products cannot come out of their respective compartments, and when thedoor 7 is in the open position, these washing products are allowed to come out. - The
door 7 is moved between the closed position and the open position by being mechanically and/or electrically controlled by thecontrol unit 4, once thedoor 3 of thedishwashing machine 1 has been closed. - In one aspect, also referring to
Figure 4 , thedispenser 6 is placed on thedoor 3, and particularly on the side facing thewashing area 2, at a predetermined height. More particularly, thedispenser 6 is housed within the thickness of thedoor 3. - The
dishwashing machine 1 comprises acontrol unit 4, e.g. situated within the thickness of thedoor 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program. - The
control unit 4 is a unit configured to control and supervise the operating functions of thedishwashing machine 1. - In one embodiment of the present invention, the memory of the
control unit 4 is designed to also permanently store a database in which the contours of the objects S, 5 and 7 are identified by means of appropriate parameters. - The objects S, 5 and 7 are advantageously identified in the database by one or more digital parameters that can represent the contour of the objects S, 5 and 7. For example, for an
impeller 5 or thedoor 7 of thedispenser 6, the so-called mathematics that represent these devices are already known to the manufacturer of thedishwashing machine 1, but the dishware S is designed to be identified using a particular imaging process. - In order to execute the selected cleaning program, the
dishwashing machine 1 comprises a pump, for example arranged in thebase 1A, which is adapted to be connected, in a manner that is known to a skilled person and will not be described herein, to a water mains supply. - For example, this pump is controlled by a solenoid valve and has the purpose of withdrawing water from the mains and supply it to the
impellers 5 arranged in thewashing area 2. - The
dishwashing machine 1 comprises one or moreoptical devices 8 that can capture digital images of thewashing area 2. - In one aspect, the
optical devices 8 are arranged with their optical system facing thewashing area 2. - Namely, each
wall washing area 2 can accommodate one or more of the aforementionedoptical devices 8 in its thickness, - A
housing 2F for eachoptical device 8 is provided for this purpose. - The
housing 2F defines a volume adapted to accommodate its respective optical device and a light-transparent covering panel 8A preferably covers the optical system of the optical device. - This covering
panel 8A is made, for example, of glass or plastic or materials having similar technical properties. - The
covering panel 8A is preferably arranged substantially flush with or slightly projecting out of the surface of thewall - Particularly referring to
Figure 5 , thehousing 2F formed in the thickness of thedoor 3 of thedishwashing machine 2. As shown in thisFigure 5 , all the electrical and electronic parts required for the operation of theoptical device 8 are accommodated in thehousing 2F. - The purpose of the
optical devices 8 in thedishwashing machine 1 is to capture still and/or sequential two-dimensional digital images at predetermined capturing speeds, usually in the visible range of the electromagnetic spectrum, such as a single frame, or a burst of images, or an seamless stream of images of thewashing area 2 and particularly of the objects S, 5, 7 in this washing area. - For example, still referring to
Figure 5 , it may be appreciated that theoptical device 8 has a field ofview 8B, allowing acquisition of images of the objects S, 5 and/or 7 that fall within such field of view. - These
optical devices 8 are in signal communication with thecontrol unit 4 via the I/O ports of the latter to send the acquired data to thecontrol unit 4. - The
optical devices 8 are embodied, for example, by a still camera and/or a video camera. These devices are known in the art and will not be described in further detail herein. - Nevertheless, it shall be noted that the still camera and/or the video camera as used in the
dishwashing machine 1 preferably comply with the technical specifications for operation with water, i.e. the still camera and/or the video camera comply with the standard IP x(1-8). - Instead of or in addition to these technical specifications, the
housing 2F in which theoptical devices 8 are placed, is configured to be watertight, e.g. using sealing techniques. - The
dishwashing machine 1 comprises auser interface 9, i.e. the control and monitoring interface through which the user may control and manage the operation and functions of the dishwashing machine. - For this purpose, the
user interface 9 is in signal communication with thecontrol unit 4 via the I/O ports of the latter to receive the data processed by the CPU of the control unit. - In one embodiment, the
user interface 9 is ascreen 23 which is integrated in thedishwashing machine 1 to be visible by a user during normal operation and/or with the addition of a buzzer (not shown). - In one aspect, still referring to
figures 1 and2 , theuser interface 9 is integrated in thedoor 3 with such an orientation that the screen faces out of thewashing area 2. - It shall be noted that the screen of the
user interface 9 is configured to display light indications, text messages and/or single or continuous images. Namely, the images displayed on screen may be the images of thewashing area 2 and the objects therein provided acquired by theoptical devices 8. Particularly, the screen may be a touch (i.e. touch sensitive) screen. - In another embodiment, the
user interface 9 comprises one or more analog buttons and/or a combination of analog/digital controls and/or a combination of analog/digital controls and a screen, the latter being, for instance, a touchscreen. - The buzzer of the
user interface 9 has the purpose of providing acoustic warnings of any situations or operating conditions to the user. - In one embodiment, the
dishwashing machine 1 comprises a radio transmitting/receiving apparatus, which is configured to provide signal communication with a wired and/or wireless network. For instance, the wireless network may be an Internet protocol-based network that uses a WI-FI connection or a Bluetooth-based WPAN (Wireless Personal Area Network). - In this case, the
user interface 9 also comprises a portable device (i.e. a device that can be carried and held in a user's hand) 22 such as a smartphone, a tablet, a PC or similar instruments. - In other words, the
user interface 9 comprises both the usual control interface of thedishwashing machine 1 and the screen of aportable device 22. - Particularly, the
portable device 22 has its own radio transmitting/receiving apparatus, which is configured to establish a signal communication with the radio transmitting/receiving apparatus of thedishwashing machine 1. - In one aspect, the
portable device 22 is not only able to communicate with thecontrol unit 4 of thedishwashing machine 1, but also to connect through the Internet network, for example via a GSM infrastructure, to one or moreremote servers 24 to carry out storage, saving and/or data processing operations on the images that have been captured by theoptical devices 8. - In other words, the
portable device 22 is adapted to connect either directly with thedishwashing machine 1 and with the Internet network via the GSM infrastructure. Thus, asystem 25 is provided which comprises thedishwashing machine 1, theportable device 22 which are in signal communication with each other via the GSM network, a WI-FI connection and/or a WPAN. - It shall be noted that the screen of the
portable device 22 is configured to display light indications, text messages and/or images captured by theoptical devices 8. - In one embodiment of the present invention, if the
user interface 9 also includes theportable device 22, then the database in which the contours of the objects S, 5 and 7, are identified through appropriate parameters may be stored at least partially, preferably entirely, in the memory of theportable device 22, in a mass storage of the server and/or be distributed in the memories of thedishwashing machine 1, theportable device 22 and theserver 23. - In one aspect, the
control unit 4 is in signal communication with the user interface 9 (provided either as the screen of thedishwashing machine 1 or as a screen of the portable device) to transmit changes of the operating state of thedishwashing machine 1. - As used herein, a change of the operating state is intended to designate any change of the function of the
dishwashing machine 1 resulting from the displacement of one or more objects S, 5 or 7 to a position that cannot ensure proper operation, i.e. to a state in which one or more problems occur. - In one aspect, these problems particularly include:
- a
component - a dishware item S that has moved from its initial position, for instance to such a position in which it cannot be properly washed and/or dried or to a position in which it will block the movement of the components (for example the rotation of the impellers, or the movement of the door of the dispenser from the closed configuration to the open configuration) of the dishwashing machine.
- In one embodiment, the identification of one or more of the aforementioned problems does not affect the execution of the cleaning program, i.e. the cleaning program that has been set will be completed in spite of the detected problem/s.
- Alternatively, upon detection of one or more of the aforementioned problems, the cleaning program is designed to be stopped either automatically, i.e. by the
control unit 4, or manually, i.e. by the user. This situation is restored as soon as the user solves the detected problems, for the initially selected program to be completed. - In a further alternative embodiment, upon detection of one or more of the aforementioned problems, the cleaning program may be designed to be changed, or modified automatically by the
control unit 4, to account for the detected problem. - For example, in case of changes to the cleaning program, if for instance, the detected problem is a displacement of a dishware item S from its reference position (which affects the washing efficiency), the cleaning program being executed may be changed by the
control unit 4 by increasing the water supply time (i.e. duration) to compensate for the detected problem. - Therefore, the visual indications that can be displayed on the screen of the
user interface 9, in addition to the usual indications known in the art, can provide warning of possible changes of the operating states of thedishwashing machine 1. - Referring now to
Figure 1 , the method of automatically assessing the displacement of an object S, 5 and/or 7, i.e. a dishware item and/or of a component of thedishwashing machine 1 in awashing area 2, includes astep 10 of providing a plurality of objects S, 5, 7 in thewashing area 2. - It shall be noted that the method steps as described hereinbelow, i.e. the steps of acquiring, processing, filtering, comparing and dividing may be carried out either directly by the CPU of the
control unit 4 or more preferably by the CPU of the portable user device via the Internet connection with the CPU of remote servers for analysis and data processing. - The method comprises a step of acquiring a first
digital image 11 representative of the plurality of objects S, 5 and/or 7. - This acquisition step is carried out through the or optical device/
s 8 located in thewashing area 2. - The first digital image is preferably acquired after closing the
door 3 but before starting the cleaning program. - For this purpose, the
control unit 4 supervises the acquisition step by controlling the or optical device/s 8 once thedoor 3 has been closed before the start of the cleaning program. - Once the first image has been acquired, the method comprises a
step 12 of digitally processing the first acquiredimage 11 to obtain a first processedimage 12A; wherein said first processedimage 12A defines a first contour for each object of said plurality of objects S, 5 and/or 7. - In other words, the
control unit 4 and/or the portable user device starts a process in which thefirst image 11 is processed to define the contour of each of the objects S, 5 and/or 7 in thewashing area 2, which may be either dishware and/or components of the dishwashing machine. - It shall be noted that the first processed
image 12A represents the initial image, i.e. an image of the initial arrangement of the objects S, 5 and/or 7 whose displacement is to be assessed. - The method comprises a
filtering step 13 that, based on the first contour of each object, filters the first processed image 12a to obtain a firstfiltered image 13A. This first filtered image 13a defines a first group ofobjects 13B, this first group of objects representing theobjects 5 and/or 7 of the plurality of objects S, 5 and/or 7 that are movable relative to thewashing area 2. - In other words, by applying the
filter 13, the contours of the objects in the first processedimage 12A may be distinguished to obtain a firstfiltered image 13A that only contains the contours of the objects that are movable relative to thewashing area 2. - Therefore, the first group of objects 13b comprises the objects that are expected to move relative to the
washing area 2 during the cleaning program, being these objects components of thedishwashing machine 1. These objects of the first group of objects 13b are, for example, the impeller/s 5 and thedoor 7 of thedispenser 6. - The impeller/
s 5 must move relative to the washing area to introduce an uniform flow of water and detergent products into thewashing area 2 The movement is a rotary movement about a central point, which is typically the center of gravity. - Likewise, for the detergent materials to be mixed with water, the
door 7 of thedispenser 6 is required to move from the closed configuration to the open configuration. - The
filtering step 13 may be implemented, for example, by comparing the contours that have been identified with the contours stored in a database that resides in the memory of thecontrol unit 4 or in the memory of the portable user device or in a server remote from both thedishwashing machine 1 and the user hand-held device. - Namely, the contours of the
impellers 5 and/or thedoor 7 of thedispenser 6 are known to the manufacturer of thedishwashing machine 1 and can be stored beforehand and directly compared with those in the first processedimage 12A. - The other contours in the first processed
image 12A, i.e. the contours that are not part of thefirst group 13B, belong to a second group ofobjects 13D which, as described below, defines the objects S that are stationary relative to thewashing area 2. - As used herein, the term objects that are stationary relative to the
washing area 2 or movable relative to thewashing area 2 is intended to indicate that: - in the former case, the spatial coordinates identifying one or more characteristic features of the objects (e.g. the edge of a dish, the bottom of a glass, etc.) will be unchanged with respect to the reference system represented by the
washing area 2 during the cleaning program (i.e. the coordinates are time-invariant during the cycle of the cleaning program); - in the latter case, the spatial coordinates identifying one or more characteristic features of the objects (e.g. the end of an impeller, the edge of the dispenser door, etc.) will change with respect to the reference system represented by the
washing area 2 during the cleaning program (i.e. the coordinates are time-variant during the cycle of the cleaning program). - The method comprises the step of acquiring a
second image 14 representative of the first group ofobjects 13B once a first preset period of time T1 has elapsed from the start of a cleaning program. - Preferably, this first period of time T1 must be greater than a few seconds, affording a check on whether the objects of the first group 13b have moved or are moving in the
washing area 2. - In a preferred embodiment, this first period of time T1 is greater than three seconds and not greater than four minutes. During this interval, a check may be made on whether the impeller/
s 5 are rotating and that thedoor 7 of thedispenser 6 has been actually opened. - In one aspect, the
optical devices 8 that are preferably used to acquire thesecond image 14 are those placed in the lower portion 2' of thewashing area 2. - The method comprises a
step 15 of digitally processing the second acquiredimage 14 to obtain a second processedimage 15A, wherein this second processedimage 15A defines a second contour for each object of said first group ofobjects 13B. - The method comprises a
step 16 of comparing the firstfiltered image 13A with the second processedimage 15A to assess whether the first contour of each object of said first group ofobjects 13B coincides with the respective second contour and, if it does, notifying 16A a critical change-of-operating-state condition through theuser interface 9. - In other words, once the period T1 after the start of the cleaning program has elapsed, the
control unit 4 will actuate the optical device/s 8 to acquire thesecond image 15A to check whether the contour of the objects of the first group of objects 13b has been moved or is moving. - In the case of the impeller/
s 5, thecontrol unit 4 can check whether they are moved, to indicate a firstcritical condition 16A through theuser interface 9, if an obstacle blocks their movement. - This also applies to the
door 7 of thedispenser 6. - Therefore, the signal associated with the first
critical condition 16A allows the user to learn through theinterface 9 whether: - the rotation of the impeller/
s 5 is blocked or hindered, - the
door 7 of the dispenser has not been opened. - In one aspect, downstream from (or possibly at the same time as) the step of indicating the first
critical condition 16A, the cleaning program is designed to proceed as expected, be changed in response to this firstcritical condition 16A that has been detected or stopped until the normal operating conditions will be restored. - The step of filtering 13 according to the first contour of each object can filter the first processed image 12a to additionally or alternatively obtain a second
filtered image 13C, the second filtered image defining a second group ofobjects 13D. - This second group of
objects 13D represents the objects S of the plurality of objects S, 5 and 7 that are stationary relative to thewashing area 2. - As mentioned above, the objects that are required to be stationary relative to the
washing area 2 are the dishware S. - The method comprises a step of acquiring a
third image 18 representative of the second group of objects once a second preset period of time T2 has elapsed from the start of the cleaning program. - Preferably, this second period of time T2 must be greater than a few seconds, affording a check on whether the objects of the second group are still, i.e. do not move in the
washing area 2. - In one embodiment, this second period of time T2 is greater than one minute.
- In one aspect, the
optical devices 8 that are preferably used to acquire thethird image 18 are those placed in theside walls - The method comprises the
step 19 of digitally processing the third acquiredimage 18 to obtain a thirdprocessed image 19A, wherein this thirdprocessed image 19A defines a second contour for each object of said second group ofobjects 13D. - The method comprises a
step 20 of comparing the secondfiltered image 13C with the thirdprocessed image 19A to assess whether the first contour of each object of the second group ofobjects 13B coincides with the respective second contour and, if it doesn't, notifying 20A a critical change-of-operating-state condition through theuser interface 9. - In order to make sure that the first group of objects is movable during the cleaning program, or more particularly when the cleaning program requires the impellers to be movable, the method includes repeating the
steps objects 13B, once the first preset period of time T1 from the start of the cleaning program has elapsed, at regular or random intervals, to thereby provide a plurality of second images, spaced in time, representative of the position of the first group ofobjects 13B relative to thewashing area 2. - By this repetition of the
steps filtered image 13A, to assess whether the first contour of each object of the first group ofobjects 13B coincides with the respective second contour and, if it does, notifying 16A the change-of-operating-state condition through theuser interface 9. - In other words, the
control unit 4 instructs the optical device/s 8 to acquire additionalsecond images 14, the acquisition occurring at regular or random intervals. Thesesecond images 14 are processed to define the new contours of the objects. These new contours are compared with the respective contours of the firstfiltered image 13A to assess whether a displacement has occurred. If the contours coincide, a change of the operating state is notified through theuser interface 9. - Mutatis mutandis, the method comprises the same procedure for the second group of
objects 13D, with the exception that a change of the operating state is notified if the new contours do not coincide with those of the second filtered image. - Particularly, the method includes repeating the
steps filtered image 13C, whether the first contour of each object of the second group ofobjects 13D coincides with the respective second contour and, if it doesn't, notifying 20A a second critical change-of-operating-state condition through theuser interface 9. - Therefore, the signal associated with the second
critical condition 20A allows the user to learn through theinterface 9 whether the dishware S have changed their position. - In one aspect, downstream from (or possibly at the same time as) the step of indicating the second
critical condition 20A, the cleaning program is designed to proceed as expected, be changed in response to this secondcritical condition 20A that has been detected or stopped until the normal operating conditions will be restored. - In one aspect, i.e. the processing steps 12, 15 and 19 comprise a process through which the
images images - Particularly, by comparing the spatial position of the contours of the acquired objects S, 5 and 7 in the
images images 15a and 19A acquired at later times, with the new respective grids as a reference, an assessment may be made of whether the objects of the first group 13b have moved or the objects of the second group are still stationary relative to thewashing area 2. The comparison of the contour of an object that lies within a grid of the initial image with the corresponding grid of the next image in time allows appreciation of a possible displacement (or non-displacement) of the object being captured. - As mentioned above, the method and the
dishwashing machine 1 allow a change of the operating state of the machine to be notified through theuser interface 9, allowing actions to be taken to restore the proper installation conditions of the object. This will reduce the need to wash part of the dishware and/or repeat the washing cycle, leading the water, detergent and power consumption. - Those skilled in the art will obviously appreciate that a number of changes and variants as described above may be made to fulfill particular requirements, without departure from the scope of the invention, as defined in the following claims.
Claims (12)
- Method of automatically assessing the displacement of an object (S, 5, 7) in a washing area (2) of a dishwashing machine (1), said dishwashing machine comprising a door (3), designed to be associated with said washing area (2) to close it, and being configured to implement a cleaning program and to be in signal communication with a user interface (9), the method comprising the steps of:- providing (10) a plurality of objects (S, 5, 7) in said washing area (2);- acquiring a first digital image (11) representative of said plurality of objects (S, 5, 7);- digitally processing (12) said first acquired image (11) to obtain a first processed image (12A); wherein said first processed image (12A) defines a first contour for each object of said plurality of objects (S, 5, 7);- according to said first contour of each object, filtering (13) said first processed image (12A) to obtain a first filtered image (13A), wherein said first filtered image (13A) defines a first group of objects (13B), wherein said first group of objects (13B) represents the objects (5, 7) of said plurality of objects (S, 5, 7) that are movable relative to the washing area (2) during said cleaning program, said first group of objects (13B) comprising at least one component of said dishwashing machine (1);- acquiring a second digital image (14) representative of said first group of objects (13B) once a first preset period (T1) has elapsed from the start of a cleaning program;- digitally processing (15) said second acquired image (14) to obtain a second processed image (15A), wherein said second processed image (15A) defines a second contour for each object of said first group of objects (13B);- comparing (16) said first filtered image (13A) with said second processed image (15A) to assess whether the first contour of each object of said first group of objects (13B) coincides with the respective second contour and, if it does, notifying a first critical change-of-operating-state condition (16A) through said user interface (9);- said method being characterized by the steps of:- according to said first contour of each object, filtering said first processed image (12A) to obtain a second filtered image (13C), wherein said second filtered image (13C) defines a second group of objects (13D), wherein said second group of objects (13D) represents the objects of said plurality of objects (S, 5, 7) that are fixed relative to the washing area (2) during said cleaning program;- acquiring a third image (18) representative of said second group of objects once a second preset period (T2) has elapsed from the start of a cleaning program;- digitally processing (19) said third acquired image (18) to obtain a third processed image (19A), wherein said third processed image (19A) defines a second contour for each object of said second group of objects (13D);- comparing (20) said second filtered image (13C) with said third processed image (19A) to assess whether the first contour of each object of said second group of objects (13D) coincides with the respective second contour and, if it does not, notifying a second critical change-of-operating-state condition (20A) through said user interface (9).
- A method as claimed in claim 1, wherein said step of acquiring said first digital image (12) occurs once said door (3) has been closed and when said cleaning program has not been started yet.
- A method as claimed in claim 1, which comprises repeating at regular or random intervals, once the first preset period of time (T1) has elapsed from the start of a cleaning program, the step of acquiring a second digital image (14), digitally processing (15) said second acquired image (14) to obtain a second processed image (15A) and comparing (16) said first filtered image (13A) with said second processed image (15A) to obtain a plurality of second images, spaced over time, representative of the position of the first group of objects (13B) relative to the washing area (2).
- A method as claimed in claim 1, which comprises repeating at regular or random intervals, once the second preset period of time (T2) has elapsed from the start of a cleaning program, the step of acquiring a third digital image (18), digitally processing (19) said third acquired image (18) to obtain a third processed image (19A) and comparing (20) said second filtered image (13C) with said third processed image (19A) to obtain a plurality of third images, spaced over time, representative of the position of the second group of objects (13D) relative to the washing area (2).
- A method as claimed in claim 1, wherein said first group (13B) comprises a component (5, 7) of the dishwashing machine which is movable between first and second operating positions.
- A method as claimed in claim 1, wherein said second group (13D) comprises a plurality of dishware items (S).
- A method as claimed in any of the preceding claims 1, wherein said steps of processing (12, 15 and 19) comprise a process through which said first or second filtered images (13A, 13C) are placed on a reference grid to compare such grid with the respective grid of the second or the third processed image (15A and 19A).
- A method as claimed in claim 1, wherein, downstream from said step of notifying said first critical condition (16A) or said second critical condition (20A), said cleaning program is changed, according to said first critical condition (16A) or second critical condition (20A) that has been notified, or stopped.
- A dishwashing machine comprising a washing area (2) and a door (3) designed to be associated with said washing area (2) to close it, a control unit (4) having a memory with a cleaning program stored therein, a pump adapted to be connected to a water mains supply connection to withdraw water from the mains, one or more impellers (5) in fluid communication with such pump, a dispenser (6) having a door (7) configured to move between a closed position to an open position, one or more optical devices (8) that can acquire digital images of said washing area (2) and a user interface (9), said one or more optical devices (8) and user interface (9) being in signal communication with said control unit (4) as well as said pump, characterized in that it comprises a program residing in another portion of said memory, which is configured to carry out the steps as claimed in any of the preceding claims 1 to 8.
- A dishwashing machine as claimed in claim 9, wherein said user interface is a screen (23) integrated in said dishwashing machine, said screen (23) being configured to display a first critical condition (16A) and/or a second critical condition (20A) due to a change of the operating state, through warning lights, texts and/or images.
- A dishwashing machine as claimed in claim 9, wherein said dishwashing machine comprises a radio transmitting apparatus and said user interface is a portable device (22) having its own radio transmitting apparatus configured to establish a signal communication with said radio transmitting apparatus of said dishwashing machine (2) to thereby receive data representative of said change of the operating state, said portable device having its own screen, which is configured to display said change of the operating state through warning lights, messages and/or images.
- A system for automatically assessing the displacement of an object (S, 5, 7) in a washing area (2) of a dishwashing machine (1), comprising:a dishwashing machine (1) comprising a washing area (2) and a door (3) designed to be associated with said washing area (2) to close it, a control unit (4) having a memory with a cleaning program stored therein, a pump adapted to be connected to a water mains supply connection to withdraw water from the mains, one or more impellers (5) in fluid communication with such pump, a dispenser (6) having a door (7) configured to move between a closed position to an open position, one or more optical devices (8) that can acquire digital images of said washing area (2) and a user interface (9), said one or more optical devices (8) and user interface (9) being in signal communication with said control unit (4) as well as said pump, and a transmitting/receiving radio apparatus;- a portable device (22) designed to be handheld by a user, having its own radio transmitting/receiving apparatus configured to establish a signal communication with said radio transmitting/receiving apparatus of said dishwashing machine, a screen configured to display warning lights, messages and/or images and a memory,characterized in that it comprises a program residing in a portion of said memory of the user-handheld portable device (22), said program being configured to carry out the steps as claimed in any of the preceding claims 1 to 8, for a first or second critical change-of-operating-state condition (16A, 20A) to be displayed on said interface (9) and/or said screen of said user-handheld portable device.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IT102017000078567A IT201700078567A1 (en) | 2017-07-13 | 2017-07-13 | Method for automatically evaluating the movement of an object within a washing area of a dishwasher machine. |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3427630A1 true EP3427630A1 (en) | 2019-01-16 |
EP3427630B1 EP3427630B1 (en) | 2020-05-13 |
Family
ID=60570038
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18182619.9A Active EP3427630B1 (en) | 2017-07-13 | 2018-07-10 | Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP3427630B1 (en) |
CN (1) | CN109247886B (en) |
ES (1) | ES2805458T3 (en) |
IT (1) | IT201700078567A1 (en) |
RU (1) | RU2760379C2 (en) |
Cited By (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102019104519A1 (en) * | 2019-02-22 | 2020-08-27 | Miele & Cie. Kg | Recording device for detecting a washing area for a cleaning device and cleaning device |
DE102019110795A1 (en) * | 2019-04-26 | 2020-10-29 | Miele & Cie. Kg | Dishwasher with an image acquisition device and method for operating such a dishwasher |
EP3741284A1 (en) * | 2019-05-21 | 2020-11-25 | Miele & Cie. KG | Dishwasher with an image acquisition device and method for operating such a dishwasher |
EP3788933A1 (en) * | 2019-09-05 | 2021-03-10 | BSH Hausgeräte GmbH | Method for controlling a home appliance |
CN112716407A (en) * | 2020-12-31 | 2021-04-30 | 佛山市顺德区美的洗涤电器制造有限公司 | Washing method and device for dish washing machine and dish washing machine |
US11026559B2 (en) | 2019-09-30 | 2021-06-08 | Midea Group Co., Ltd. | Dishwasher with image-based fluid condition sensing |
US11058281B2 (en) | 2019-06-20 | 2021-07-13 | Midea Group Co., Ltd. | Dishwasher including rack position sensor to control capture of rack images by a camera |
US11185209B2 (en) | 2019-11-20 | 2021-11-30 | Midea Group Co., Ltd. | Dishwasher steam generator |
US11191416B2 (en) | 2019-09-30 | 2021-12-07 | Midea Group Co., Ltd. | Dishwasher with image-based position sensor |
US11202550B2 (en) | 2019-11-20 | 2021-12-21 | Midea Group Co., Ltd. | Dishwasher thermal imaging system |
US11259681B2 (en) | 2019-09-30 | 2022-03-01 | Midea Group Co., Ltd | Dishwasher with image-based diagnostics |
EP3973843A1 (en) * | 2020-09-29 | 2022-03-30 | LG Electronics Inc. | Dishwasher and method for detecting camera failure by dishwasher |
US11399690B2 (en) | 2019-09-30 | 2022-08-02 | Midea Group Co., Ltd. | Dishwasher with cam-based position sensor |
US11464389B2 (en) | 2019-09-30 | 2022-10-11 | Midea Group Co., Ltd. | Dishwasher with image-based detergent sensing |
US11484183B2 (en) | 2019-09-30 | 2022-11-01 | Midea Group Co., Ltd. | Dishwasher with image-based object sensing |
EP4085815A1 (en) * | 2021-05-04 | 2022-11-09 | Miele & Cie. KG | Dishwasher |
US11737638B2 (en) | 2021-03-16 | 2023-08-29 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for determination of door position |
US11825999B2 (en) | 2021-02-17 | 2023-11-28 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for basket detection |
EP4344598A1 (en) * | 2022-09-28 | 2024-04-03 | Illinois Tool Works Inc. | Conveyor dishwasher and method for operating a conveyor dishwasher |
EP4491089A1 (en) * | 2023-07-10 | 2025-01-15 | Miele & Cie. KG | Method and control unit for operating a cleaning device and cleaning device |
US12232680B2 (en) | 2022-08-24 | 2025-02-25 | Haier Us Appliance Solutions, Inc. | Clean dish verification using a camera assembly in a dishwasher appliance |
US12251065B2 (en) | 2022-08-24 | 2025-03-18 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for determination of spray assembly operation |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10809685B2 (en) | 2019-03-18 | 2020-10-20 | Midea Group Co., Ltd. | Dishwasher with cloud connected cameras |
CN112773291B (en) * | 2021-01-07 | 2022-04-26 | 佛山市顺德区美的洗涤电器制造有限公司 | Control method for dish washing machine, processor, control device and dish washing machine |
CN112806932B (en) * | 2021-01-07 | 2022-02-01 | 佛山市顺德区美的洗涤电器制造有限公司 | Method for a dishwasher, control device, processor and dishwasher |
CN112914455A (en) * | 2021-01-25 | 2021-06-08 | 佛山市顺德区美的洗涤电器制造有限公司 | Control method, processor and device for dish washing machine and dish washing machine |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120138092A1 (en) | 2010-12-01 | 2012-06-07 | Whirlpool Corporation | Dishwasher with imaging device for measuring load characteristics and a method for controlling same |
WO2016008699A1 (en) | 2014-07-17 | 2016-01-21 | BSH Hausgeräte GmbH | Dishwasher, in particular domestic dishwasher with a rotatably mounted optical detection means |
DE102015102694A1 (en) * | 2015-02-25 | 2016-08-25 | Miele & Cie. Kg | Method for determining the rotational speed of a spray arm of a dishwasher |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2623077B1 (en) * | 1987-11-13 | 1991-06-07 | Bonnet Sa | BASKET FEEDING DEVICE FOR DISHWASHER |
US6196239B1 (en) * | 1999-07-06 | 2001-03-06 | Mark W. Eskey | Dishwasher status indicator |
ES2343033T3 (en) * | 2007-02-14 | 2010-07-21 | Electrolux Home Products Corporation N.V. | WASHING MACHINE WITH LIQUID WASHING AGENTS DISPENSER. |
DE102008043576A1 (en) * | 2008-11-07 | 2010-05-12 | BSH Bosch und Siemens Hausgeräte GmbH | Method for operating a dishwasher |
JP2010142317A (en) * | 2008-12-17 | 2010-07-01 | Panasonic Corp | Dishwasher/drier |
DE102008055018A1 (en) * | 2008-12-19 | 2010-06-24 | BSH Bosch und Siemens Hausgeräte GmbH | Method for operating a dishwasher |
DE102009023252A1 (en) * | 2009-05-29 | 2010-12-02 | BSH Bosch und Siemens Hausgeräte GmbH | dishwasher |
WO2011048575A2 (en) * | 2009-10-23 | 2011-04-28 | Ecolab Inc. | Optical processing to control a washing apparatus |
DE102013207359B4 (en) * | 2013-04-23 | 2017-04-27 | BSH Hausgeräte GmbH | Dishwasher with at least one functional component associated optical display |
KR102128283B1 (en) * | 2013-11-11 | 2020-06-30 | 삼성전자주식회사 | Dishwasher and controlling method thereof |
KR102046046B1 (en) * | 2013-12-31 | 2019-11-18 | 삼성전자주식회사 | A dish washing machine and a method of controlling the dish washing machine |
-
2017
- 2017-07-13 IT IT102017000078567A patent/IT201700078567A1/en unknown
-
2018
- 2018-07-09 RU RU2018125039A patent/RU2760379C2/en active
- 2018-07-10 ES ES18182619T patent/ES2805458T3/en active Active
- 2018-07-10 EP EP18182619.9A patent/EP3427630B1/en active Active
- 2018-07-13 CN CN201810770126.5A patent/CN109247886B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120138092A1 (en) | 2010-12-01 | 2012-06-07 | Whirlpool Corporation | Dishwasher with imaging device for measuring load characteristics and a method for controlling same |
WO2016008699A1 (en) | 2014-07-17 | 2016-01-21 | BSH Hausgeräte GmbH | Dishwasher, in particular domestic dishwasher with a rotatably mounted optical detection means |
DE102015102694A1 (en) * | 2015-02-25 | 2016-08-25 | Miele & Cie. Kg | Method for determining the rotational speed of a spray arm of a dishwasher |
Cited By (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102019104519A1 (en) * | 2019-02-22 | 2020-08-27 | Miele & Cie. Kg | Recording device for detecting a washing area for a cleaning device and cleaning device |
DE102019110795A1 (en) * | 2019-04-26 | 2020-10-29 | Miele & Cie. Kg | Dishwasher with an image acquisition device and method for operating such a dishwasher |
EP3741284A1 (en) * | 2019-05-21 | 2020-11-25 | Miele & Cie. KG | Dishwasher with an image acquisition device and method for operating such a dishwasher |
DE102019113414A1 (en) * | 2019-05-21 | 2020-11-26 | Miele & Cie. Kg | Dishwasher with an image acquisition device and method for operating such a dishwasher |
US11058281B2 (en) | 2019-06-20 | 2021-07-13 | Midea Group Co., Ltd. | Dishwasher including rack position sensor to control capture of rack images by a camera |
EP3788933A1 (en) * | 2019-09-05 | 2021-03-10 | BSH Hausgeräte GmbH | Method for controlling a home appliance |
WO2021043624A1 (en) * | 2019-09-05 | 2021-03-11 | BSH Hausgeräte GmbH | Method for controlling a home appliance |
CN114340468A (en) * | 2019-09-05 | 2022-04-12 | Bsh家用电器有限公司 | Method for controlling household appliances |
US11464389B2 (en) | 2019-09-30 | 2022-10-11 | Midea Group Co., Ltd. | Dishwasher with image-based detergent sensing |
US11766160B2 (en) | 2019-09-30 | 2023-09-26 | Midea Group Co., Ltd. | Dishwasher with image-based position sensor |
US11191416B2 (en) | 2019-09-30 | 2021-12-07 | Midea Group Co., Ltd. | Dishwasher with image-based position sensor |
US12251066B2 (en) | 2019-09-30 | 2025-03-18 | Midea Group Co., Ltd. | Dishwasher with image-based diagnostics |
US11259681B2 (en) | 2019-09-30 | 2022-03-01 | Midea Group Co., Ltd | Dishwasher with image-based diagnostics |
US12042111B2 (en) | 2019-09-30 | 2024-07-23 | Midea Group Co., Ltd. | Dishwasher with cam-based position sensor |
US11026559B2 (en) | 2019-09-30 | 2021-06-08 | Midea Group Co., Ltd. | Dishwasher with image-based fluid condition sensing |
US11399690B2 (en) | 2019-09-30 | 2022-08-02 | Midea Group Co., Ltd. | Dishwasher with cam-based position sensor |
US11896182B2 (en) | 2019-09-30 | 2024-02-13 | Midea Group Co., Ltd. | Dishwasher with image-based object sensing |
US11484183B2 (en) | 2019-09-30 | 2022-11-01 | Midea Group Co., Ltd. | Dishwasher with image-based object sensing |
US11889966B2 (en) | 2019-09-30 | 2024-02-06 | Midea Group Co., Ltd. | Dishwasher with image-based object sensing |
US11877711B2 (en) | 2019-09-30 | 2024-01-23 | Midea Group Co., Ltd. | Dishwasher with image-based detergent sensing |
US11185209B2 (en) | 2019-11-20 | 2021-11-30 | Midea Group Co., Ltd. | Dishwasher steam generator |
US11202550B2 (en) | 2019-11-20 | 2021-12-21 | Midea Group Co., Ltd. | Dishwasher thermal imaging system |
US11864705B2 (en) | 2019-11-20 | 2024-01-09 | Midea Group Co., Ltd. | Dishwasher thermal imaging system |
EP3973843A1 (en) * | 2020-09-29 | 2022-03-30 | LG Electronics Inc. | Dishwasher and method for detecting camera failure by dishwasher |
CN112716407A (en) * | 2020-12-31 | 2021-04-30 | 佛山市顺德区美的洗涤电器制造有限公司 | Washing method and device for dish washing machine and dish washing machine |
US11825999B2 (en) | 2021-02-17 | 2023-11-28 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for basket detection |
US11737638B2 (en) | 2021-03-16 | 2023-08-29 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for determination of door position |
EP4085815A1 (en) * | 2021-05-04 | 2022-11-09 | Miele & Cie. KG | Dishwasher |
BE1029372B1 (en) * | 2021-05-04 | 2022-12-05 | Miele & Cie | dishwasher |
US12232680B2 (en) | 2022-08-24 | 2025-02-25 | Haier Us Appliance Solutions, Inc. | Clean dish verification using a camera assembly in a dishwasher appliance |
US12251065B2 (en) | 2022-08-24 | 2025-03-18 | Haier Us Appliance Solutions, Inc. | Dishwasher appliance with camera for determination of spray assembly operation |
EP4344598A1 (en) * | 2022-09-28 | 2024-04-03 | Illinois Tool Works Inc. | Conveyor dishwasher and method for operating a conveyor dishwasher |
EP4491089A1 (en) * | 2023-07-10 | 2025-01-15 | Miele & Cie. KG | Method and control unit for operating a cleaning device and cleaning device |
BE1031788B1 (en) * | 2023-07-10 | 2025-02-11 | Miele & Cie | Method and control unit for operating a cleaning device and cleaning device |
Also Published As
Publication number | Publication date |
---|---|
RU2760379C2 (en) | 2021-11-24 |
IT201700078567A1 (en) | 2019-01-13 |
RU2018125039A (en) | 2020-01-09 |
RU2018125039A3 (en) | 2021-09-16 |
CN109247886B (en) | 2022-07-29 |
EP3427630B1 (en) | 2020-05-13 |
CN109247886A (en) | 2019-01-22 |
ES2805458T3 (en) | 2021-02-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3427630B1 (en) | Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine | |
EP3476269B1 (en) | Method of automatically assessing the type of detergent in use in a dishwashing machine | |
US10157308B2 (en) | Interaction recognition and analysis system | |
US11759086B2 (en) | Household dishwasher machine, system comprising household dishwasher machine, and method for operating a household dishwasher machine | |
CN107447442B (en) | Alarm method based on image recognition technology and intelligent device | |
US10260269B2 (en) | Water-conducting domestic appliance and method for operating a water-conducting domestic appliance | |
CN114364297B (en) | System and method for suggesting object placement | |
CN111580396A (en) | Washing control method, dishwasher, and storage medium | |
US10762641B2 (en) | Interaction recognition and analysis system | |
EP3517015B1 (en) | Method for automatically evaluating the degree of cleanliness of the filtering system in a dishwashing machine | |
CN112869679B (en) | Control method and device for dish washing machine, dish washing machine and processor | |
US20140192182A1 (en) | Method for viewing virtual objects within an appliance | |
US20230124027A1 (en) | Systems and methods for capturing images for use in artificial intelligence processes in a laundry appliance | |
EP3524125B1 (en) | Method for automatically evaluating the presence of foam in a dishwashing machine | |
EP3725208B1 (en) | Dishwasher with optical device and illumination device | |
US12180636B2 (en) | Leftover load detection method using image recognition in a laundry appliance | |
US12251070B2 (en) | Methods of monitoring the load state of a dishwashing appliance | |
US11957292B2 (en) | Dishwasher coverage alert system and method | |
CN105451626A (en) | Detecting opening of a washing agent dispenser lid in a dishwasher | |
RU2772954C2 (en) | Method for automatic assessment of presence of foam in dishwasher | |
RU2776938C2 (en) | Method for automatic assessment of purity degree of filtration system of dishwasher | |
US12251065B2 (en) | Dishwasher appliance with camera for determination of spray assembly operation | |
US20240423440A1 (en) | Dishwashing appliance and methods of operation for future cycle protection | |
US20240110324A1 (en) | Systems and methods for prompting image capture for a laundry appliance | |
US20200359872A1 (en) | Rack detection system for child safety and a method of controlling a dishwasher |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20190715 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200108 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: FUMAGALLI, ALDO |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018004451 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1269120 Country of ref document: AT Kind code of ref document: T Effective date: 20200615 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20200513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200914 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200913 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200814 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200813 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200813 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1269120 Country of ref document: AT Kind code of ref document: T Effective date: 20200513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2805458 Country of ref document: ES Kind code of ref document: T3 Effective date: 20210212 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018004451 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20210216 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200710 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210731 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20210731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200513 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20230801 Year of fee payment: 6 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20240628 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20240524 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240719 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20240725 Year of fee payment: 7 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20240801 Year of fee payment: 7 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602018004451 Country of ref document: DE Owner name: CANDY S.P.A., IT Free format text: FORMER OWNER: CANDY S.P.A., MONZA, IT |