[go: up one dir, main page]

EP3427630A1 - Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine - Google Patents

Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine Download PDF

Info

Publication number
EP3427630A1
EP3427630A1 EP18182619.9A EP18182619A EP3427630A1 EP 3427630 A1 EP3427630 A1 EP 3427630A1 EP 18182619 A EP18182619 A EP 18182619A EP 3427630 A1 EP3427630 A1 EP 3427630A1
Authority
EP
European Patent Office
Prior art keywords
objects
image
dishwashing machine
washing area
group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18182619.9A
Other languages
German (de)
French (fr)
Other versions
EP3427630B1 (en
Inventor
Aldo Fumagalli
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Candy SpA
Original Assignee
Candy SpA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Candy SpA filed Critical Candy SpA
Publication of EP3427630A1 publication Critical patent/EP3427630A1/en
Application granted granted Critical
Publication of EP3427630B1 publication Critical patent/EP3427630B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/0018Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
    • A47L15/0049Detection or prevention of malfunction, including accident prevention
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/0018Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
    • A47L15/0021Regulation of operational steps within the washing processes, e.g. optimisation or improvement of operational steps depending from the detergent nature or from the condition of the crockery
    • A47L15/0028Washing phases
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/0018Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
    • A47L15/006Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control using wireless communication between internal components of the machine
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/14Washing or rinsing machines for crockery or tableware with stationary crockery baskets and spraying devices within the cleaning chamber
    • A47L15/18Washing or rinsing machines for crockery or tableware with stationary crockery baskets and spraying devices within the cleaning chamber with movably-mounted spraying devices
    • A47L15/22Rotary spraying devices
    • A47L15/23Rotary spraying devices moved by means of the sprays
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/42Details
    • A47L15/4214Water supply, recirculation or discharge arrangements; Devices therefor
    • A47L15/4219Water recirculation
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/42Details
    • A47L15/4295Arrangements for detecting or measuring the condition of the crockery or tableware, e.g. nature or quantity
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L15/00Washing or rinsing machines for crockery or tableware
    • A47L15/0018Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
    • A47L15/0063Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control using remote monitoring or controlling of the dishwasher operation, e.g. networking systems
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2401/00Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
    • A47L2401/04Crockery or tableware details, e.g. material, quantity, condition
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2401/00Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
    • A47L2401/24Spray arms status, e.g. detection of spray arm rotation
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2401/00Automatic detection in controlling methods of washing or rinsing machines for crockery or tableware, e.g. information provided by sensors entered into controlling devices
    • A47L2401/30Variation of electrical, magnetical or optical quantities
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2501/00Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
    • A47L2501/26Indication or alarm to the controlling device or to the user
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2501/00Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
    • A47L2501/30Regulation of machine operational steps within the washing process, e.g. performing an additional rinsing phase, shortening or stopping of the drying phase, washing at decreased noise operation conditions
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L2501/00Output in controlling method of washing or rinsing machines for crockery or tableware, i.e. quantities or components controlled, or actions performed by the controlling device executing the controlling method
    • A47L2501/32Stopping or disabling machine operation, including disconnecting the machine from a network, e.g. from an electrical power supply

Definitions

  • the present disclosure relates to a method of automatically assessing the displacement of an object in a washing area of a dishwashing machine, as defined in the preamble of claim 1.
  • the present disclosure also relates to a dishwashing machine configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 10.
  • the present disclosure further relates to a system composed of a dishwashing machine and a user-handheld portable device configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 13.
  • Dishwashing machines are known in the art, which are equipped with optical devices such as still cameras, video cameras or camcorders, located in a fixed or moving position relative to the washing chamber to check the dishware load or degree of cleaning.
  • optical devices such as still cameras, video cameras or camcorders
  • WO2016008699 and US 2012/0138092 disclose such dishwashing machines.
  • the object of the present invention is to provide a method, a dishwashing machine and a system for assessing whether the objects in the washing zone have changed their position, to avoid the above described prior art problems.
  • One embodiment of the present invention provides a method and a corresponding dishwashing machine as well as a system composed of a dishwashing machine and a user-handheld portable device that can be used to identify the displacement of objects inside the washing zone of a dishwashing machine, in view of taking actions and restoring the conditions for proper positioning of the obj ects, thereby reducing the need to wash part of the dishware and/or repeat the washing cycle, leading to water, detergent and power consumption.
  • numeral 1 designates a dishwashing machine, e.g. of built-in type, located in a kitchen cabinet, the finishing panels being omitted for better illustration of the internal volumes.
  • This dishwashing machine 1 comprises a washing area 2 and a door 3 adapted to be closingly associated with the washing area 2.
  • the dishwashing machine 1 identifies a base 1A, usually designed to accommodate the mechanisms/devices required to carry out the specific operations of the machine 1.
  • the washing area 2 defines the volume in which the objects S, 5 and 7 to be monitored are arranged.
  • the washing area 2 is defined by a plurality of walls, such as the base wall 2A, the side walls 2B and 2C, the ceiling 2D and the bottom wall 2E and identifies an upper portion 2' and a lower portion 2".
  • upper/lower shall be intended to be related to a proper installation and operation condition of the dishwashing machine 1.
  • the term upper designates the portion that is farther from the base 1A
  • the term lower designates the portion that is closer to the base 1A.
  • the door 3 can be manually operated by the user and/or be power-assisted and has the purpose of hermetically closing the washing area 2 to avoid leakage of washing liquids while the cleaning program is being executed.
  • object S, 5 and 7 shall be intended hereinafter as:
  • the impellers 5 are well known in the art and will not be further described herein. It shall be simply noted that one or preferably two impellers may be located in the washing area. Namely, the first impeller is located in the lower area 2' proximate to the base 1A and the other is located in the upper area 2", preferably in the lower portion of the upper area.
  • a dish rack 21 is situated in the lower area 2' and/or the upper area 2", and has the purpose to accommodate the dishware S, in a manner that is known in the art and will not be further described herein.
  • the dishwashing machine 1 comprises a dispenser 6 whose shape defines a volume adapted to accommodate the products required to clean the objects, particularly the dishware.
  • these products may be detergent powders or tabs, but also a gel.
  • the dispenser 6 may comprise one or more compartments, each designed to receive a particular washing product.
  • the dispenser 6 comprises a door 7 which is configured to move between a closed position and a position allowing free access to the internal volume of the dispenser 6.
  • the door 7 is moved between the closed position and the open position by being mechanically and/or electrically controlled by the control unit 4, once the door 3 of the dishwashing machine 1 has been closed.
  • the dispenser 6 is placed on the door 3, and particularly on the side facing the washing area 2, at a predetermined height. More particularly, the dispenser 6 is housed within the thickness of the door 3.
  • the dishwashing machine 1 comprises a control unit 4, e.g. situated within the thickness of the door 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program.
  • a control unit 4 e.g. situated within the thickness of the door 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program.
  • the control unit 4 is a unit configured to control and supervise the operating functions of the dishwashing machine 1.
  • the memory of the control unit 4 is designed to also permanently store a database in which the contours of the objects S, 5 and 7 are identified by means of appropriate parameters.
  • the objects S, 5 and 7 are advantageously identified in the database by one or more digital parameters that can represent the contour of the objects S, 5 and 7.
  • digital parameters that can represent the contour of the objects S, 5 and 7.
  • the so-called mathematics that represent these devices are already known to the manufacturer of the dishwashing machine 1, but the dishware S is designed to be identified using a particular imaging process.
  • the dishwashing machine 1 comprises a pump, for example arranged in the base 1A, which is adapted to be connected, in a manner that is known to a skilled person and will not be described herein, to a water mains supply.
  • this pump is controlled by a solenoid valve and has the purpose of withdrawing water from the mains and supply it to the impellers 5 arranged in the washing area 2.
  • the dishwashing machine 1 comprises one or more optical devices 8 that can capture digital images of the washing area 2.
  • the optical devices 8 are arranged with their optical system facing the washing area 2.
  • each wall 2A, 2B, 2C, 2D and/or 2E of the washing area 2 can accommodate one or more of the aforementioned optical devices 8 in its thickness
  • a housing 2F for each optical device 8 is provided for this purpose.
  • the housing 2F defines a volume adapted to accommodate its respective optical device and a light-transparent covering panel 8A preferably covers the optical system of the optical device.
  • This covering panel 8A is made, for example, of glass or plastic or materials having similar technical properties.
  • the covering panel 8A is preferably arranged substantially flush with or slightly projecting out of the surface of the wall 2A, 2B, 2C, 2D or 2E.
  • the housing 2F formed in the thickness of the door 3 of the dishwashing machine 2. As shown in this Figure 5 , all the electrical and electronic parts required for the operation of the optical device 8 are accommodated in the housing 2F.
  • the purpose of the optical devices 8 in the dishwashing machine 1 is to capture still and/or sequential two-dimensional digital images at predetermined capturing speeds, usually in the visible range of the electromagnetic spectrum, such as a single frame, or a burst of images, or an seamless stream of images of the washing area 2 and particularly of the objects S, 5, 7 in this washing area.
  • the optical device 8 has a field of view 8B, allowing acquisition of images of the objects S, 5 and/or 7 that fall within such field of view.
  • optical devices 8 are in signal communication with the control unit 4 via the I/O ports of the latter to send the acquired data to the control unit 4.
  • the optical devices 8 are embodied, for example, by a still camera and/or a video camera. These devices are known in the art and will not be described in further detail herein.
  • the still camera and/or the video camera as used in the dishwashing machine 1 preferably comply with the technical specifications for operation with water, i.e. the still camera and/or the video camera comply with the standard IP x(1-8).
  • the housing 2F in which the optical devices 8 are placed is configured to be watertight, e.g. using sealing techniques.
  • the dishwashing machine 1 comprises a user interface 9, i.e. the control and monitoring interface through which the user may control and manage the operation and functions of the dishwashing machine.
  • the user interface 9 is in signal communication with the control unit 4 via the I/O ports of the latter to receive the data processed by the CPU of the control unit.
  • the user interface 9 is a screen 23 which is integrated in the dishwashing machine 1 to be visible by a user during normal operation and/or with the addition of a buzzer (not shown).
  • the user interface 9 is integrated in the door 3 with such an orientation that the screen faces out of the washing area 2.
  • the screen of the user interface 9 is configured to display light indications, text messages and/or single or continuous images.
  • the images displayed on screen may be the images of the washing area 2 and the objects therein provided acquired by the optical devices 8.
  • the screen may be a touch (i.e. touch sensitive) screen.
  • the user interface 9 comprises one or more analog buttons and/or a combination of analog/digital controls and/or a combination of analog/digital controls and a screen, the latter being, for instance, a touchscreen.
  • the buzzer of the user interface 9 has the purpose of providing acoustic warnings of any situations or operating conditions to the user.
  • the dishwashing machine 1 comprises a radio transmitting/receiving apparatus, which is configured to provide signal communication with a wired and/or wireless network.
  • the wireless network may be an Internet protocol-based network that uses a WI-FI connection or a Bluetooth-based WPAN (Wireless Personal Area Network).
  • the user interface 9 also comprises a portable device (i.e. a device that can be carried and held in a user's hand) 22 such as a smartphone, a tablet, a PC or similar instruments.
  • a portable device i.e. a device that can be carried and held in a user's hand
  • a smartphone such as a smartphone, a tablet, a PC or similar instruments.
  • the user interface 9 comprises both the usual control interface of the dishwashing machine 1 and the screen of a portable device 22.
  • the portable device 22 has its own radio transmitting/receiving apparatus, which is configured to establish a signal communication with the radio transmitting/receiving apparatus of the dishwashing machine 1.
  • the portable device 22 is not only able to communicate with the control unit 4 of the dishwashing machine 1, but also to connect through the Internet network, for example via a GSM infrastructure, to one or more remote servers 24 to carry out storage, saving and/or data processing operations on the images that have been captured by the optical devices 8.
  • the portable device 22 is adapted to connect either directly with the dishwashing machine 1 and with the Internet network via the GSM infrastructure.
  • a system 25 is provided which comprises the dishwashing machine 1, the portable device 22 which are in signal communication with each other via the GSM network, a WI-FI connection and/or a WPAN.
  • the screen of the portable device 22 is configured to display light indications, text messages and/or images captured by the optical devices 8.
  • the database in which the contours of the objects S, 5 and 7, are identified through appropriate parameters may be stored at least partially, preferably entirely, in the memory of the portable device 22, in a mass storage of the server and/or be distributed in the memories of the dishwashing machine 1, the portable device 22 and the server 23.
  • control unit 4 is in signal communication with the user interface 9 (provided either as the screen of the dishwashing machine 1 or as a screen of the portable device) to transmit changes of the operating state of the dishwashing machine 1.
  • a change of the operating state is intended to designate any change of the function of the dishwashing machine 1 resulting from the displacement of one or more objects S, 5 or 7 to a position that cannot ensure proper operation, i.e. to a state in which one or more problems occur.
  • these problems particularly include:
  • the identification of one or more of the aforementioned problems does not affect the execution of the cleaning program, i.e. the cleaning program that has been set will be completed in spite of the detected problem/s.
  • the cleaning program is designed to be stopped either automatically, i.e. by the control unit 4, or manually, i.e. by the user. This situation is restored as soon as the user solves the detected problems, for the initially selected program to be completed.
  • the cleaning program may be designed to be changed, or modified automatically by the control unit 4, to account for the detected problem.
  • the cleaning program being executed may be changed by the control unit 4 by increasing the water supply time (i.e. duration) to compensate for the detected problem.
  • the visual indications that can be displayed on the screen of the user interface 9 in addition to the usual indications known in the art, can provide warning of possible changes of the operating states of the dishwashing machine 1.
  • the method of automatically assessing the displacement of an object S, 5 and/or 7, i.e. a dishware item and/or of a component of the dishwashing machine 1 in a washing area 2 includes a step 10 of providing a plurality of objects S, 5, 7 in the washing area 2.
  • the method steps as described hereinbelow i.e. the steps of acquiring, processing, filtering, comparing and dividing may be carried out either directly by the CPU of the control unit 4 or more preferably by the CPU of the portable user device via the Internet connection with the CPU of remote servers for analysis and data processing.
  • the method comprises a step of acquiring a first digital image 11 representative of the plurality of objects S, 5 and/or 7.
  • This acquisition step is carried out through the or optical device/s 8 located in the washing area 2.
  • the first digital image is preferably acquired after closing the door 3 but before starting the cleaning program.
  • control unit 4 supervises the acquisition step by controlling the or optical device/s 8 once the door 3 has been closed before the start of the cleaning program.
  • the method comprises a step 12 of digitally processing the first acquired image 11 to obtain a first processed image 12A; wherein said first processed image 12A defines a first contour for each object of said plurality of objects S, 5 and/or 7.
  • control unit 4 and/or the portable user device starts a process in which the first image 11 is processed to define the contour of each of the objects S, 5 and/or 7 in the washing area 2, which may be either dishware and/or components of the dishwashing machine.
  • the first processed image 12A represents the initial image, i.e. an image of the initial arrangement of the objects S, 5 and/or 7 whose displacement is to be assessed.
  • the method comprises a filtering step 13 that, based on the first contour of each object, filters the first processed image 12a to obtain a first filtered image 13A.
  • This first filtered image 13a defines a first group of objects 13B, this first group of objects representing the objects 5 and/or 7 of the plurality of objects S, 5 and/or 7 that are movable relative to the washing area 2.
  • the contours of the objects in the first processed image 12A may be distinguished to obtain a first filtered image 13A that only contains the contours of the objects that are movable relative to the washing area 2.
  • the first group of objects 13b comprises the objects that are expected to move relative to the washing area 2 during the cleaning program, being these objects components of the dishwashing machine 1.
  • These objects of the first group of objects 13b are, for example, the impeller/s 5 and the door 7 of the dispenser 6.
  • the impeller/s 5 must move relative to the washing area to introduce an uniform flow of water and detergent products into the washing area 2
  • the movement is a rotary movement about a central point, which is typically the center of gravity.
  • the door 7 of the dispenser 6 is required to move from the closed configuration to the open configuration.
  • the filtering step 13 may be implemented, for example, by comparing the contours that have been identified with the contours stored in a database that resides in the memory of the control unit 4 or in the memory of the portable user device or in a server remote from both the dishwashing machine 1 and the user hand-held device.
  • the contours of the impellers 5 and/or the door 7 of the dispenser 6 are known to the manufacturer of the dishwashing machine 1 and can be stored beforehand and directly compared with those in the first processed image 12A.
  • the other contours in the first processed image 12A i.e. the contours that are not part of the first group 13B, belong to a second group of objects 13D which, as described below, defines the objects S that are stationary relative to the washing area 2.
  • the term objects that are stationary relative to the washing area 2 or movable relative to the washing area 2 is intended to indicate that:
  • the method comprises the step of acquiring a second image 14 representative of the first group of objects 13B once a first preset period of time T1 has elapsed from the start of a cleaning program.
  • this first period of time T1 must be greater than a few seconds, affording a check on whether the objects of the first group 13b have moved or are moving in the washing area 2.
  • this first period of time T1 is greater than three seconds and not greater than four minutes. During this interval, a check may be made on whether the impeller/s 5 are rotating and that the door 7 of the dispenser 6 has been actually opened.
  • the optical devices 8 that are preferably used to acquire the second image 14 are those placed in the lower portion 2' of the washing area 2.
  • the method comprises a step 15 of digitally processing the second acquired image 14 to obtain a second processed image 15A, wherein this second processed image 15A defines a second contour for each object of said first group of objects 13B.
  • the method comprises a step 16 of comparing the first filtered image 13A with the second processed image 15A to assess whether the first contour of each object of said first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A a critical change-of-operating-state condition through the user interface 9.
  • control unit 4 will actuate the optical device/s 8 to acquire the second image 15A to check whether the contour of the objects of the first group of objects 13b has been moved or is moving.
  • control unit 4 can check whether they are moved, to indicate a first critical condition 16A through the user interface 9, if an obstacle blocks their movement.
  • the signal associated with the first critical condition 16A allows the user to learn through the interface 9 whether:
  • the cleaning program downstream from (or possibly at the same time as) the step of indicating the first critical condition 16A, the cleaning program is designed to proceed as expected, be changed in response to this first critical condition 16A that has been detected or stopped until the normal operating conditions will be restored.
  • the step of filtering 13 according to the first contour of each object can filter the first processed image 12a to additionally or alternatively obtain a second filtered image 13C, the second filtered image defining a second group of objects 13D.
  • This second group of objects 13D represents the objects S of the plurality of objects S, 5 and 7 that are stationary relative to the washing area 2.
  • the objects that are required to be stationary relative to the washing area 2 are the dishware S.
  • the method comprises a step of acquiring a third image 18 representative of the second group of objects once a second preset period of time T2 has elapsed from the start of the cleaning program.
  • this second period of time T2 must be greater than a few seconds, affording a check on whether the objects of the second group are still, i.e. do not move in the washing area 2.
  • this second period of time T2 is greater than one minute.
  • the optical devices 8 that are preferably used to acquire the third image 18 are those placed in the side walls 2B and 2C.
  • the method comprises the step 19 of digitally processing the third acquired image 18 to obtain a third processed image 19A, wherein this third processed image 19A defines a second contour for each object of said second group of objects 13D.
  • the method comprises a step 20 of comparing the second filtered image 13C with the third processed image 19A to assess whether the first contour of each object of the second group of objects 13B coincides with the respective second contour and, if it doesn't, notifying 20A a critical change-of-operating-state condition through the user interface 9.
  • the method includes repeating the steps 14, 15 and 16, namely acquiring the second image representative of the first group of objects 13B, once the first preset period of time T1 from the start of the cleaning program has elapsed, at regular or random intervals, to thereby provide a plurality of second images, spaced in time, representative of the position of the first group of objects 13B relative to the washing area 2.
  • a comparison may be made with the first filtered image 13A, to assess whether the first contour of each object of the first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A the change-of-operating-state condition through the user interface 9.
  • control unit 4 instructs the optical device/s 8 to acquire additional second images 14, the acquisition occurring at regular or random intervals.
  • These second images 14 are processed to define the new contours of the objects.
  • These new contours are compared with the respective contours of the first filtered image 13A to assess whether a displacement has occurred. If the contours coincide, a change of the operating state is notified through the user interface 9.
  • the method comprises the same procedure for the second group of objects 13D, with the exception that a change of the operating state is notified if the new contours do not coincide with those of the second filtered image.
  • the method includes repeating the steps 18, 19 and 20 to assess, by a comparison with the second filtered image 13C, whether the first contour of each object of the second group of objects 13D coincides with the respective second contour and, if it doesn't, notifying 20A a second critical change-of-operating-state condition through the user interface 9.
  • the signal associated with the second critical condition 20A allows the user to learn through the interface 9 whether the dishware S have changed their position.
  • the cleaning program downstream from (or possibly at the same time as) the step of indicating the second critical condition 20A, the cleaning program is designed to proceed as expected, be changed in response to this second critical condition 20A that has been detected or stopped until the normal operating conditions will be restored.
  • the processing steps 12, 15 and 19 comprise a process through which the images 13A, 13C are divided, with a reference grid being placed thereon, to compare the grid with the respective grid of the images 15A and 19A acquired at later times.
  • an assessment may be made of whether the objects of the first group 13b have moved or the objects of the second group are still stationary relative to the washing area 2.
  • the comparison of the contour of an object that lies within a grid of the initial image with the corresponding grid of the next image in time allows appreciation of a possible displacement (or non-displacement) of the object being captured.
  • the method and the dishwashing machine 1 allow a change of the operating state of the machine to be notified through the user interface 9, allowing actions to be taken to restore the proper installation conditions of the object. This will reduce the need to wash part of the dishware and/or repeat the washing cycle, leading the water, detergent and power consumption.

Landscapes

  • Engineering & Computer Science (AREA)
  • Water Supply & Treatment (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Washing And Drying Of Tableware (AREA)

Abstract

The present disclosure relates a method of automatically assessing the displacement of an object (S, 5, 7) in a washing area (2) of a dishwashing machine (1) having optical means (8) and a user interface (9). The method includes acquiring, processing and comparing various images to check whether the object (S, 5, 7) has moved, to indicate a change-of-operating-state condition (16A) through said user interface (9).

Description

    Field of The Invention
  • The present disclosure relates to a method of automatically assessing the displacement of an object in a washing area of a dishwashing machine, as defined in the preamble of claim 1.
  • The present disclosure also relates to a dishwashing machine configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 10.
  • The present disclosure further relates to a system composed of a dishwashing machine and a user-handheld portable device configured to carry out the method of automatically assessing the displacement of an object in a washing area, as defined in the preamble of claim 13.
  • Discussion of the related art
  • Dishwashing machines are known in the art, which are equipped with optical devices such as still cameras, video cameras or camcorders, located in a fixed or moving position relative to the washing chamber to check the dishware load or degree of cleaning.
  • For example, WO2016008699 and US 2012/0138092 disclose such dishwashing machines.
  • Problem of the prior art
  • During operation of a dishwashing machine of the above-discussed type, conditions may occur that might degrade the washing and drying performance on the entire load and/or on part of the dishware loaded in the washing area.
  • This may be also caused by the fact that, in certain cases, the dishware loaded on the racks by a user might:
    • be displaced due to unstable positioning thereof on the rack;
    • be displaced due to the mechanical action of the washing fluid;
    • be displaced due to water weight;
    • block the rotation of the impellers used to distribute the fluid on the dishware;
    • block the detergent dispenser door.
    SUMMARY OF THE INVENTION
  • The object of the present invention is to provide a method, a dishwashing machine and a system for assessing whether the objects in the washing zone have changed their position, to avoid the above described prior art problems.
  • This object is fulfilled by a method, a dishwashing machine and a system for automatically assessing the displacement of an object in a washing area of a dishwashing machine as defined in the following claims 10 and 13, respectively.
  • Advantages of the Invention
  • One embodiment of the present invention provides a method and a corresponding dishwashing machine as well as a system composed of a dishwashing machine and a user-handheld portable device that can be used to identify the displacement of objects inside the washing zone of a dishwashing machine, in view of taking actions and restoring the conditions for proper positioning of the obj ects, thereby reducing the need to wash part of the dishware and/or repeat the washing cycle, leading to water, detergent and power consumption.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The characteristics and advantages of the present disclosure will appear from the following detailed description of a possible practical embodiment, illustrated as a nonlimiting example in the set of drawings, in which:
    • Figure 1 shows a flowchart of the method of the present invention;
    • Figure 2 shows a front perspective view of a built-in dishwashing machine with the omission of the finishing panels, which is configured to carry out the method of Figure 1;
    • Figure 3 shows a rear perspective view of the dishwashing machine of Figure 2 with the omission of some of its parts and the dishware;
    • Figure 4 shows a detail view of a zone proximate to the dispenser, when the latter is equipped with an optical device of the dishwashing machine of Figure 2, according to the present invention;
    • Figure 5 shows a cross sectional view as taken along line V- V of Figure 4.
    DETAILED DESCRIPTION
  • Even when this is not expressly stated, the individual features as described with reference to the particular embodiments shall be intended as auxiliary to and/or interchangeable with other features described with reference to other exemplary embodiments.
  • Referring to the accompanying figures 2 to 5, numeral 1 designates a dishwashing machine, e.g. of built-in type, located in a kitchen cabinet, the finishing panels being omitted for better illustration of the internal volumes.
  • This dishwashing machine 1 comprises a washing area 2 and a door 3 adapted to be closingly associated with the washing area 2.
  • The dishwashing machine 1 identifies a base 1A, usually designed to accommodate the mechanisms/devices required to carry out the specific operations of the machine 1.
  • The washing area 2 defines the volume in which the objects S, 5 and 7 to be monitored are arranged.
  • Namely, the washing area 2 is defined by a plurality of walls, such as the base wall 2A, the side walls 2B and 2C, the ceiling 2D and the bottom wall 2E and identifies an upper portion 2' and a lower portion 2".
  • The terms upper/lower shall be intended to be related to a proper installation and operation condition of the dishwashing machine 1. Here, the term upper designates the portion that is farther from the base 1A, and the term lower designates the portion that is closer to the base 1A.
  • The door 3 can be manually operated by the user and/or be power-assisted and has the purpose of hermetically closing the washing area 2 to avoid leakage of washing liquids while the cleaning program is being executed.
  • The term object S, 5 and 7 shall be intended hereinafter as:
    • a dishware item S, such as a dish, a piece of cutlery, a glass, a pot, or
    • a part of the dishwashing machine itself, such as an impeller 5 for introducing washing liquid into the washing area or a door 7 of a detergent-containing dispenser 6.
  • The impellers 5 are well known in the art and will not be further described herein. It shall be simply noted that one or preferably two impellers may be located in the washing area. Namely, the first impeller is located in the lower area 2' proximate to the base 1A and the other is located in the upper area 2", preferably in the lower portion of the upper area.
  • A dish rack 21 is situated in the lower area 2' and/or the upper area 2", and has the purpose to accommodate the dishware S, in a manner that is known in the art and will not be further described herein.
  • The dishwashing machine 1 comprises a dispenser 6 whose shape defines a volume adapted to accommodate the products required to clean the objects, particularly the dishware.
  • For example, these products may be detergent powders or tabs, but also a gel.
  • The dispenser 6 may comprise one or more compartments, each designed to receive a particular washing product.
  • In one aspect, the dispenser 6 comprises a door 7 which is configured to move between a closed position and a position allowing free access to the internal volume of the dispenser 6.
  • For example, when the door 7 is in the closed position, products cannot come out of their respective compartments, and when the door 7 is in the open position, these washing products are allowed to come out.
  • The door 7 is moved between the closed position and the open position by being mechanically and/or electrically controlled by the control unit 4, once the door 3 of the dishwashing machine 1 has been closed.
  • In one aspect, also referring to Figure 4, the dispenser 6 is placed on the door 3, and particularly on the side facing the washing area 2, at a predetermined height. More particularly, the dispenser 6 is housed within the thickness of the door 3.
  • The dishwashing machine 1 comprises a control unit 4, e.g. situated within the thickness of the door 3, which has a motherboard with the usual electrical and electronic devices located thereon, including a CPU, a number of I/O ports for receiving and transmitting data, a memory bank, a portion whereof being designed to permanently store at least one cleaning program.
  • The control unit 4 is a unit configured to control and supervise the operating functions of the dishwashing machine 1.
  • In one embodiment of the present invention, the memory of the control unit 4 is designed to also permanently store a database in which the contours of the objects S, 5 and 7 are identified by means of appropriate parameters.
  • The objects S, 5 and 7 are advantageously identified in the database by one or more digital parameters that can represent the contour of the objects S, 5 and 7. For example, for an impeller 5 or the door 7 of the dispenser 6, the so-called mathematics that represent these devices are already known to the manufacturer of the dishwashing machine 1, but the dishware S is designed to be identified using a particular imaging process.
  • In order to execute the selected cleaning program, the dishwashing machine 1 comprises a pump, for example arranged in the base 1A, which is adapted to be connected, in a manner that is known to a skilled person and will not be described herein, to a water mains supply.
  • For example, this pump is controlled by a solenoid valve and has the purpose of withdrawing water from the mains and supply it to the impellers 5 arranged in the washing area 2.
  • The dishwashing machine 1 comprises one or more optical devices 8 that can capture digital images of the washing area 2.
  • In one aspect, the optical devices 8 are arranged with their optical system facing the washing area 2.
  • Namely, each wall 2A, 2B, 2C, 2D and/or 2E of the washing area 2 can accommodate one or more of the aforementioned optical devices 8 in its thickness,
  • A housing 2F for each optical device 8 is provided for this purpose.
  • The housing 2F defines a volume adapted to accommodate its respective optical device and a light-transparent covering panel 8A preferably covers the optical system of the optical device.
  • This covering panel 8A is made, for example, of glass or plastic or materials having similar technical properties.
  • The covering panel 8A is preferably arranged substantially flush with or slightly projecting out of the surface of the wall 2A, 2B, 2C, 2D or 2E.
  • Particularly referring to Figure 5, the housing 2F formed in the thickness of the door 3 of the dishwashing machine 2. As shown in this Figure 5, all the electrical and electronic parts required for the operation of the optical device 8 are accommodated in the housing 2F.
  • The purpose of the optical devices 8 in the dishwashing machine 1 is to capture still and/or sequential two-dimensional digital images at predetermined capturing speeds, usually in the visible range of the electromagnetic spectrum, such as a single frame, or a burst of images, or an seamless stream of images of the washing area 2 and particularly of the objects S, 5, 7 in this washing area.
  • For example, still referring to Figure 5, it may be appreciated that the optical device 8 has a field of view 8B, allowing acquisition of images of the objects S, 5 and/or 7 that fall within such field of view.
  • These optical devices 8 are in signal communication with the control unit 4 via the I/O ports of the latter to send the acquired data to the control unit 4.
  • The optical devices 8 are embodied, for example, by a still camera and/or a video camera. These devices are known in the art and will not be described in further detail herein.
  • Nevertheless, it shall be noted that the still camera and/or the video camera as used in the dishwashing machine 1 preferably comply with the technical specifications for operation with water, i.e. the still camera and/or the video camera comply with the standard IP x(1-8).
  • Instead of or in addition to these technical specifications, the housing 2F in which the optical devices 8 are placed, is configured to be watertight, e.g. using sealing techniques.
  • The dishwashing machine 1 comprises a user interface 9, i.e. the control and monitoring interface through which the user may control and manage the operation and functions of the dishwashing machine.
  • For this purpose, the user interface 9 is in signal communication with the control unit 4 via the I/O ports of the latter to receive the data processed by the CPU of the control unit.
  • In one embodiment, the user interface 9 is a screen 23 which is integrated in the dishwashing machine 1 to be visible by a user during normal operation and/or with the addition of a buzzer (not shown).
  • In one aspect, still referring to figures 1 and 2, the user interface 9 is integrated in the door 3 with such an orientation that the screen faces out of the washing area 2.
  • It shall be noted that the screen of the user interface 9 is configured to display light indications, text messages and/or single or continuous images. Namely, the images displayed on screen may be the images of the washing area 2 and the objects therein provided acquired by the optical devices 8. Particularly, the screen may be a touch (i.e. touch sensitive) screen.
  • In another embodiment, the user interface 9 comprises one or more analog buttons and/or a combination of analog/digital controls and/or a combination of analog/digital controls and a screen, the latter being, for instance, a touchscreen.
  • The buzzer of the user interface 9 has the purpose of providing acoustic warnings of any situations or operating conditions to the user.
  • In one embodiment, the dishwashing machine 1 comprises a radio transmitting/receiving apparatus, which is configured to provide signal communication with a wired and/or wireless network. For instance, the wireless network may be an Internet protocol-based network that uses a WI-FI connection or a Bluetooth-based WPAN (Wireless Personal Area Network).
  • In this case, the user interface 9 also comprises a portable device (i.e. a device that can be carried and held in a user's hand) 22 such as a smartphone, a tablet, a PC or similar instruments.
  • In other words, the user interface 9 comprises both the usual control interface of the dishwashing machine 1 and the screen of a portable device 22.
  • Particularly, the portable device 22 has its own radio transmitting/receiving apparatus, which is configured to establish a signal communication with the radio transmitting/receiving apparatus of the dishwashing machine 1.
  • In one aspect, the portable device 22 is not only able to communicate with the control unit 4 of the dishwashing machine 1, but also to connect through the Internet network, for example via a GSM infrastructure, to one or more remote servers 24 to carry out storage, saving and/or data processing operations on the images that have been captured by the optical devices 8.
  • In other words, the portable device 22 is adapted to connect either directly with the dishwashing machine 1 and with the Internet network via the GSM infrastructure. Thus, a system 25 is provided which comprises the dishwashing machine 1, the portable device 22 which are in signal communication with each other via the GSM network, a WI-FI connection and/or a WPAN.
  • It shall be noted that the screen of the portable device 22 is configured to display light indications, text messages and/or images captured by the optical devices 8.
  • In one embodiment of the present invention, if the user interface 9 also includes the portable device 22, then the database in which the contours of the objects S, 5 and 7, are identified through appropriate parameters may be stored at least partially, preferably entirely, in the memory of the portable device 22, in a mass storage of the server and/or be distributed in the memories of the dishwashing machine 1, the portable device 22 and the server 23.
  • In one aspect, the control unit 4 is in signal communication with the user interface 9 (provided either as the screen of the dishwashing machine 1 or as a screen of the portable device) to transmit changes of the operating state of the dishwashing machine 1.
  • As used herein, a change of the operating state is intended to designate any change of the function of the dishwashing machine 1 resulting from the displacement of one or more objects S, 5 or 7 to a position that cannot ensure proper operation, i.e. to a state in which one or more problems occur.
  • In one aspect, these problems particularly include:
    • a component 5, 7 of the dishwashing machine that has not been displaced from its initial position, e.g. because it is blocked by a dishware item, and/or
    • a dishware item S that has moved from its initial position, for instance to such a position in which it cannot be properly washed and/or dried or to a position in which it will block the movement of the components (for example the rotation of the impellers, or the movement of the door of the dispenser from the closed configuration to the open configuration) of the dishwashing machine.
  • In one embodiment, the identification of one or more of the aforementioned problems does not affect the execution of the cleaning program, i.e. the cleaning program that has been set will be completed in spite of the detected problem/s.
  • Alternatively, upon detection of one or more of the aforementioned problems, the cleaning program is designed to be stopped either automatically, i.e. by the control unit 4, or manually, i.e. by the user. This situation is restored as soon as the user solves the detected problems, for the initially selected program to be completed.
  • In a further alternative embodiment, upon detection of one or more of the aforementioned problems, the cleaning program may be designed to be changed, or modified automatically by the control unit 4, to account for the detected problem.
  • For example, in case of changes to the cleaning program, if for instance, the detected problem is a displacement of a dishware item S from its reference position (which affects the washing efficiency), the cleaning program being executed may be changed by the control unit 4 by increasing the water supply time (i.e. duration) to compensate for the detected problem.
  • Therefore, the visual indications that can be displayed on the screen of the user interface 9, in addition to the usual indications known in the art, can provide warning of possible changes of the operating states of the dishwashing machine 1.
  • Referring now to Figure 1, the method of automatically assessing the displacement of an object S, 5 and/or 7, i.e. a dishware item and/or of a component of the dishwashing machine 1 in a washing area 2, includes a step 10 of providing a plurality of objects S, 5, 7 in the washing area 2.
  • It shall be noted that the method steps as described hereinbelow, i.e. the steps of acquiring, processing, filtering, comparing and dividing may be carried out either directly by the CPU of the control unit 4 or more preferably by the CPU of the portable user device via the Internet connection with the CPU of remote servers for analysis and data processing.
  • The method comprises a step of acquiring a first digital image 11 representative of the plurality of objects S, 5 and/or 7.
  • This acquisition step is carried out through the or optical device/s 8 located in the washing area 2.
  • The first digital image is preferably acquired after closing the door 3 but before starting the cleaning program.
  • For this purpose, the control unit 4 supervises the acquisition step by controlling the or optical device/s 8 once the door 3 has been closed before the start of the cleaning program.
  • Once the first image has been acquired, the method comprises a step 12 of digitally processing the first acquired image 11 to obtain a first processed image 12A; wherein said first processed image 12A defines a first contour for each object of said plurality of objects S, 5 and/or 7.
  • In other words, the control unit 4 and/or the portable user device starts a process in which the first image 11 is processed to define the contour of each of the objects S, 5 and/or 7 in the washing area 2, which may be either dishware and/or components of the dishwashing machine.
  • It shall be noted that the first processed image 12A represents the initial image, i.e. an image of the initial arrangement of the objects S, 5 and/or 7 whose displacement is to be assessed.
  • The method comprises a filtering step 13 that, based on the first contour of each object, filters the first processed image 12a to obtain a first filtered image 13A. This first filtered image 13a defines a first group of objects 13B, this first group of objects representing the objects 5 and/or 7 of the plurality of objects S, 5 and/or 7 that are movable relative to the washing area 2.
  • In other words, by applying the filter 13, the contours of the objects in the first processed image 12A may be distinguished to obtain a first filtered image 13A that only contains the contours of the objects that are movable relative to the washing area 2.
  • Therefore, the first group of objects 13b comprises the objects that are expected to move relative to the washing area 2 during the cleaning program, being these objects components of the dishwashing machine 1. These objects of the first group of objects 13b are, for example, the impeller/s 5 and the door 7 of the dispenser 6.
  • The impeller/s 5 must move relative to the washing area to introduce an uniform flow of water and detergent products into the washing area 2 The movement is a rotary movement about a central point, which is typically the center of gravity.
  • Likewise, for the detergent materials to be mixed with water, the door 7 of the dispenser 6 is required to move from the closed configuration to the open configuration.
  • The filtering step 13 may be implemented, for example, by comparing the contours that have been identified with the contours stored in a database that resides in the memory of the control unit 4 or in the memory of the portable user device or in a server remote from both the dishwashing machine 1 and the user hand-held device.
  • Namely, the contours of the impellers 5 and/or the door 7 of the dispenser 6 are known to the manufacturer of the dishwashing machine 1 and can be stored beforehand and directly compared with those in the first processed image 12A.
  • The other contours in the first processed image 12A, i.e. the contours that are not part of the first group 13B, belong to a second group of objects 13D which, as described below, defines the objects S that are stationary relative to the washing area 2.
  • As used herein, the term objects that are stationary relative to the washing area 2 or movable relative to the washing area 2 is intended to indicate that:
    • in the former case, the spatial coordinates identifying one or more characteristic features of the objects (e.g. the edge of a dish, the bottom of a glass, etc.) will be unchanged with respect to the reference system represented by the washing area 2 during the cleaning program (i.e. the coordinates are time-invariant during the cycle of the cleaning program);
    • in the latter case, the spatial coordinates identifying one or more characteristic features of the objects (e.g. the end of an impeller, the edge of the dispenser door, etc.) will change with respect to the reference system represented by the washing area 2 during the cleaning program (i.e. the coordinates are time-variant during the cycle of the cleaning program).
    First group of objects 13B
  • The method comprises the step of acquiring a second image 14 representative of the first group of objects 13B once a first preset period of time T1 has elapsed from the start of a cleaning program.
  • Preferably, this first period of time T1 must be greater than a few seconds, affording a check on whether the objects of the first group 13b have moved or are moving in the washing area 2.
  • In a preferred embodiment, this first period of time T1 is greater than three seconds and not greater than four minutes. During this interval, a check may be made on whether the impeller/s 5 are rotating and that the door 7 of the dispenser 6 has been actually opened.
  • In one aspect, the optical devices 8 that are preferably used to acquire the second image 14 are those placed in the lower portion 2' of the washing area 2.
  • The method comprises a step 15 of digitally processing the second acquired image 14 to obtain a second processed image 15A, wherein this second processed image 15A defines a second contour for each object of said first group of objects 13B.
  • The method comprises a step 16 of comparing the first filtered image 13A with the second processed image 15A to assess whether the first contour of each object of said first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A a critical change-of-operating-state condition through the user interface 9.
  • In other words, once the period T1 after the start of the cleaning program has elapsed, the control unit 4 will actuate the optical device/s 8 to acquire the second image 15A to check whether the contour of the objects of the first group of objects 13b has been moved or is moving.
  • In the case of the impeller/s 5, the control unit 4 can check whether they are moved, to indicate a first critical condition 16A through the user interface 9, if an obstacle blocks their movement.
  • This also applies to the door 7 of the dispenser 6.
  • Therefore, the signal associated with the first critical condition 16A allows the user to learn through the interface 9 whether:
    • the rotation of the impeller/s 5 is blocked or hindered,
    • the door 7 of the dispenser has not been opened.
  • In one aspect, downstream from (or possibly at the same time as) the step of indicating the first critical condition 16A, the cleaning program is designed to proceed as expected, be changed in response to this first critical condition 16A that has been detected or stopped until the normal operating conditions will be restored.
  • Second group of objects 13D
  • The step of filtering 13 according to the first contour of each object can filter the first processed image 12a to additionally or alternatively obtain a second filtered image 13C, the second filtered image defining a second group of objects 13D.
  • This second group of objects 13D represents the objects S of the plurality of objects S, 5 and 7 that are stationary relative to the washing area 2.
  • As mentioned above, the objects that are required to be stationary relative to the washing area 2 are the dishware S.
  • The method comprises a step of acquiring a third image 18 representative of the second group of objects once a second preset period of time T2 has elapsed from the start of the cleaning program.
  • Preferably, this second period of time T2 must be greater than a few seconds, affording a check on whether the objects of the second group are still, i.e. do not move in the washing area 2.
  • In one embodiment, this second period of time T2 is greater than one minute.
  • In one aspect, the optical devices 8 that are preferably used to acquire the third image 18 are those placed in the side walls 2B and 2C.
  • The method comprises the step 19 of digitally processing the third acquired image 18 to obtain a third processed image 19A, wherein this third processed image 19A defines a second contour for each object of said second group of objects 13D.
  • The method comprises a step 20 of comparing the second filtered image 13C with the third processed image 19A to assess whether the first contour of each object of the second group of objects 13B coincides with the respective second contour and, if it doesn't, notifying 20A a critical change-of-operating-state condition through the user interface 9.
  • In order to make sure that the first group of objects is movable during the cleaning program, or more particularly when the cleaning program requires the impellers to be movable, the method includes repeating the steps 14, 15 and 16, namely acquiring the second image representative of the first group of objects 13B, once the first preset period of time T1 from the start of the cleaning program has elapsed, at regular or random intervals, to thereby provide a plurality of second images, spaced in time, representative of the position of the first group of objects 13B relative to the washing area 2.
  • By this repetition of the steps 14, 15 and 16, a comparison may be made with the first filtered image 13A, to assess whether the first contour of each object of the first group of objects 13B coincides with the respective second contour and, if it does, notifying 16A the change-of-operating-state condition through the user interface 9.
  • In other words, the control unit 4 instructs the optical device/s 8 to acquire additional second images 14, the acquisition occurring at regular or random intervals. These second images 14 are processed to define the new contours of the objects. These new contours are compared with the respective contours of the first filtered image 13A to assess whether a displacement has occurred. If the contours coincide, a change of the operating state is notified through the user interface 9.
  • Mutatis mutandis, the method comprises the same procedure for the second group of objects 13D, with the exception that a change of the operating state is notified if the new contours do not coincide with those of the second filtered image.
  • Particularly, the method includes repeating the steps 18, 19 and 20 to assess, by a comparison with the second filtered image 13C, whether the first contour of each object of the second group of objects 13D coincides with the respective second contour and, if it doesn't, notifying 20A a second critical change-of-operating-state condition through the user interface 9.
  • Therefore, the signal associated with the second critical condition 20A allows the user to learn through the interface 9 whether the dishware S have changed their position.
  • In one aspect, downstream from (or possibly at the same time as) the step of indicating the second critical condition 20A, the cleaning program is designed to proceed as expected, be changed in response to this second critical condition 20A that has been detected or stopped until the normal operating conditions will be restored.
  • In one aspect, i.e. the processing steps 12, 15 and 19 comprise a process through which the images 13A, 13C are divided, with a reference grid being placed thereon, to compare the grid with the respective grid of the images 15A and 19A acquired at later times.
  • Particularly, by comparing the spatial position of the contours of the acquired objects S, 5 and 7 in the images 13A, 13C, with the respective grids as a reference, with the contours of the objects S, 5 and 7 of the images 15a and 19A acquired at later times, with the new respective grids as a reference, an assessment may be made of whether the objects of the first group 13b have moved or the objects of the second group are still stationary relative to the washing area 2. The comparison of the contour of an object that lies within a grid of the initial image with the corresponding grid of the next image in time allows appreciation of a possible displacement (or non-displacement) of the object being captured.
  • As mentioned above, the method and the dishwashing machine 1 allow a change of the operating state of the machine to be notified through the user interface 9, allowing actions to be taken to restore the proper installation conditions of the object. This will reduce the need to wash part of the dishware and/or repeat the washing cycle, leading the water, detergent and power consumption.
  • Those skilled in the art will obviously appreciate that a number of changes and variants as described above may be made to fulfill particular requirements, without departure from the scope of the invention, as defined in the following claims.

Claims (12)

  1. Method of automatically assessing the displacement of an object (S, 5, 7) in a washing area (2) of a dishwashing machine (1), said dishwashing machine comprising a door (3), designed to be associated with said washing area (2) to close it, and being configured to implement a cleaning program and to be in signal communication with a user interface (9), the method comprising the steps of:
    - providing (10) a plurality of objects (S, 5, 7) in said washing area (2);
    - acquiring a first digital image (11) representative of said plurality of objects (S, 5, 7);
    - digitally processing (12) said first acquired image (11) to obtain a first processed image (12A); wherein said first processed image (12A) defines a first contour for each object of said plurality of objects (S, 5, 7);
    - according to said first contour of each object, filtering (13) said first processed image (12A) to obtain a first filtered image (13A), wherein said first filtered image (13A) defines a first group of objects (13B), wherein said first group of objects (13B) represents the objects (5, 7) of said plurality of objects (S, 5, 7) that are movable relative to the washing area (2) during said cleaning program, said first group of objects (13B) comprising at least one component of said dishwashing machine (1);
    - acquiring a second digital image (14) representative of said first group of objects (13B) once a first preset period (T1) has elapsed from the start of a cleaning program;
    - digitally processing (15) said second acquired image (14) to obtain a second processed image (15A), wherein said second processed image (15A) defines a second contour for each object of said first group of objects (13B);
    - comparing (16) said first filtered image (13A) with said second processed image (15A) to assess whether the first contour of each object of said first group of objects (13B) coincides with the respective second contour and, if it does, notifying a first critical change-of-operating-state condition (16A) through said user interface (9);
    - said method being characterized by the steps of:
    - according to said first contour of each object, filtering said first processed image (12A) to obtain a second filtered image (13C), wherein said second filtered image (13C) defines a second group of objects (13D), wherein said second group of objects (13D) represents the objects of said plurality of objects (S, 5, 7) that are fixed relative to the washing area (2) during said cleaning program;
    - acquiring a third image (18) representative of said second group of objects once a second preset period (T2) has elapsed from the start of a cleaning program;
    - digitally processing (19) said third acquired image (18) to obtain a third processed image (19A), wherein said third processed image (19A) defines a second contour for each object of said second group of objects (13D);
    - comparing (20) said second filtered image (13C) with said third processed image (19A) to assess whether the first contour of each object of said second group of objects (13D) coincides with the respective second contour and, if it does not, notifying a second critical change-of-operating-state condition (20A) through said user interface (9).
  2. A method as claimed in claim 1, wherein said step of acquiring said first digital image (12) occurs once said door (3) has been closed and when said cleaning program has not been started yet.
  3. A method as claimed in claim 1, which comprises repeating at regular or random intervals, once the first preset period of time (T1) has elapsed from the start of a cleaning program, the step of acquiring a second digital image (14), digitally processing (15) said second acquired image (14) to obtain a second processed image (15A) and comparing (16) said first filtered image (13A) with said second processed image (15A) to obtain a plurality of second images, spaced over time, representative of the position of the first group of objects (13B) relative to the washing area (2).
  4. A method as claimed in claim 1, which comprises repeating at regular or random intervals, once the second preset period of time (T2) has elapsed from the start of a cleaning program, the step of acquiring a third digital image (18), digitally processing (19) said third acquired image (18) to obtain a third processed image (19A) and comparing (20) said second filtered image (13C) with said third processed image (19A) to obtain a plurality of third images, spaced over time, representative of the position of the second group of objects (13D) relative to the washing area (2).
  5. A method as claimed in claim 1, wherein said first group (13B) comprises a component (5, 7) of the dishwashing machine which is movable between first and second operating positions.
  6. A method as claimed in claim 1, wherein said second group (13D) comprises a plurality of dishware items (S).
  7. A method as claimed in any of the preceding claims 1, wherein said steps of processing (12, 15 and 19) comprise a process through which said first or second filtered images (13A, 13C) are placed on a reference grid to compare such grid with the respective grid of the second or the third processed image (15A and 19A).
  8. A method as claimed in claim 1, wherein, downstream from said step of notifying said first critical condition (16A) or said second critical condition (20A), said cleaning program is changed, according to said first critical condition (16A) or second critical condition (20A) that has been notified, or stopped.
  9. A dishwashing machine comprising a washing area (2) and a door (3) designed to be associated with said washing area (2) to close it, a control unit (4) having a memory with a cleaning program stored therein, a pump adapted to be connected to a water mains supply connection to withdraw water from the mains, one or more impellers (5) in fluid communication with such pump, a dispenser (6) having a door (7) configured to move between a closed position to an open position, one or more optical devices (8) that can acquire digital images of said washing area (2) and a user interface (9), said one or more optical devices (8) and user interface (9) being in signal communication with said control unit (4) as well as said pump, characterized in that it comprises a program residing in another portion of said memory, which is configured to carry out the steps as claimed in any of the preceding claims 1 to 8.
  10. A dishwashing machine as claimed in claim 9, wherein said user interface is a screen (23) integrated in said dishwashing machine, said screen (23) being configured to display a first critical condition (16A) and/or a second critical condition (20A) due to a change of the operating state, through warning lights, texts and/or images.
  11. A dishwashing machine as claimed in claim 9, wherein said dishwashing machine comprises a radio transmitting apparatus and said user interface is a portable device (22) having its own radio transmitting apparatus configured to establish a signal communication with said radio transmitting apparatus of said dishwashing machine (2) to thereby receive data representative of said change of the operating state, said portable device having its own screen, which is configured to display said change of the operating state through warning lights, messages and/or images.
  12. A system for automatically assessing the displacement of an object (S, 5, 7) in a washing area (2) of a dishwashing machine (1), comprising:
    a dishwashing machine (1) comprising a washing area (2) and a door (3) designed to be associated with said washing area (2) to close it, a control unit (4) having a memory with a cleaning program stored therein, a pump adapted to be connected to a water mains supply connection to withdraw water from the mains, one or more impellers (5) in fluid communication with such pump, a dispenser (6) having a door (7) configured to move between a closed position to an open position, one or more optical devices (8) that can acquire digital images of said washing area (2) and a user interface (9), said one or more optical devices (8) and user interface (9) being in signal communication with said control unit (4) as well as said pump, and a transmitting/receiving radio apparatus;
    - a portable device (22) designed to be handheld by a user, having its own radio transmitting/receiving apparatus configured to establish a signal communication with said radio transmitting/receiving apparatus of said dishwashing machine, a screen configured to display warning lights, messages and/or images and a memory,
    characterized in that it comprises a program residing in a portion of said memory of the user-handheld portable device (22), said program being configured to carry out the steps as claimed in any of the preceding claims 1 to 8, for a first or second critical change-of-operating-state condition (16A, 20A) to be displayed on said interface (9) and/or said screen of said user-handheld portable device.
EP18182619.9A 2017-07-13 2018-07-10 Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine Active EP3427630B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
IT102017000078567A IT201700078567A1 (en) 2017-07-13 2017-07-13 Method for automatically evaluating the movement of an object within a washing area of a dishwasher machine.

Publications (2)

Publication Number Publication Date
EP3427630A1 true EP3427630A1 (en) 2019-01-16
EP3427630B1 EP3427630B1 (en) 2020-05-13

Family

ID=60570038

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18182619.9A Active EP3427630B1 (en) 2017-07-13 2018-07-10 Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine

Country Status (5)

Country Link
EP (1) EP3427630B1 (en)
CN (1) CN109247886B (en)
ES (1) ES2805458T3 (en)
IT (1) IT201700078567A1 (en)
RU (1) RU2760379C2 (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019104519A1 (en) * 2019-02-22 2020-08-27 Miele & Cie. Kg Recording device for detecting a washing area for a cleaning device and cleaning device
DE102019110795A1 (en) * 2019-04-26 2020-10-29 Miele & Cie. Kg Dishwasher with an image acquisition device and method for operating such a dishwasher
EP3741284A1 (en) * 2019-05-21 2020-11-25 Miele & Cie. KG Dishwasher with an image acquisition device and method for operating such a dishwasher
EP3788933A1 (en) * 2019-09-05 2021-03-10 BSH Hausgeräte GmbH Method for controlling a home appliance
CN112716407A (en) * 2020-12-31 2021-04-30 佛山市顺德区美的洗涤电器制造有限公司 Washing method and device for dish washing machine and dish washing machine
US11026559B2 (en) 2019-09-30 2021-06-08 Midea Group Co., Ltd. Dishwasher with image-based fluid condition sensing
US11058281B2 (en) 2019-06-20 2021-07-13 Midea Group Co., Ltd. Dishwasher including rack position sensor to control capture of rack images by a camera
US11185209B2 (en) 2019-11-20 2021-11-30 Midea Group Co., Ltd. Dishwasher steam generator
US11191416B2 (en) 2019-09-30 2021-12-07 Midea Group Co., Ltd. Dishwasher with image-based position sensor
US11202550B2 (en) 2019-11-20 2021-12-21 Midea Group Co., Ltd. Dishwasher thermal imaging system
US11259681B2 (en) 2019-09-30 2022-03-01 Midea Group Co., Ltd Dishwasher with image-based diagnostics
EP3973843A1 (en) * 2020-09-29 2022-03-30 LG Electronics Inc. Dishwasher and method for detecting camera failure by dishwasher
US11399690B2 (en) 2019-09-30 2022-08-02 Midea Group Co., Ltd. Dishwasher with cam-based position sensor
US11464389B2 (en) 2019-09-30 2022-10-11 Midea Group Co., Ltd. Dishwasher with image-based detergent sensing
US11484183B2 (en) 2019-09-30 2022-11-01 Midea Group Co., Ltd. Dishwasher with image-based object sensing
EP4085815A1 (en) * 2021-05-04 2022-11-09 Miele & Cie. KG Dishwasher
US11737638B2 (en) 2021-03-16 2023-08-29 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for determination of door position
US11825999B2 (en) 2021-02-17 2023-11-28 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for basket detection
EP4344598A1 (en) * 2022-09-28 2024-04-03 Illinois Tool Works Inc. Conveyor dishwasher and method for operating a conveyor dishwasher
EP4491089A1 (en) * 2023-07-10 2025-01-15 Miele & Cie. KG Method and control unit for operating a cleaning device and cleaning device
US12232680B2 (en) 2022-08-24 2025-02-25 Haier Us Appliance Solutions, Inc. Clean dish verification using a camera assembly in a dishwasher appliance
US12251065B2 (en) 2022-08-24 2025-03-18 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for determination of spray assembly operation

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10809685B2 (en) 2019-03-18 2020-10-20 Midea Group Co., Ltd. Dishwasher with cloud connected cameras
CN112773291B (en) * 2021-01-07 2022-04-26 佛山市顺德区美的洗涤电器制造有限公司 Control method for dish washing machine, processor, control device and dish washing machine
CN112806932B (en) * 2021-01-07 2022-02-01 佛山市顺德区美的洗涤电器制造有限公司 Method for a dishwasher, control device, processor and dishwasher
CN112914455A (en) * 2021-01-25 2021-06-08 佛山市顺德区美的洗涤电器制造有限公司 Control method, processor and device for dish washing machine and dish washing machine

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120138092A1 (en) 2010-12-01 2012-06-07 Whirlpool Corporation Dishwasher with imaging device for measuring load characteristics and a method for controlling same
WO2016008699A1 (en) 2014-07-17 2016-01-21 BSH Hausgeräte GmbH Dishwasher, in particular domestic dishwasher with a rotatably mounted optical detection means
DE102015102694A1 (en) * 2015-02-25 2016-08-25 Miele & Cie. Kg Method for determining the rotational speed of a spray arm of a dishwasher

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2623077B1 (en) * 1987-11-13 1991-06-07 Bonnet Sa BASKET FEEDING DEVICE FOR DISHWASHER
US6196239B1 (en) * 1999-07-06 2001-03-06 Mark W. Eskey Dishwasher status indicator
ES2343033T3 (en) * 2007-02-14 2010-07-21 Electrolux Home Products Corporation N.V. WASHING MACHINE WITH LIQUID WASHING AGENTS DISPENSER.
DE102008043576A1 (en) * 2008-11-07 2010-05-12 BSH Bosch und Siemens Hausgeräte GmbH Method for operating a dishwasher
JP2010142317A (en) * 2008-12-17 2010-07-01 Panasonic Corp Dishwasher/drier
DE102008055018A1 (en) * 2008-12-19 2010-06-24 BSH Bosch und Siemens Hausgeräte GmbH Method for operating a dishwasher
DE102009023252A1 (en) * 2009-05-29 2010-12-02 BSH Bosch und Siemens Hausgeräte GmbH dishwasher
WO2011048575A2 (en) * 2009-10-23 2011-04-28 Ecolab Inc. Optical processing to control a washing apparatus
DE102013207359B4 (en) * 2013-04-23 2017-04-27 BSH Hausgeräte GmbH Dishwasher with at least one functional component associated optical display
KR102128283B1 (en) * 2013-11-11 2020-06-30 삼성전자주식회사 Dishwasher and controlling method thereof
KR102046046B1 (en) * 2013-12-31 2019-11-18 삼성전자주식회사 A dish washing machine and a method of controlling the dish washing machine

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120138092A1 (en) 2010-12-01 2012-06-07 Whirlpool Corporation Dishwasher with imaging device for measuring load characteristics and a method for controlling same
WO2016008699A1 (en) 2014-07-17 2016-01-21 BSH Hausgeräte GmbH Dishwasher, in particular domestic dishwasher with a rotatably mounted optical detection means
DE102015102694A1 (en) * 2015-02-25 2016-08-25 Miele & Cie. Kg Method for determining the rotational speed of a spray arm of a dishwasher

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019104519A1 (en) * 2019-02-22 2020-08-27 Miele & Cie. Kg Recording device for detecting a washing area for a cleaning device and cleaning device
DE102019110795A1 (en) * 2019-04-26 2020-10-29 Miele & Cie. Kg Dishwasher with an image acquisition device and method for operating such a dishwasher
EP3741284A1 (en) * 2019-05-21 2020-11-25 Miele & Cie. KG Dishwasher with an image acquisition device and method for operating such a dishwasher
DE102019113414A1 (en) * 2019-05-21 2020-11-26 Miele & Cie. Kg Dishwasher with an image acquisition device and method for operating such a dishwasher
US11058281B2 (en) 2019-06-20 2021-07-13 Midea Group Co., Ltd. Dishwasher including rack position sensor to control capture of rack images by a camera
EP3788933A1 (en) * 2019-09-05 2021-03-10 BSH Hausgeräte GmbH Method for controlling a home appliance
WO2021043624A1 (en) * 2019-09-05 2021-03-11 BSH Hausgeräte GmbH Method for controlling a home appliance
CN114340468A (en) * 2019-09-05 2022-04-12 Bsh家用电器有限公司 Method for controlling household appliances
US11464389B2 (en) 2019-09-30 2022-10-11 Midea Group Co., Ltd. Dishwasher with image-based detergent sensing
US11766160B2 (en) 2019-09-30 2023-09-26 Midea Group Co., Ltd. Dishwasher with image-based position sensor
US11191416B2 (en) 2019-09-30 2021-12-07 Midea Group Co., Ltd. Dishwasher with image-based position sensor
US12251066B2 (en) 2019-09-30 2025-03-18 Midea Group Co., Ltd. Dishwasher with image-based diagnostics
US11259681B2 (en) 2019-09-30 2022-03-01 Midea Group Co., Ltd Dishwasher with image-based diagnostics
US12042111B2 (en) 2019-09-30 2024-07-23 Midea Group Co., Ltd. Dishwasher with cam-based position sensor
US11026559B2 (en) 2019-09-30 2021-06-08 Midea Group Co., Ltd. Dishwasher with image-based fluid condition sensing
US11399690B2 (en) 2019-09-30 2022-08-02 Midea Group Co., Ltd. Dishwasher with cam-based position sensor
US11896182B2 (en) 2019-09-30 2024-02-13 Midea Group Co., Ltd. Dishwasher with image-based object sensing
US11484183B2 (en) 2019-09-30 2022-11-01 Midea Group Co., Ltd. Dishwasher with image-based object sensing
US11889966B2 (en) 2019-09-30 2024-02-06 Midea Group Co., Ltd. Dishwasher with image-based object sensing
US11877711B2 (en) 2019-09-30 2024-01-23 Midea Group Co., Ltd. Dishwasher with image-based detergent sensing
US11185209B2 (en) 2019-11-20 2021-11-30 Midea Group Co., Ltd. Dishwasher steam generator
US11202550B2 (en) 2019-11-20 2021-12-21 Midea Group Co., Ltd. Dishwasher thermal imaging system
US11864705B2 (en) 2019-11-20 2024-01-09 Midea Group Co., Ltd. Dishwasher thermal imaging system
EP3973843A1 (en) * 2020-09-29 2022-03-30 LG Electronics Inc. Dishwasher and method for detecting camera failure by dishwasher
CN112716407A (en) * 2020-12-31 2021-04-30 佛山市顺德区美的洗涤电器制造有限公司 Washing method and device for dish washing machine and dish washing machine
US11825999B2 (en) 2021-02-17 2023-11-28 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for basket detection
US11737638B2 (en) 2021-03-16 2023-08-29 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for determination of door position
EP4085815A1 (en) * 2021-05-04 2022-11-09 Miele & Cie. KG Dishwasher
BE1029372B1 (en) * 2021-05-04 2022-12-05 Miele & Cie dishwasher
US12232680B2 (en) 2022-08-24 2025-02-25 Haier Us Appliance Solutions, Inc. Clean dish verification using a camera assembly in a dishwasher appliance
US12251065B2 (en) 2022-08-24 2025-03-18 Haier Us Appliance Solutions, Inc. Dishwasher appliance with camera for determination of spray assembly operation
EP4344598A1 (en) * 2022-09-28 2024-04-03 Illinois Tool Works Inc. Conveyor dishwasher and method for operating a conveyor dishwasher
EP4491089A1 (en) * 2023-07-10 2025-01-15 Miele & Cie. KG Method and control unit for operating a cleaning device and cleaning device
BE1031788B1 (en) * 2023-07-10 2025-02-11 Miele & Cie Method and control unit for operating a cleaning device and cleaning device

Also Published As

Publication number Publication date
RU2760379C2 (en) 2021-11-24
IT201700078567A1 (en) 2019-01-13
RU2018125039A (en) 2020-01-09
RU2018125039A3 (en) 2021-09-16
CN109247886B (en) 2022-07-29
EP3427630B1 (en) 2020-05-13
CN109247886A (en) 2019-01-22
ES2805458T3 (en) 2021-02-12

Similar Documents

Publication Publication Date Title
EP3427630B1 (en) Method for automatically assessing the displacement of an object in a washing area of a dishwashing machine
EP3476269B1 (en) Method of automatically assessing the type of detergent in use in a dishwashing machine
US10157308B2 (en) Interaction recognition and analysis system
US11759086B2 (en) Household dishwasher machine, system comprising household dishwasher machine, and method for operating a household dishwasher machine
CN107447442B (en) Alarm method based on image recognition technology and intelligent device
US10260269B2 (en) Water-conducting domestic appliance and method for operating a water-conducting domestic appliance
CN114364297B (en) System and method for suggesting object placement
CN111580396A (en) Washing control method, dishwasher, and storage medium
US10762641B2 (en) Interaction recognition and analysis system
EP3517015B1 (en) Method for automatically evaluating the degree of cleanliness of the filtering system in a dishwashing machine
CN112869679B (en) Control method and device for dish washing machine, dish washing machine and processor
US20140192182A1 (en) Method for viewing virtual objects within an appliance
US20230124027A1 (en) Systems and methods for capturing images for use in artificial intelligence processes in a laundry appliance
EP3524125B1 (en) Method for automatically evaluating the presence of foam in a dishwashing machine
EP3725208B1 (en) Dishwasher with optical device and illumination device
US12180636B2 (en) Leftover load detection method using image recognition in a laundry appliance
US12251070B2 (en) Methods of monitoring the load state of a dishwashing appliance
US11957292B2 (en) Dishwasher coverage alert system and method
CN105451626A (en) Detecting opening of a washing agent dispenser lid in a dishwasher
RU2772954C2 (en) Method for automatic assessment of presence of foam in dishwasher
RU2776938C2 (en) Method for automatic assessment of purity degree of filtration system of dishwasher
US12251065B2 (en) Dishwasher appliance with camera for determination of spray assembly operation
US20240423440A1 (en) Dishwashing appliance and methods of operation for future cycle protection
US20240110324A1 (en) Systems and methods for prompting image capture for a laundry appliance
US20200359872A1 (en) Rack detection system for child safety and a method of controlling a dishwasher

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190715

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200108

RIN1 Information on inventor provided before grant (corrected)

Inventor name: FUMAGALLI, ALDO

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018004451

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1269120

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200615

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200914

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200913

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200814

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200813

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1269120

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2805458

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20210212

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018004451

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20210216

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200710

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20230801

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240628

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20240524

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240719

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20240725

Year of fee payment: 7

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20240801

Year of fee payment: 7

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602018004451

Country of ref document: DE

Owner name: CANDY S.P.A., IT

Free format text: FORMER OWNER: CANDY S.P.A., MONZA, IT