FR3133258A1 - systems, devices and processes for optimizing a cosmetic manufacturing process - Google Patents

Abstract

S SYSTEMS, DEVICES AND METHODS FOR OPTIMIZING A COSMETIC MANUFACTURING PROCESS A system configured to execute a contest includes displaying an image of a face of one of a plurality of models to a user; receiving inputs from the user to adjust a color of a mixed cosmetic product to be applied to the model's face; displaying the model with the adjusted color selected by the user; receiving the image of the model's face with the adjusted color as input from the user; displaying the user input to a plurality of users and providing the plurality of users with an option to submit a vote on the user input and the inputs of other users; providing the output of a result of a competition based on one or more entries receiving the greatest number of votes. The system further transmits an instruction to a cartridge manufacturing facility of a dispensing device to create a multipack of cartridges for the determined plurality of colors. Figure for abstract: NIL

Description

systems, devices and processes for optimizing a cosmetic manufacturing process CONTEXT Domain

The present disclosure generally relates to a system, apparatus and method for determining a combination of cosmetic materials that can be mixed and dispensed for a particular user.

SUMMARY

A system includes processing circuitry configured to execute a contest that includes displaying an image of a face of one of a plurality of models to a user; receiving inputs from the user to adjust a color of a mixed cosmetic product to be applied to the model's face; displaying the model with the adjusted color selected by the user; receiving the image of the model's face with the adjusted color as input from the user; displaying the user input to a plurality of users and providing the plurality of users with an option to submit a vote on the user input and the inputs of other users; providing the output of a result of a competition based on one or more entries receiving the greatest number of votes; wherein the processing circuitry is further configured to: determine a plurality of color ingredients used for the adjusted colors in one or more entries receiving the highest number of votes, the color ingredients corresponding to cartridges used in a device distribution to produce the mixed cosmetic product; transmitting an instruction to a cartridge manufacturing facility to create a multi-pack of cartridges for the determined plurality of color ingredients.

The system may include one or more of the following characteristics, taken in isolation or in any technically possible combination:

• the competition also includes:
  • displaying an image of a face of one of a plurality of models to a user;
  • receiving user inputs to adjust a color of a mixed cosmetic product to apply to the model's face;
  • displaying the model with the adjusted color selected by the user; And
  • receiving the image of the model's face with the adjusted color as user input;
• a number of cartridges in the cartridge bundle corresponds to a number of cartridges that are stored simultaneously in the dispensing device;
• the processing circuitry is further configured to:
  • determining a particular color among the adjusted colors in one or more entries receiving the greatest number of votes; And
  • transmitting an instruction to the cartridge manufacturing facility to create a batch pack of cartridges to produce the particular color determined with the dispensing device;
• the processing circuitry is further configured to:
  • determining a plurality of most frequent ingredients in the adjusted colors in the one or more inputs; And
  • transmitting an instruction to the cartridge manufacturing facility to create a cartridge bundle that includes the plurality of the most common ingredients;
• the processing circuitry is further configured to transmit an instruction to a cartridge manufacturing facility to adjust manufacturing volumes to prioritize the production of cartridges corresponding to the determined plurality of color ingredients;
• the processing circuitry is further configured to transmit the instruction to a particular manufacturing facility of the cartridges in a specific geographic region based on the collection of voting data in the contest from the specific geographic region;
• the contest is configured to end before a season or event, and the end of the contest automatically triggers the processing circuitry to transmit the instruction to the manufacturing facility;
• the processing circuitry is further configured to display a link for purchasing a mixed cosmetic product corresponding to the entry receiving the greatest number of votes;
• the processing circuitry is configured to transmit the instruction to the manufacturing facility a predetermined time before displaying the link.

The patent or application file contains at least one drawing executed in color. A fuller appreciation of the disclosure and the many advantages which flow therefrom will readily be obtained by reference to the detailed description which follows when considered in connection with the accompanying drawings, in which:

There is an overall perspective view of a cosmetic dispensing device, or a cosmetic dispenser, according to one example;

There is a perspective view of a distributor body, according to an example;

There is a perspective view of the cosmetic dispenser with the dispenser body removed, according to one example;

[Fig. 4A] [Fig. 4A] is a perspective view of internal components of the cosmetic dispenser, according to one example;

[Fig. 4B] [Fig. 4B] is a perspective view of internal components of the cosmetic dispenser, according to one example;

There is a perspective view of a cartridge, according to an example;

There is a perspective view of a cartridge gear, according to one example;

[Fig. 7A] [Fig. 7A] is a perspective view of a bottom plate, according to an example;

[Fig. 7B] [Fig. 7B] is a perspective view of the bottom plate, seen from below, according to an example;

There is a perspective view of a base, according to an example;

[Fig. 9A] [Fig. 9A] is an exploded perspective view of a compact, placed above a collector, according to an example;

[Fig. 9B] [Fig. 9B] is a perspective view of the compact in the open position, according to an example;

There is a diagram representing an example of a sequence of primary processes of a cosmetic formulation process 900, according to one example;

There is a process diagram showing an example process of detecting cosmetic material in the cosmetic dispenser, according to one example;

[Fig. 12A] [Fig. 12B] Figures 12A and 12B are process diagrams showing examples of processes for selecting a cosmetic formulation, according to one example;

There is a process diagram showing an example of a cosmetic material dispensing process in the cosmetic dispenser, according to one example.

There is a diagram representing an example of a connected cosmetics distribution system, according to an example; And

There is a diagram representing an example of circuitry of the control device and the cosmetic dispenser, according to one example.

There shows the components of an ecosystem that uses the cosmetic dispenser to manufacture personalized doses for a user.

There shows an ecosystem whose objective is to offer a trendy lipstick color to a user.

[Fig. 18A] [Fig. 18A] shows an example flow of operations in the ecosystem to distribute a personalized lipstick shade from the app perspective.

[Fig. 18B] [Fig. 18B] shows an additional flowchart of how smartphone app algorithms in the lipstick ecosystem can allow a user to visualize a lipstick shade in the user's self-portrait.

[Fig. 18C] The [Fig. 18C] further illustrates how the specific set of cartridges can result in different hue universes to be presented to the user.

[Fig. 18D] [Fig. 18D] shows how a “match my style” mode can work on the app in the lipstick ecosystem.

[Fig. 18E] The [Fig. 18E] shows details of how the lipstick recommendation engine based on the user's outfit selfie works.

There shows an ecosystem whose objective is to offer the user a skincare formulation that is most effective for them.

[Fig. 20A] [Fig. 20A] shows an example of an ecosystem operation flow for distributing a personalized skincare formulation from an app perspective.

[Fig. 20B] [Fig. 20B] shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges.

There shows an ecosystem used to distribute personalized foundation to a user.

[Fig. 22A] [Fig. 22A] shows an example of an operation flow in the ecosystem for distributing personalized foundation from an app perspective.

[Fig. 22B] [Fig. 22B] provides details of a method for performing a skin tone diagnosis.

[Fig. 22C] [Fig. 22D] Figures 22C and 22D show details of how deep learning is used to estimate skin tone in an image.

There shows the structure of a cartridge with an NFC tag.

There shows a data format of the data stored on the NFC tag of the cartridge.

There shows a table that includes descriptions of the different fields contained in the NFC tag data format.

There shows a structure of the dispensing device equipped with a system of intelligent exchangeable cartridges.

There shows a handshake between the dispensing device and a user's smartphone.

There shows the consumer app state machine which shows a process, from the app's perspective, of priming cartridges prior to any use of the dispensing device.

There shows a method for handling a defective cartridge NFC tag in the aforementioned scenario.

[Fig. 30A] [Fig. 30B] [Fig. 30C] Figures 30A to 30C show a first type of game that uses a color wheel interface for a dispensing device.

There shows a graph where data is collected regarding user selections on the color wheel interface.

There shows a flowchart based on a game calibration feature that uses the color wheel interface.

There shows a second type of game that uses a color wheel interface for a dispensing device.

There shows a third type of game that uses a color wheel interface for a dispensing device.

There shows an example user design challenge that uses the color wheel interface for a dispensing device.

[Fig. 36A] [Fig. 36B] Figures 36A and 36B show different screens displayed to the user while the user participates in the user design challenge.

There shows a user design challenge variation.

Figures 38 and 39 show example screens for different specific types of challenges for different themes.

There shows a process of generating a recommended cosmetic shade for a user based on the user's image and the results of a design challenge.

Figures 41 and 42 show different processes for bundling cosmetic cartridges into a single package based on the results of a design challenge.

There shows a screen displayed at the end of a design challenge that allows a user to purchase the cartridge bundles based on the results of the challenge.

detailed description of the embodiments

In the drawings, like numerals designate identical or corresponding parts in the different views. In addition, when used herein, the words "a", "an" and the like generally have the meaning of "one or more", unless otherwise indicated.

Referring now to the drawings, in which the reference numerals designate identical or corresponding parts in the different views.

The selection of cosmetic formulations and component cosmetic materials to formulate cosmetic formulations is a common activity that often relies on subjective decision-making and manual input. There are a wide variety of cosmetic materials available, and countless combinations and permutations of cosmetic formulations possible.

For each occasion where cosmetic formulations are used, subjective decisions are often made by a cosmetic end user to produce satisfactory cosmetic formulations. Results are generally the result of experimentation, sometimes requiring multiple iterations to achieve a satisfactory result. Partly due to limited knowledge of the specific characteristics of cosmetic base materials and the necessary proportions, the resulting cosmetic formulations may lack precision. Repeatability of production of a specific cosmetic formulation is therefore difficult to achieve. The embodiments below address these issues in classical art.

Specifically, the description below relates to an ecosystem for personalizing skin care and creating a formula customization system for use at home, which is based on a specialized dispensing device for instantly mixing skin care ingredients. a cosmetic product to achieve the end result desired by the user and then carry it conveniently.

The system shown below is a first-of-its-kind AI-powered 3-in-1 device that allows personalization of skincare, foundation and liquid lipstick at home. The device and its corresponding app assess users' individual skin and local environmental data to create and deliver personalized, on-site cosmetic and skincare formulas that optimize levels of personalization over time.

The overall ecosystem features a motorized AI-enabled cartridge system, as described above, that creates personalized cosmetic and skincare formulas in four steps. The device creates personalized skin serums using the following process:

1. Personal skin analysis: The user takes a photo with a smartphone camera and opens an app on the smartphone. The app uses AI to analyze the user's overall skin condition, assessing deep wrinkles, fine lines, dark spots, lack of firmness, pore visibility and lack of radiance.

2. Environmental Assessment: The app (and/or a cloud computing platform) assesses local environmental conditions that may influence the condition of the user's skin, including weather, temperature, humidity, UV index, air quality and pollen.

3. Product Preference: The user then enters their specific skincare concerns, such as fine lines, wrinkles, dark spots, rough skin texture, and dullness, into the app.

4. Custom Formulation and Delivery: A custom blend of high-performance skin care is then dispensed in a single serving at the top of the device.

The motor system, located at the top of the device, moves and compresses the formula from the cartridges at the base of the machine in an upward motion to the dispensing tray above for clean application.

With regular use, the AI platform can assess the appearance of a user's skin over time, helping users identify what works and calibrate future formulas. The AI-powered system can optimize the effectiveness of personalized formulas. By regularly taking photos, users allow the intelligent system to recognize the effects of the formulas, and adjust the dosage of active ingredients accordingly. That said, the user can override the system's recommendations if they want, for example, additional moisturizer.

The skin care system includes active ingredients such as AHAs, vitamins C and E, hyaluronic acid, ferulic acid, retinol, cucumber, thyme and mulberry.

Cosmetics offerings – foundation and liquid lipstick – will have the ability to integrate real-time trend information as well as color matching technology into their personalized product offerings, as described below.

- Using the Lipstick System, consumers will be able to create a liquid lipstick based on their skin tone and preferences. The system can match the shade of a user's clothing or accessories, or even choose to create a particular color that's trending on social media. The device will be equipped with three cartridges; Collectively, these cartridges will have the capacity to create hundreds of shades.

- The foundation system described below will contain three cartridges, ranging from light to deep tones. Knowing that foundation is never unique, a selection of these trios of colors can be offered in order to match the greatest variety of shades. Using a shade-matching tool, the three cartridges distribute different levels of color to create custom shades. The device has the ability to create hundreds of custom shades. The device creates a single dose of color, but users can easily double or triple the amount with additional pressure.

There are three dosage settings for the system described herein. There will be a standard-sized dose (0.7 grams, about the size of a pistachio) that users can double or triple with additional pressure.

The device has the particularity of being equipped with a detachable powder compact with mirror, which allows you to take a portion of the product with you.

Between opening the app, taking a photo of their face and dispensing the product, the user experience with the present system takes about three minutes.

[delivery device]

There is an overall perspective view of a cosmetic dispensing device 100, or a cosmetic dispenser, according to one example. The visible portion of the cosmetic dispenser 100 includes a base 102 connected to a power cord 104. The base 102 constitutes a support for the dispenser body 106. A compact 108 is disposed above the dispenser body 106, a button power button 110 may be disposed partially within the dispenser body 106 such that the dispenser body 106 anchors the placement of the power button 110, and an indicator light button 122 may be disposed partially therein of the dispenser body 106 such that the dispenser body 106 anchors the placement of the indicator light button 122. The indicator light button 122 may be a mechanical or capacitive touch-type button.

There is a perspective view of the distributor body 106, according to one example. The dispenser body 106 is a thin-walled hollow container that serves as a covering for a large portion of the components of the cosmetic dispenser 100. In this example, the dispenser body 106 has a first end at the top with a cross section of approximately square with rounded corners, while a second end at the bottom has a circular cross section. The dispenser body 106 may provide a base for the compact 108, or other components that serve as a base for the compact 108. The dispenser body 106 may also include a mounting point for the power button 110 and a mounting point assembly for the button with indicator light 122.

There is a perspective view of the cosmetic dispenser 100 with the dispenser body 106 removed, according to one example. The power button 110, the indicator light button 122, a controller 150, a bottom plate 166, an induction plate 176 and a gear case 170 are visible in this view, as well as a section of lower body 154, a middle body section 155 and an upper body section 156. The power button 110 is electrically connected to the controller 150.

The controller 150 includes circuitry for distributing power received by the power cord 104, controlling one or more motors 112 to dispense the cosmetic material, detecting readings from an optical encoder 192, charging one or more batteries 126 , operate indicators such as the indicator light button 122, chimes or other audio-visual signals, sensors, for example to detect the availability status, type and quantity of cosmetic material, and communicate wirelessly with external devices, including circuitry for sending and receiving signals and data, for example via smartphones and other wireless devices, using a variety of communications protocols, such as radio frequency (RF), Bluetooth, Wi-Fi or cellular.

The induction plate 176 supports the bottom plate 166, apart from the base 102 and the power cord 104, the rest of the cosmetic dispenser 100 is disposed on the bottom plate 166. The gear case 170 is disposed at the above, is connected to and provides support to the internal components of the cosmetic dispenser 100 which are described in more detail in Figures 4 to 9B. Additionally, the gear case 170 includes a plurality of gear case cartridge holes 178, one for each cartridge 114 in the cosmetic dispenser 100. A nozzle 160 of each cartridge 114 is disposed within the one of the gear case cartridge holes 178. Various additional substructures and covering elements may be disposed between the internal components of the cosmetic dispenser 100 and the dispenser body 106.

For example, the upper body section 156 is disposed above the central body section 155, and the lower body section 154 is disposed below the central body section 155. When connected, the dispenser body 106 attaches to the exterior of at least one of the lower body section 154, the middle body section 155 and the upper body section 156. The bottom plate 166 is disposed under the lower body section 154 and is connected to it.

[Fig. 4A] and [Fig. 4B] are perspective views of internal components of the cosmetic dispenser 100, according to one example. The internal assembly includes a plurality of distribution assemblies 120, disposed above the bottom plate 166 and the induction plate 176. Each distribution assembly 120 includes a cartridge 114, a cartridge gear 116, a motor 112, a motor gear 124, an ejector 140, an ejector index ring 190, an ejector spring 142, an ejector spring pin 144, a trigger plunger 146, and a trigger spring 152 The controller 150 controls the operation of each of the dispensing assemblies 120. The cosmetic dispenser 100 includes at least one dispensing assembly 120. The examples described herein contain three dispensing assemblies 120, although one person One of ordinary skill in the art will recognize that a cosmetic dispenser 100 may have any number of dispensing assemblies 120.

Additionally, a plurality of batteries 126 within the cosmetic dispenser 100 are electrically connected to the plurality of dispensing assemblies 120 to provide electrical power for operation of the controller 150, the dispensing assembly 120, the motor 112 and various indicators, such as the indicator light button 122 (described in more detail in ), chimes and other audiovisual signals.

The control device 150 and a connected device 300 (shown in ) allow a user to operate the cosmetic dispenser 100 wirelessly. Cosmetic material formulation and recipe orders addressed to the controller 150 may be received from the connected device 300, such as a smartphone, tablet or personal computer, configured to communicate with the cosmetic dispenser 100. Additionally , the dispensing of the cosmetic material can also be triggered by the user by pressing the indicator light button 122 on the cosmetic dispenser 100.

The cartridge 114 also has a cartridge key 162 disposed on or near the nozzle 160, is connected near a first end to the cartridge gear 116, is connected near a second end to the bottom plate 166, with a motor gear 124 connected to the motor 112, and the motor gear 124 drive connected to the cartridge gear 116. The cartridge 114 and the cartridge gear 116 are held in position by the gear housing 170 (shown on the ). The cartridge 114 may be disposed within the cosmetic dispenser 100, and secured in place by the ejector 140 connected to an ejector spring 142, the ejector spring pin 144 connected at a first end to the ejector spring 142 and rigidly connected at a second end to an interior surface of at least one of the distributor body 106, the lower body section 154, the middle body section 155, the upper body section 156, and other internal structures. The dispensing assembly 120 further includes an ejector indexing ring 190 (shown in [Fig. 4A]) to guide the movement of the ejector 140 within the cosmetic dispenser 100 during insertion and removing the cartridge 114, the ejector index ring 190 being disposed against the interior surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155 and the upper body section 156 to provide a guide for the movement of the ejector 140.

Additionally, a trigger plunger 146 may be disposed substantially perpendicular to a longitudinal axis of the cartridge 114 and connected near the second end of the cartridge 114, providing lateral pressure to a circumferential groove 134 of the cartridge 114, holding the cartridge 114 in place along the vertical axis Y, counteracting an opposing force applied by tension to the cartridge 114 by the ejector 140, the ejector spring 142, and an ejector spring pin 144. The ejector 140 is disposed inside the cosmetic dispenser 100 and can move substantially parallel to the cartridge 114, and is connected to the ejector spring 142 which is further connected to the ejector spring pin 144. When the cartridge 114 is inserted in the cosmetic dispenser 100, an edge of the ejector 140 contacts an edge near the first end of the cartridge 114. The ejector 140 applies pressure to the cartridge 114 when the ejector spring 142 springs. stretches with increasing distance between the fixed ejector spring pin 144 and the ejector 140, as the ejector 140 moves with the cartridge 114 further into the cosmetic dispenser 100. Once the cartridge 114 is inserted into the point where a first end of the trigger plunger 146 makes contact with the circumferential groove 134 of the cartridge 114, the movement of the cartridge 114 along the Y axis is limited, which holds the cartridge 114 in place.

The trigger plunger 146 is a mechanism for holding the cartridge 114 in place. The trigger plunger 146 moves along an axis substantially perpendicular to that of the major axis of the cartridge 114. A first end of the trigger plunger 146 is arranged to make contact with the cartridge 114. A second end is connected to a first end of a detent spring 152, the second end of the detent spring 152 contacting an interior surface of at least one of the valve body 106, the lower body section 154, the body section central 155, upper body section 156, or other internal structure. Insertion of cartridge 114 into cosmetic dispenser 100 moves trigger plunger 146 against trigger spring 152, compressing trigger spring 152. As the contour of cartridge 114 varies along the length of cartridge 114, the trigger plunger 146 and trigger spring 152 are moved by varying amounts depending on the position of cartridge 114 relative to cosmetic dispenser 100. At a point where trigger plunger 146 contacts the groove 134 of the cartridge 114, the first end of the trigger plunger 146 is capable of locking the cartridge 114 in place due to the pressure of the trigger spring 152 and the geometric relationship between the trigger plunger 146 and the circumferential groove 134 .

Further, the cartridge 114 is inserted into the cosmetic dispenser 100 through a cartridge through-hole 172 of the bottom plate 166. The cartridge through-hole 172 has a base key cutout 165 ([Fig. 7A]) shaped to match base key 164 so that when base key 164 and base key cutout 165 make contact, cartridge 114 cannot rotate relative to bottom plate 166. Cartridge 114 is also shaped to fit bottom plate 166 and cartridge gear 116 in a specific orientation. In the position where cartridge 114 is fully inserted into cosmetic dispenser 100 and locked in place by trigger plunger 146, cartridge 114 is placed against cartridge gear 116. Additionally, cartridge gear 116 has a collar portion 168 which is rotatably connected to the gear housing 170, restricting the movement of the cartridge gear 116 so that the cartridge gear 116 can rotate about a longitudinal axis but cannot rotate move axially or otherwise, and supporting the position of each of the cartridge gears 116 and the motor gears 124. Likewise, the motor gear 124 has a motor gear collar portion 169 which is rotatably connected to the gear housing 170, restricting the movement of the motor gear 124 so that the motor gear 124 can rotate about a longitudinal axis but cannot move axially or otherwise, preserving the relationship between the gear cartridge 116 and motor gear 124 such that rotary movement of motor gear 124 results in rotary movement of cartridge gear 116 at a fixed ratio.

Motor gear 124 may be a spur gear that includes a key cutout 163 ( ) which fits cartridge key 162 of cartridge 114, as described in [Fig. 4B].

There is a perspective view of the cartridge 114, according to an example. Cartridge 114 has a round, cylindrical body and a nozzle 160 at a first end. The nozzle 160 is further disposed near a cartridge key 162. The cartridge key 162 fits inside the opening of the cartridge gear 116, matches the shape of the key cutout 163 of the cartridge gear 116, and locks the rotational movement of the portion near a first end of the cartridge 114 with that of the cartridge gear 116. The cartridge gear 116 is driven by the cartridge gear 116. motor 124 and motor 112. A second end of cartridge 114 includes a base key 164. Base key 164 fits inside base key cutout 165 of bottom plate 166, securing the second end of the cartridge 114 to the bottom plate 166, and prevents the rotational movement of the second end of the cartridge 114 relative to the bottom plate 166. Since the first end of the cartridge 114 is secured to the movement of the cartridge gear 116, actuation of motor 112 rotates motor gear 124 and drives cartridge gear 116, thereby opening and closing nozzle 160 of cartridge 114. The first and second ends of cartridge 114 can rotate relative to each other.

Cartridge 114 contains and dispenses a quantity of cosmetic material into compact 108 as needed (described in more detail in Figure 9). The cartridge 114 dispenses the cosmetic material by the rotation of the cartridge gear 116 while the cartridge 114 remains in place substantially vertically along the Y axis. The cartridge gear 116 is driven by the motor gear 124 which is rotated by the rotation of the motor 112. The amplitude of rotation of the motor 112 is controlled by the control device 150.

A quantity of cosmetic material is released from the cartridge 114 through the nozzle 160 by a first rotational movement of the first end relative to the second end of the cartridge 114. The rotational movement of the first end of the cartridge 114 in a second direction, opposite to the first rotational movement, can close the nozzle 160 of the cartridge 114.

Cartridge gear 116 actuates nozzle 160 of cartridge 114 which is attached to a hollow cartridge leadscrew 202 within cartridge 114. Rotation of cartridge leadscrew 202 proportionally moves a piston of cartridge 200 which pushes an amount of cosmetic material through cartridge lead screw 202 and out of nozzle 160 of cartridge 114. The amount of cosmetic material released during an opening and closing operation of nozzle 160 is a function of the movement of the cartridge lead screw 202, which depends on the rotational movement of the cartridge gear 116. Rotation of the motor 112 rotates the respective motor gear 124 and cartridge gear 116. The controller 150 detects the relative movement of the cartridge gear 116 using the optical encoder 192 to count a number of cartridge gear slots 148 that pass the optical encoder 192 when the cartridge gear 116 rotates, and the direction of rotation of the cartridge gear 116. A specific unit of measurement of cosmetic material is a unit of dose 118.

In one example, the pitch of cartridge lead screw 202 is approximately 1 mm, with one full rotation of cartridge lead screw 202 dispensing approximately 1 ml of cosmetic material from cartridge 114.

In another example, due to the shape of the cartridge key 162 of the cartridge 114, the circumferential groove 134 may be a notch or groove around a portion of the circumference of the cartridge 114, rather than extend fully around the perimeter of the cartridge 114 to secure the cartridge 114 to the trigger plunger 146 in substantially the same manner.

There is a perspective view of cartridge gear 116, according to one example. Cartridge gear 116 may be a spur gear that includes a key cutout 163 that matches the shape of cartridge key 162 of cartridge 114. Cartridge gear 116 may also have a collar 168 that connects from rotatably to an interior surface of the gear case 170 to align and support the position of the cartridge gear 116 and the corresponding motor gear 124. Cartridge gear 116 may have a plurality of cartridge gear slots 148 for use with optical encoder 192 to detect the angular position of cartridge gear 116 and cartridge lead screw 202.

[Fig. 7A] is a perspective view of the bottom plate 166, according to an example. The bottom plate 166 is connected to the dispenser body 106 and/or the lower body section 154, holds the plurality of cartridges 114 disposed inside the cosmetic dispenser 100, and connects the cosmetic dispenser 100 to the plate induction 176 arranged under the bottom plate 166.

The bottom plate 166 has a plurality of cartridge through-holes 172 to permit insertion, removal and docking of the plurality of cartridges 114. Each cartridge through-hole 172 includes a base key cutout 165, and the shape of the base key cutout 165 corresponds to the shape of the base key 164 of each cartridge 114 to prevent rotational movement of the second end of the cartridge 114, the portion being in contact with the bottom plate 166, when the cartridge 114 is installed in the cosmetic dispenser 100.

Additionally, the bottom plate 166 has contact pins 174 (shown in [Fig. 7B]) which contact the induction plate, providing electricity to the bottom plate 166, allowing the dispenser to cosmetic 100 to charge the plurality of batteries 126 by contact or induction.

[Fig. 7B] is a perspective view of the bottom plate 166, seen from below, according to an example. The bottom plate 166 includes three cartridge through holes 172 disposed inside the plate, and contact pins 174. When the bottom plate 166 is disposed inside the cosmetic dispenser and on the base 102, the contact pins 174 can conduct electricity from the base 102 to the bottom plate 166. The bottom plate 166 can then inductively charge the plurality of batteries 126 disposed above the bottom plate 166.

There is a perspective view of the base 102, according to an example. A power cord 104 is connected at a first end to the base 102. The power cord 104 is connected at a second end to a power source (not shown), providing power for operation of the cosmetic dispenser 100 and for charging the plurality of batteries 126. The base 102 includes a base indentation 128 for placement of the induction plate 176 and other portions of the cosmetic dispenser 100. The base indentation 128 may have the capability to inductively charge the plurality of batteries 126 using power supplied by the power cord 104. Additionally, it may also charge the cosmetic dispenser 100 via contact pins 174 disposed inside the bottom plate 166 when the bottom plate 166 is disposed in the base indentation 128.

[Fig. 9A] is an exploded perspective view of the compact 108, arranged above a collector 130, according to an example. The compact 108 includes a top cover 180, a compact base 182, and a bottom cover 184. The top cover 180 is disposed above the compact base 182, which is disposed above or below interior of the bottom cover 184. The top cover 180 is secured to the compact base 182 by magnets, as described in more detail in [Fig. 9B]. The compact base 182 includes a plurality of compact base through-holes 138. In this example, there is one compact base through-hole 138 for each cartridge 114 in the cosmetic dispenser 100. The bottom cover 184, comprising a plurality of bottom cover through holes 136, is disposed under the compact base 182. In this example, there is one bottom cover through hole 136 for each cartridge 114 in the cosmetic dispenser 100, and the bottom cover bottom 184 is arranged such that each bottom cover through-hole 136 matches and is connected to a compact base through-hole 138 of the compact base 182.

The compact 108 is connected to the manifold 130, the manifold 130 being connected to and disposed above the gear case 170, further disposed within the dispenser body 106 of the cosmetic dispenser 100, and the compact 108 is disposed above both the manifold 130 and the dispenser body 106. The manifold 130 includes a manifold through-hole 132 for each cartridge 114 in the cosmetic dispenser 100, and the manifold 130 is arranged such that each hole manifold through-hole 132 corresponds to and is connected to a compact base through-hole 136 of the bottom cover 184. Furthermore, each manifold through-hole 132 of the manifold 130 corresponds to and is disposed above a cartridge hole of gear housing 178 of the gear housing 170, providing a passage through which the cosmetic material can be dispensed from the nozzle 160 of each cartridge 114 through the manifold 130, the under cover 184, and into the base of powder compact 182.

The compact 108 may have a shape such that there is only one orientation by which the compact 108 can connect to the cosmetic dispenser 100. In another example, it is possible that the shape of the compact 108 can be connect to compact 108 in more than one orientation.

Additionally, the cosmetic product dispensed into the compact 108 may be prevented from flowing outward by the use of a one-way duckbill valve 194 (not shown) disposed in each of the compact base through-holes. 136 in the bottom cover 184 of the compact 108.

[Fig. 9B] is a perspective view of the compact 108 in an open position, according to an example. The compact 108 includes a top lid 180, a compact base 182, a bottom lid 184, a plurality of hinge magnets 186a, 186b, 186c and 186d, a plurality of lid magnets 188a, 188b, 188c and 188d, and a plurality of mounting magnets 196a, 196b and 196c.

In one example, the compact base 182, the plurality of mounting magnets 196a to 196c, a first half of the plurality of lid magnets 188b and 188d, and a first half of the plurality of hinge magnets 186b and 186d, are disposed inside the bottom cover 184, with the compact base 182 disposed above. The plurality of mounting magnets 196a-196c are arranged to magnetically connect the compact 108 to the cosmetic dispensing device 100, for example by connecting it to the manifold 130 ([Fig. 9A]). The collector 130, or portions of the surface of the collector 130, may be formed of a ferrous material or contain corresponding magnets to magnetically attach to the plurality of mounting magnets 196a-196c.

A second half of the plurality of lid magnets 188a and 188c is disposed in one side of the top lid 180, and a second half of the plurality of hinge magnets 186a and 186c is disposed in one side of the top lid 180 The hinge magnets 186b and 186d are disposed in one side of the bottom cover 184 so that they can contact the corresponding hinge magnets 186a and 186c in at least two planes, depending on a relative position between the top cover 180 and the bottom cover 184. The hinge magnets 186a and 186b have opposite magnetic polarity, as do the respective pairs of hinge magnets 186c and 186d, the cover magnets 188a and 188b, and the magnets cover 188c and 188d.

The plurality of 196 and the plurality of cover magnets 188 to 188d may be arranged such that the plurality of undercover through-holes 138 disposed in the base of the compact 182 are unobstructed to allow the cosmetic material to be removed. flow from each of the cartridges 114 into the compact 108 when the cosmetic material is dispensed.

In the case where the compact 108 is in the open position, the top cover 180 and the bottom cover 184 are positioned approximately in perpendicular planes, the hinge magnets 186a and 186c being magnetically connected to the hinge magnets 186b and 186d, respectively . The magnetic force between each pair of hinge magnets 186a and 186b and hinge magnets 186c and 186d is sufficient to hold the top cover 180 in position relative to the bottom cover 184.

In the case where the compact 108 is in the closed position, the top cover 180 and the bottom cover 184 are positioned approximately in parallel planes, the hinge magnets 186a and 186c are magnetically connected to the hinge magnets 186b and 186d, respectively , and the cover magnets 188a and 188c are arranged in corresponding positions, and magnetically connected to the cover magnets 188b and 188d, respectively, the magnetic connection between the pairs of hinge magnets 186a and 186b and hinge magnets 186c and 186d, and between the pair of cover magnets 188a and 188b, and the pair of cover magnets 188c and 188d, being sufficient to hold the top cover 180 connected to the bottom cover 184 in a closed position.

Since the top cover 180 is connected to the bottom cover 184 magnetically, the top cover 180 may be fully removable from the bottom cover 184. Additionally, it may also be capable of connecting to the bottom cover 184 in a closed position in more than one orientation around the x-z plane, depending on the arrangement of the plurality of hinge magnets 186 to 186d and lid magnets 188 to 188d in the top lid 180 and the bottom lid 184. Additionally, the top cover 180 may be capable of pivoting about the bottom cover 184, or vice versa, by opening or closing about more than one axis, for example around the x axis or the l axis. z axis.

Alternatively, the plurality of mounting magnets 196a-196c can be replaced by a mounting magnet 196 of sufficient strength to secure the compact 108 to the cosmetic dispensing device 100.

Alternatively, the plurality of hinge magnets 186-186d may be replaced by a hinge magnet 186a of sufficient strength in the top cover 180 and by a hinge magnet 186b of sufficient strength in the bottom cover 184 to secure a side of the top cover 180 to the bottom cover 184 with the compact 108 in an open or closed position.

Alternatively, the plurality of lid magnets 188 to 188d may be replaced by a lid magnet 188a of sufficient strength in the top lid 180 and by a lid magnet 188b of sufficient strength in the bottom lid 184 to secure a side of the top cover 180 to the bottom cover 184 with the compact 108 in a closed position.

There is a diagram representing an example of a primary process sequence of a cosmetic formulation process 900, according to one example. The examples provided herein each have three cartridges, although the same process can be used by the cosmetic dispenser 100 equipped with any number of cartridges 114. The cosmetic formulation method 900 includes a detection process S920, a selection process S940, and a distribution process S960. An additional S980 mixing process can be performed by a user. The detection processes S920, the selection process S940 and the dispensing process S960 are executed by the cosmetic device 100 based on orders received from the controller 150, the controller 150 sending data to the user and receiving inputs from the user through the smart device 300 or through LEDs on the cosmetic device 100 itself, as described in and in Figure 4.

There is a process diagram showing an example process of detecting cosmetic material in the cosmetic dispenser 100, according to one example. S920 represents a cosmetic material detection process. Process S920 may include at least one of the following steps: step 921 of detecting the removal and installation of a cartridge 114, step 922 of detecting at least one material characteristic of the cartridge 114, an optional step 923 of detecting a quantity of cosmetic material in the cartridge 114, and an optional step 924 of calculating an estimated exhaustion of the cartridge(s) after carrying out a future dispensing operation.

Optional step 923 of detecting a quantity of material in each of a plurality of cartridges 114 may include, for example, step 923a of detecting a quantity of material from a cartridge A, step 923b detecting a quantity of material of a cartridge B, and step 923c of detecting a quantity of material of a cartridge C, for example based on the total net displacement (rotation) of the gear of cartridge 116 detected by the optical encoder 192 since the installation of each cartridge 114.

The optional step 924 of detecting at least one material characteristic in each of a plurality of cartridges 114 may include, for example, step 924a of detecting at least one material characteristic of a cartridge A, step 924b of detecting at least one material characteristic of a cartridge B, and step 924c of detecting at least one material characteristic of a cartridge C. The material characteristics may include at least one characteristic of the whole constituted by color, texture, luster, humidity, nutrient content and chemical formulation. This detection can be performed based on a near field sensor disposed in the dispenser 100 which detects an RFID tag on the cartridge which stores information about the contents of the cartridge according to methods well known in the art. Variations in detection methods may be used, such as detecting a barcode printed on the cartridge, or detecting using methods well known in the art. The step of detecting at least one material characteristic in each of the cartridges can be performed before the optional step of detecting the quantity of cosmetic material in each cartridge.

Additionally, process S920 may include the optional step 926 of reporting information that may be derived from historical user usage data or aggregated across groups of users, such as cosmetic dispenser cartridge 114 100 of which are expected to be sold out first and by what date.

[Fig. 12A] is a process diagram representing an example of S940 process for selecting a cosmetic formulation, according to one example. The S940 process includes a cosmetic formulation selection process. Process S940 includes steps for identifying possible cosmetic formulation combinations based on the type and quantities of cosmetic materials present in cosmetic dispenser 100, as established by detection process S920.

A step 942d may be based on a user selection of a set of cosmetic formulations that are possible for the types and quantities of cosmetic materials present in the cosmetic dispenser 100, or a step 942c allows the user to choosing from a broader set of cosmetic material inventory 204 that is possible for the types and quantities of cosmetic materials that the cosmetic dispenser 100 is capable of using.

In another example, step 943 of process S940 includes the ability for a user to choose a desired dose unit 118. Varying the dosage unit 118 may alter the set of cosmetic formulations available within the cosmetic dispenser 100 if a greater quantity of one or more cosmetic materials is required than is available to dispense a specific quantity of dose unit 118 for a specific cosmetic formulation.

For example, if cartridge A contains a yellow cosmetic material, cartridge B a red cosmetic material and cartridge C a green cosmetic material, and only one dose unit 118 of cartridge A remains, the user may not choose to dispense any combination of dose units 118 and cosmetic formulation requiring more than one dose unit 118 of yellow cosmetic material.

Additionally, method S940 may include step 942a allowing the user to select a cosmetic formulation based on a photo match, step 942b allowing the user to select a cosmetic formulation based on recommendations , or select a cosmetic formulation based on another process. U.S. Patent Number 8,634,640 describes a method of selecting a color from an image or photo in a camera or electronic device, and using color reference data to substantially match the color .

In another embodiment, a skin diagnosis (sometimes referred to herein as a skin profile) may be performed to provide a recommended plurality of predetermined colors that the user may select based on an analysis of the skin's particularities. of the user. The skin diagnosis determines an appropriate color for the user based on an imaging operation performed on the user's face. Examples of skin diagnostic tools known in the art are: Diagnos ABS from Lancôme, HR Skinscope, Bluesmart from Biotherm, Skinprofiler V.0 from Kiehl, CA Dermanalyzer, and Vichyconsult.

For cosmetic formulations that are possible but not available based on the results of the detection process S920, the cosmetic dispenser 100 may communicate to the user the cosmetic materials necessary to dispense such cosmetic formulations.

In one example, in step 944, the user selects a dose unit 118 of a currently unavailable cosmetic formulation. Step 944 may determine which cosmetic materials, such as cartridge type 114, are needed to mix and dispense the selected cosmetic formulation.

In another example, step 944 may determine what additional cosmetic formulations may become available if a specific cartridge 114 is replaced with a full but otherwise identical cartridge 114.

In another example, step 944 may determine what additional cosmetic formulations may become available if a cartridge 114 is replaced with another cartridge 114 containing a different cosmetic material.

Step 945 determines whether to proceed to step 947 to prompt the user to confirm and continue dispensing a cosmetic formulation or to proceed to step 946 to report which cartridge(s) 114 are necessary to distribute the desired cosmetic formulation, based on the result of step 944.

[Fig. 12B] shows an optional process S940b which is carried out by the dispensing apparatus 100 alone once a cosmetic formulation has been previously received and is currently stored on the dispensing apparatus 100 in a step 948. The remaining steps 943 to 947 of S940b are identical to those of S940 described by [Fig. 12A]. The process of [Fig. 12B] can be made without an existing connection being established between the dispensing device 100 and the device 300.

There is a process diagram representing an example of a cosmetic product dispensing process S960 in a cosmetic dispenser 100, according to an example. Step 961 represents a step of dispensing at least one dose unit of a cosmetic formulation. Process S960 includes steps 962a to 962c of ejecting a requested quantity of cosmetic material from at least one cartridge 114 to produce a cosmetic formulation selected by the user in process S940, such that the cosmetic formulation can be applied, transported in a container, or otherwise available to the user. The process S960 includes the optional steps 963a to 963c of detecting the remaining quantity of cosmetic material in each of the cartridges and the optional step 964 of recording the results in a memory of the dispensing apparatus.

Once the S960 dispensing process is completed, the user can perform the S980 process of manually mixing the released cosmetic material, producing the requested cosmetic formulation.

There is a diagram representing an example of a connected cosmetics distribution system, according to one example. A system 400, which implements the cosmetic dispenser 100 described above, includes at least the cosmetic dispenser 100 and a connected device 300. Optionally, the system may further include one or more external servers 410 which are implemented works in a cloud computing environment. Additionally, the system may optionally include a cosmetic material inventory 204 which is an inventory of possible cosmetic materials that may be inserted into the cosmetic device 100.

The connected device 300 may be a personal computer (PC), a laptop, a PDA (personal digital assistant), a smartphone, a tablet, an UMPC (ultra mobile personal computer), a mini-laptop, or a personal computer of the type notepad. In the examples below, the connected device 300 is assumed to be a tablet, such as an Apple iPad.

The connected device 300 is capable of wireless communication with the cosmetic dispenser 100 by means of wireless communication interface circuitry 774 on the cosmetic dispenser 100. However, the connected device 300 is also capable of have a wired connection with the cosmetic dispenser 100 by means of a USB interface 776 on the device 100. Additionally, each device, including the cosmetic dispenser 100, can communicate with the others and with the device(s) external devices through an Internet connection via an 802.11 wireless connection to a wireless Internet access point, or a physical connection to the Internet access point, for example via an Ethernet interface. Each connected device 300 is capable of wireless communication with other devices, for example through a Bluetooth connection or other wireless means.

The connected device 300 is configured to receive information from a user for use in generating a cosmetic formulation that will be used by the cosmetic dispenser 100 to dispense a cosmetic product into the compact 108.

There is a functional diagram representing the circuitry of the control device 150 and the cosmetic dispenser 100, according to an example. A central processing unit (CPU) 710 provides primary control over separate circuitry components included in the apparatus, such as valve control circuitry 740 (which may include control circuitry for motors 112, control circuitry for the optical encoder 192, and induction sensor circuitry). CPU 710 may also control an optional input/output device 772 (such as a keyboard or mouse), memory 780, wireless communications interface circuitry 774, serial bus controller universal (USB) 776, an LED driver 778 and a display module 780. The LED driver 778 controls the pulsing of one or more indicator lights 122.

In one embodiment, the circuitry includes, among others, one or more computing devices such as a processor (e.g., a microprocessor, a quantum processor, a qubit processor, etc.), a central processing unit (CPU ), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or the like, or any combination thereof, and may include elements discrete digital or analog circuits or electronic components, or combinations thereof.

In one embodiment, a module includes one or more ASICs having a plurality of predefined logic components.

In one embodiment, a module includes one or more FPGAs, each having a plurality of programmable logic components.

In one embodiment, the circuitry includes one or more components operatively coupled (e.g., communicatively, electromagnetically, magnetic, ultrasonic, optical, inductive, electrical, capacitive, wireless, or the like) to each other .

In one embodiment, the circuitry includes one or more remotely located components.

In one embodiment, the remotely located components are operationally coupled, for example, via wireless communication, such as with a connected device 300.

In one embodiment, the remotely located components are operationally coupled, for example, via one or more communications modules, receivers, transmitters, transceivers, or the like.

In one embodiment, any of the CPU 710 or other components shown on the can be replaced by variants of circuitry elements. Examples of circuits include a memory that, for example, stores instructions or information. Non-limiting examples of memory include volatile memory (e.g., random access memory (RAM), dynamic random access memory (DRAM), or the like), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read-only memory (EEPROM), a compact disk read-only memory (CD-ROM), or the like), a persistent memory, or the like. Other non-limiting examples of memory include erasable programmable read only memory (EPROM), flash memory, etc.

In one embodiment, the memory is coupled, for example, to one or more computing devices by one or more instructions, information, or power bus.

In one embodiment, the circuitry includes one or more computer-readable media readers, interface jacks, Universal Serial Bus (USB) ports, memory or other card slots, and one or more input components. /output such as, for example, a graphical user interface, a display, a keyboard, a numeric keypad, a trackball, a joystick, a touch screen, a mouse, a switch, a dial or the like, and any other peripheral device.

In one embodiment, a module includes one or more user input/output components that are operably coupled to at least one computing device configured to control (electrical control, electromechanical, software implemented, software implemented). firmware, or other control, or combinations thereof) at least one parameter associated, for example, with determining one or more thermal properties of the fabric in response to detected shifts in the power-on voltage.

In one embodiment, the circuitry includes a computer-readable media reader or memory location that is configured to accept signal-carrying media (e.g., computer-readable memory media, computer-readable recording media, computer, or similar).

In one embodiment, a program for causing a system to execute any of the disclosed methods may be stored, for example, on a computer-readable recording medium, a signal-carrying medium or the like. Non-limiting examples of signal-carrying media include a recordable type media such as a magnetic tape, a floppy disk, a hard disk, a compact disk (CD), a digital video disk (DVD), a Blu-Ray disk, a digital tape, a computer memory or the like, as well as a transmission type medium such as a digital or analog communications medium (for example, a fiber optic cable, a waveguide, a communications link wired, a wireless communications link (e.g., a receiver, transmitter, transceiver, transmission logic, reception logic, etc.) Other non-limiting examples of signal-carrying media include, but are not limited to, limited to, DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD -RW, video compact discs, super video discs, flash memory, magnetic tape, magneto-optical disk, MINIDISC, non-volatile memory card, EEPROM, optical disk, optical storage, RAM, ROM, system memory, web server, or the like.

In one embodiment, the circuitry includes acoustic transducers, electroacoustic transducers, electrochemical transducers, electromagnetic transducers, electromechanical transducers, electrostatic transducers, photoelectric transducers, radioacoustic transducers, thermoelectric transducers, or ultrasonic transducers.

In one embodiment, the circuitry includes electrical circuitry operably coupled to a transducer (e.g., an actuator, a motor, a piezoelectric crystal, a microelectromechanical system (MEMS), etc.)

In one embodiment, the circuitry includes electrical circuitry comprising at least one discrete electrical circuit, electrical circuitry comprising at least one integrated circuit, or electrical circuitry comprising at least one specific application integrated circuit.

In one embodiment, the circuitry includes electrical circuitry forming a universal computing device configured by a computer program (e.g., a universal computer configured by a computer program that at least partially executes processes and/or devices described herein, or a microprocessor configured by a computer program which at least partially executes processes and/or devices described herein), electrical circuitry forming a memory device (e.g., forms of memory (for example, random access memory, flash, read-only memory, etc.), electrical circuitry forming a communication device (for example, a modem, a communications switch, opto-electric equipment, etc.), and/or any non-electrical analogue thereof, such as optical or other analogues.

[PERSONALIZED COSMETIC ECOSYSTEM]

There shows the components of the 1600 ecosystem that are common to each product type. The ecosystem includes the dispenser 1610, a user smartphone device 1620, and a cloud platform 1630. The smartphone is shown to include two functional blocks: the configuration of the smartphone app ("app") 1621 and the using the smartphone app 1622. Configuring the smartphone app 1621 will be described in detail below with respect to the various customization examples and involves establishing the initial configuration information to configure a user's user profile. The configuration information may then be used when the smartphone app is used and may also be sent to the cloud platform 1630 for use in sending a selection of styles relevant to the user.

Using the smartphone app itself involves the user actually making selections that lead to the determination of a color, and engaging in interactive communication with the distributor, such as sending the recipe to the dispenser and tracking dispenser status (such as inventory and remaining volume of cartridges in the dispenser). The smartphone application also performs interactive communication with the cloud platform. For example, the smartphone application may receive the selection of relevant styles described above, and it may also provide direct user feedback on the styles that the cloud platform has previously sent and it may notify the cloud platform of the colors and recipes actually selected by the user and distributed by the distributor. Such feedback can provide a form of machine learning to the cloud platform and improve the algorithms used by it.

[PERSONALIZED LIPSTICK ECOSYSTEM]

There shows the ecosystem (1700) described above whose objective is to offer a trendy lipstick color to the consumer after analyzing trends on social media by combining the taste of favorite colors, geolocation, favorite influencers , past selection and likes. It gives the consumer the opportunity to choose a color based on a style, try it on virtually and adjust it if necessary to finally produce the formula on site with a connected distributor. It is also possible to suggest a color based on the user's outfit scanned with a self-portrait photo. The consumer can save the most favorite colors and share them with their virtual community.

There shows that the user smartphone ultimately delivers a recipe to the dispensing device via a smartphone application (“app”). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the app must be configured (1710) with configuration information to configure a user profile. The app configuration can be based on the following configuration inputs.

- Welcome questionnaire (like favorite color),

- Social media credentials (like Instagram, Twitter, Facebook),

- Favorite influencers to follow color,

- Geolocation according to local fashion,

- Environmental data (UV index, pollution, humidity, pollen).

The configuration inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which can be an external server device connected via the Internet.

Actual usage of the smartphone app (1720) includes selecting a lipstick selection mode. In the present example, the modes include a mode of selecting a social media trending recommendation by algorithms that are executed in the cloud platform (discussed further in detail). Another mode allows the user to create their own lipstick color using a wide variety of color options.

Another mode can allow the user to match a lipstick color to their “style” based on a self-portrait photo. In this example, the selection of the shade and finish in the proposed photo is extracted. User can virtually try on the lipstick in real time, user can adjust the color presented. When the user is happy with the color, they can press a button displayed on the app to dispense the formula and an internal neural network will break down the requested color into different doses of color cartridges. Once the recipe is sent to the dispenser and the lipstick shade is dispensed, the user can apply the lipstick.

After using the lipstick, the user can use the application to indicate whether he or she liked the result or not. User can also save their favorite style and color for reuse later, and user can share their style and color on the web via social media platform.

The cloud platform implements functions shown in 1730, such as a remote algorithm workflow and improvement process.

In the workflow carried out by the cloud platform, personal accounts of social media networks (influencers, trending styles) can be harvested to find data relating to lipstick colors. The cloud platform can analyze one or more collected images to extract an average makeup color (lip color, foundation color, hair color) using a deep learning algorithm to segment lip makeup finishes. For example, the cloud platform may accomplish this by first detecting lips in a plurality of images using a technique known in the art (such as that described in U.S. Patent No. 5,805,745). The cloud platform can then make comparisons of an extracted color with the colors most liked by one or more user communities while also taking into account user configuration inputs received from the smartphone device of the user. 'user. Taking into account all the collected data, the final step is for the cloud platform to send the analysis results to the user in the form of the relevant style selection mentioned above.

In the improvement process carried out by the cloud platform and smartphone app, the user can save their favorite styles and “like” the popular color to enrich the harvesting algorithms for subsequent relevant recommendation. The cloud platform can then aggregate all user feedback, and the platform can send new users the most trending wordings by location area.

The operations of the distributor at block 1740 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses the top portion and the user can mix it to achieve the desired color. The dispenser returns the remaining formula inventory to the consumer app to ensure that only dispenseable colors are available in the user interface when the user makes a selection.

[Fig. 18A] shows an example flow of operations in the ecosystem described above for dispensing a personalized lipstick shade from an app perspective. At step 1810, the user may select a "mode" as discussed above, which may be a mode of selecting a social media trending recommendation by the algorithms that are executed in the cloud; allow the user to create their own lipstick color using a wide variety of color options; or allow the user to match a lipstick color to their “style” based on a self-portrait photo.

Step 1820 shows an example display when the mode is chosen to select a trending style powered by an AI algorithm of the cloud platform. Step 1820 also shows that a menu is provided at the bottom of the interface to allow the user to switch between the modes described above.

Step 1830 shows an example display where the user has selected a potential hue and is allowed to adjust the hue using an appropriate adjustment mechanism, such as a color palette or slider. The shade can be shown on the user's self-portrait.

Step 1840 shows that once a color is finally selected by the user, the color is broken down into a combination of the available colors contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for be distributed.

[Fig. 18B] shows an additional flowchart of how the Lipstick Ecosystem smartphone app's algorithms can allow a user to visualize a lipstick shade in the user's self-portrait. A recipe prediction module 1860 ("Module 2") may receive as inputs the dispensing capacity of the device, which is the set of three lipstick ingredient cartridges currently inside the dispensing device. Another input can be the mass tone color of the dilution mixtures, which represent the actual color values that can be produced by the ingredients in the cartridge. The output of module 2 is a list of recipes (actual quantities dispensed from each cartridge) and a corresponding predicted RGB mass tone color resulting from each recipe. Module 1 (1870) can then project what the lipstick will look like on the user's actual lips based on the color of a recipe's RGB mass tone and the lip color of the user (lip tone), resulting in a list of recipes and a corresponding applied RGB color. The relationship between the mass tone color and the applied color according to the user's lip color can be predetermined and stored in advance. Thus, what can be presented to the user on the display is a palette based on an RGB color universe as shown in 1890.

[Fig. 18C] further illustrates how the specific set of cartridges can result in different hue universes to be presented to the user.

[Fig. 18D] shows how the “match my style” mode can work on the app in the lipstick ecosystem. In step 1881, a user may enter a self-portrait image that includes the user's outfit. A recommendation can be generated in different ways based on color recognition and/or outfit type in the image. For example, a first approach ("Approach 1") in step 1882 can use the 7 rules of color science and harmony to target the formation of a certain type of relationship between lipstick shade and the colors of the outfit based on color wheel relationships, as illustrated in Approach 1. Alternatively, in step 1883, a predetermined palette may be presented based on a recommendation from a makeup artist with a view to seasonal styling of the outfit in combination with the color of the outfit.

[Fig. 18E] shows more details on how the lipstick recommendation engine based on the user's outfit selfie works. In step 1891, probes can be user defined at different points in the outfit, where only one probe can have priority. At step 1892, a different color palette may be assigned to each probe based on the makeup artist's recommendation palettes, or based on a predetermined color wheel relationship, as shown in [Fig. 18D]. As seen in step 1893, the output may recommend colors based on the set of cartridges installed in the dispensing device, and based on the number and priority of probes that the user has decided to use. If desired, the user can also swipe to browse options that would be available in other color wheels if other cartridge sets were used. This may prompt the user to purchase a new set of cartridges.

[PERSONALIZED SKIN CARE ECOSYSTEM]

There shows the ecosystem described above (1900) whose objective is to offer the user a skin care formulation that is most effective for the user based on the user's geolocation, factor environmental, cumulative UV exposure and clinical signature assessed with the smartphone or dermatologist's diagnosis. The system manages to adjust the proportion of assets to obtain the most effective recipe on a daily basis. The user can save their favorite colors and share them with their virtual community.

There shows that a user's smartphone ultimately delivers a recipe to the dispensing device via a smartphone app ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the application must be configured (1910) with configuration information to configure a user profile. The app configuration can be based on the following configuration inputs.

- Welcome questionnaire (like favorite color),

- Analysis of skin care by a dermatologist or by AI algorithms based on a self-portrait,

- Geolocation based on the location detection function of the smart phone,

- Environmental data (UV index, pollution, humidity, pollen).

The configuration inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device connected via the Internet.

Real-world use of the smartphone app (1920) includes collecting geolocation-based environmental data and combining it with a smartphone diagnostic assessing clinical signs (wrinkles, dark spots, firmness, pores, fine lines, appearance dull).

The user can also collect data from a UV sensor, such as a wearable UV sensor as described in US Patent No. 10,060,787, which will effectively give an accurate measurement of the cumulative UV exposure received. Based on historical data from skin assessment and environmental factors, the app will process the ideal formulation to combat signs of skin aging and prevent environmental damage. When the user is satisfied with the formulation, they can press a button displayed on the app to dispense the formulation and an internal neural network will break down the requested formula into different cartridge ingredients. Once the recipe is sent to the dispenser and the formulation is dispensed, the user can apply the formulation. The user can provide feedback on their preferred formulations for a specific period of time.

The cloud platform implements functions shown in 1930, such as a remote algorithm workflow and improvement process. In the workflow carried out by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe. For example, there is a known correlation between environmental conditions and skin aging (see “Assessing the impact of an aerial chronic urban pollution (UP) on some facial signs of differently-aged Chinese men” at www.researchgate.net , and “The skin aging exposome” on www.jdsjournal.com). Additionally, by giving input of the user's geolocation, which can provide a determination of air quality using a tool such as BreezometerTM and a forecast of the local UV index (or l 'UV exposure can be obtained based on a UV sensor described above), the cloud platform can adjust the recipe to account for environmental factors such as UV exposure and air quality. For example, [Fig. 20B] below shows examples of combinations of environmental factors and their correlation with the ingredients contained in the cartridges.

In the improvement process carried out by the cloud platform and smartphone app, the user can save their favorite recipes that are most effective over time or provide the best feeling on the skin. The user can also share their recipes with the community.

The cloud platform can then aggregate all user feedback, and the platform can send new users the most trending wordings by location area.

The operations of the distributor at Block 1940 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses the top portion and the user can mix it to achieve the desired color. The dispenser returns the remaining formula inventory to the consumer app to ensure that only dispenseable ingredients are available in the user interface when the user makes a selection.

[Fig. 20A] shows an example workflow in the ecosystem described above for distributing a personalized skincare formulation from an app perspective. At step 2010, the user may perform a skin care diagnosis as discussed above, which may be performed by taking a 360° self-portrait photo, or a series of photos at different angles using the smart phone camera capability. In step 2020, the app performs an analysis of the user's skin to detect skin peculiarities, such as dark spots, wrinkles, firmness, pores, fine lines, dullness, etc. A method of performing deep learning to achieve training and execution of this type of detection is discussed in more detail below. Variations of known methods can also be used, such as those described in US Patent Nos. 10,325,146 and 9,760,935.

Step 2030 shows the analysis results for one or more of the skin features being analyzed. The results can be shown as a score, which can be relative to people in the user's age range. For example, each of the skin features can be presented on a five-point scale, and features that represent a score worse than an average score can be highlighted as a priority for the user, while features that that are better than average can be presented as a strong point.

Step 2040 shows that the application may present a recommended skin care formulation ("blend") that addresses the user's priority skin care concerns while taking into account current environmental conditions. Once the formulation is finally selected by the user, the formulation is broken down into a combination of the available colors contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing in step 2050.

[Fig. 20B] shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges. In this example, the cartridges respectively include guiding ingredients for deep damage recovery, cell renewal, and daily protection against skin aggressors (which may include an SPF ingredient and a pollution protection ingredient). In this example, a fixed dose of cartridge 1 can always be used for effectiveness, while the proportions of the other cartridges vary depending on the levels of UV or pollution present.

[CUSTOM FOUNDATION ECOSYSTEM]

There shows an ecosystem 2100 which is used to distribute personalized foundation for the user. The 2100 ecosystem uses a deep learning algorithm to measure the user's skin tone with a smartphone. By combining it with environmental information or makeup tutorials, the system can adjust throughout the year to always deliver the best foundation color to the consumer that matches their tan level/variation. his skin tone. Depending on the weather forecast and UV exposure, the device may also increase skincare actives or SPF.

There shows that the user smartphone ultimately delivers a recipe to the dispensing device via a smartphone application (“app”). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the app must be configured (2110) with configuration information to configure a user profile. The app configuration can be based on the following configuration inputs.

- Welcome questionnaire (like favorite color),

- Detection of user's skin tone using 360° video and skin tone algorithm,

- Geolocation based on the location detection function of the smartphone,

- Environmental data (UV index, pollution, humidity, pollen).

The configuration data is used during regular use of the app on the smartphone, but it is also transmitted to a cloud platform, which can be an external server device connected to the Internet.

Actual use of the smartphone app (2120) includes collecting geolocation-based environmental data and combining it with a smartphone diagnostic assessing the user's skin tone. Although methods of determining a user's skin tone to match a foundation are known in the art, a method below related to a deep learning method will be discussed in detail. Depending on the user's skin condition, the app may determine to merge skincare actives with foundation such as SPF when environmental conditions are not optimal. The app determines, depending on the time of year and the person's tan level, to slightly adjust the color of the foundation to follow the evolution of the skin tone. When the color is not perfect in the matching process, the user can send feedback to the cloud to remotely improve the algorithms. In some cases, the user may want to use the device to adjust the color of the base to achieve a specific makeup strategy by layering different colors.

The cloud platform implements functions shown in 2130, such as a remote algorithm workflow and improvement process. In the workflow carried out by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe by adding an FPS. The cloud platform can modify the user's master skin tone formula which is sent when the consumer's tan level is different from the initial diagnosis.

In the improvement process carried out by the cloud platform and smartphone app, the user can save their favorite recipes that are most effective over time or provide a better feeling on the skin. The user can also share their recipes with the community. The cloud platform can further aggregate all user feedback, and the platform can send new users the most trending wordings by location area.

The operations of the distributor at block 2140 are already described in detail above, but they are summarized as follows. The dispenser receives an order to dispense a certain proportion of each cartridge. The dispenser dispenses the top portion and the user can mix it to achieve the desired color. The dispenser returns the remaining formula inventory to the consumer app to ensure that only dispenseable ingredients are available in the user interface when the user makes a selection.

[Fig. 22A] shows an example workflow in the ecosystem described above for distributing personalized foundation from an app perspective. At step 2210, the user may perform a skin tone diagnosis as discussed above, which may be performed by taking a 360° self-portrait photo, or a series of photos at different angles using the smart phone camera capability. In step 2220, the app performs an analysis of the user's skin to detect skin tone and hue.

At step 2230, the app may present a recommended foundation (“blend”) that matches the user's skin tone while taking into account current environmental conditions. Once the foundation is finally selected by the user, the foundation is broken down into a combination of the available ingredients contained in the cartridges of the dispensing device, then the recipe is transmitted to the dispensing device for dispensing to the step 2240.

[Fig. 22B] provides more details on the method of performing the skin tone diagnosis described above. In step 2211, the user performs a video recording of himself until face detection is performed by the smartphone app. In step 2212, face detection is carried out according to known methods. If no face is detected, an error message is displayed to the user, and the user may be asked to change the camera angle or position relative to the user until face detection faces is made. Once face detection is performed, pre-processing is carried out on 10 frames of video data, where a normalization process and a zooming process are carried out to evaluate the specific features of the user's face. Normalization is a process of aligning all images to the same resolution, orientation width, lighting, etc. The purpose of normalization is to make images comparable to each other and to ensure that the main algorithm will operate within the validated operating conditions/ranges and avoid any outlier data points. A skin tone prediction model is then executed in step 2213 based on a median skin tone value detected in the 10 images used for prediction. Furthermore, a prediction noise evaluation is performed using a median approach to filter/average the noise. If the noise prediction is low, a skin tone LAB value is used to determine the mixture used to generate the foundation at the dispensing device. However, if the noise level is high, then a security backup questionnaire is triggered in step 2214, which asks for a previous foundation that the user has used. Next, the color of the previous foundation is matched to a stored LAB value which is used to determine the mixture used to generate the foundation at the dispensing device.

Figure 22C and D show additional details of how deep learning is performed to cause the smartphone app (or cloud platform) to estimate a skin tone in an image. The same process can also be used to cause a device to estimate a skin care condition in an image. In [Fig. 22C], training is performed for the deep learning model. Inputs are provided in step 2221, where photos (which may be 360 video self-portraits or photo self-portraits) are input with metadata associated with the input photo and external metadata. Metadata associated with the photo may include the date and time (and/or season) as well as an optional GPS location and whether the photo was taken indoors or outdoors. External metadata can be historical climate data. Preprocessing is performed on the input images in step 2222, which may include face detection, centering and scaling, face recognition (depending on library availability), and correction of faces. lighting conditions. In step 2223, the deep learning model performs photo training by learning the particularities of the skin tone estimation. The deep learning model can also perform image selection to determine the scalar weight of the importance of selected images based on a group of images from the same user. The output of the deep learning model (2224) provides a weighted average of the skin colors of the selected images and the weights of the image selection and post-processing. To adjust the accuracy of the model, a measured skin color is input to the system for the real user in the images to train the deep learning model.

[Fig. 22D] shows the use of the deep learning model once the training has reached an adequate level. This is called "inference time", since the skin tone (or skin condition) will be inferred from the images without being able to perform a measure of truth on the actual skin of the person. 'user. It can be seen that the steps in [Fig. 22D] are the same, except that there is no measurement of the user's skin color in the final step.

[SMART EXCHANGEABLE CARTRIDGE SYSTEM]

The dispensing device described above allows consumable cartridges to be exchanged intelligently and efficiently. The cartridges (consumables) used in the dispensing device described above are preferably managed in sets (such as sets of three cartridges). For example, there could be separate cartridge sets for each of the lipstick, skincare and foundation applications described above. In the system, the consumable sets are equipped with a smart chip or electronic device configured to perform data storage and transmission/reception (such as NFC, RFID, or a contact chip). In the following description, an NFC (near field communication) tag will be mentioned, but not limited to this example. Each cartridge has different cosmetic attributes and a unique formula identifier that can identify attributes such as shade/finish, texture, and skin/hair benefits. The attributes are stored on the integrated circuit during production and signed using an asymmetric cryptographic algorithm.

As discussed in detail below, the NFC tag applied to the cartridges ensures management of the color universe for the user, multi-device use cases and traceability. The label will have two memory areas: an area for production data (encoded during the filling process); and a usage area where the device will encode usage and tracking amounts. In addition, the following security mechanisms have been implemented: (i) guarantee non-modification of production data: sector editing is protected by a password (secret password); (ii) guarantee non-duplication of cartridge data in the event of diversion: addition of a signature mechanism using the UIID (unique identifier of the label, encoded data, secret manufacturing key). The app using the device to read the cartridge will then verify that the signature comes from the manufacturing entity before authorizing distribution.

There shows a structure of the cartridge 2300, which is similar to the cartridge described above, but which further includes a region 2310, which is an area where metallization is not permitted, and an NFC (smart chip) tag 2320 which is made to adhere to the underside of the cartridge so that it is flat and without edges.

There shows a data format of the data stored on the NFC tag of the cartridge. The “OFF” column corresponds to an “offset,” which represents the coordinates of the hexadecimal-encoded data. “Page” represents consecutive blocks of data because the system can only fully read/write one page at a time. It can be seen that the format includes a tag ID (tag ID) and several fields. The size of the data included in the NFC tag is 56 bytes in this non-limiting example, but it can also be greater or less. The data format shows that there are information fields oriented toward production information and other fields oriented toward usage tracking.

There shows a table that includes obvious descriptions of the different fields contained in the NFC tag data format. Also, "base type" means the data type: for example: u8 means an 8-bit unsigned integer. “Ule16” means a 16-bit unsigned integer. “Length” and “page” are the coordinates and allocation required in the memory page of the NFC tag. For example “u8” is an 8-bit unsigned integer, which will require 8 bits of memory space in page location 0.

There shows a structure of the dispensing device 2600 which is equipped with the intelligent exchangeable cartridge system. It can be seen that the dispensing device 2600 includes a contact/Hall effect sensor 2610 which detects and counts an opening/closing cycle of the cover to trigger the reading and consumable change detection operations. The device further includes a communication interface 2620, which here is a specific NFC antenna, for each cartridge channel which can read and write information to the cartridge's NFC tag each time it is dispensed.

There shows a handshake between the dispensing device 2600 and the user smartphone device 2710. The various triggers for initiating communication between the dispensing device and the smartphone may include an established connection between the devices (such as Bluetooth pairing), opening the cover of the dispensing device, a dispensing order from the smartphone app (such as one of the apps described above), or a dispensing order entered directly on the dispensing device. In response to the trigger, the link establishment includes in step 1, reading a consumption status of the cartridges stored on the dispensing device and sending the status to the smartphone. At the same time, the user experience is updated and sent to the smart phone. “User experience” refers to a context of the device in relation to the user viewing a specific interface displaying to the user a pop-up menu when the lid is open, the cartridge is empty, or the color wheel is at the good color available. In step 2, the smartphone may transmit or adjust a dispensing order to the dispensing device. In step 3, the dispensing device may transmit the feedback on the actual dispensing to the smartphone. In step 4, the smartphone can transmit an instruction to update the NFC tags on the cartridges when a dispensing session is completed.

There shows the consumer app state machine which shows a process, from the app's perspective, of priming cartridges prior to any use of the dispensing device. In an initial priming step 2810, formula may be dispensed in a predetermined sequence and/or simultaneously from each of the cartridges to verify that dispensing can be accomplished from each cartridge. In an additional priming step 2820, the user can practice clicking on a displayed color to command individual dispensing on command. This can be done to ensure that the correct color is detected in the correct channel inside the device, so that recipes can be automatically assigned to the correct channel. Step 2830 shows a display, when priming is complete, of the status of the cartridges in the dispensing device.

As a result, the priming process can detect when a new cartridge has been installed and allows proper engagement with the dispensing device plunger and the formula contained in the cartridge, so that a correct dose can be dispensed when an actual mixture is created.

Additionally, by detecting the exact cartridges that are installed, the cartridge set (such as the set of three cartridges) can be determined, and the color attributes (or skin care attributes) that are possible with the current set are automatically updated in the app.

The app can also manage consumables by suggesting or automatically performing pipe cleaning when a cartridge is changed. The application can also adapt the universe of formulas in the user interface function depending on the type of cartridge set installed.

Additionally, the app state machine can detect inconsistent sets or missing cartridges. He may offer to buy the missing set to obtain a result. It can automatically detect the expiration dates of all cartridges. Additionally, since the security information is stored on the cartridge, it natively enables multi-user and multi-device capability, since each user smartphone will detect the information on the cartridge independently.

During boot, cartridges can also be authenticated. A 32-bit hash code is generated at production using a manufacturer's secret key and the code is encoded on the cartridge's NFC tag. The smartphone includes a hard-coded secret key, which may be included in a software development kit (SDK), to verify the hash code when reading the NFC tag data transmitted by the dispensing device. The smart phone can also be hardcoded with the secret key if possible. A unique item identification (UIID) tag can also be physically added to the cartridge or NFC tag (in the form of a barcode for example) and read by the dispensing device. If the cartridge authentication process fails, the dispensing device can transmit the notification to the smartphone.

In certain rare cases, the user may encounter a cartridge whose NFC tag is not read by the machine (encoding error, tag destruction, device out of range, other fault). In this case, the user should be able to continue dispensing the formula and using their device as normally as possible. To ensure this tolerant default mode, a cartridge recovery mode requiring user entry of cartridge information will take over. The application using the SDK will then create a virtual cartridge to continue the distribution algorithm. This auto-triggered recovery mode will be deactivated the moment a new cartridge is inserted or the NFC is in range again.

There shows a method for handling a defective cartridge NFC tag in the aforementioned scenario. In the event of an error reading the NFC tag data, the process is started at step 2910 where the SDK installed on the smartphone activates a recovery mode for a particular channel in the distribution device. In step 2911, the SDK attempts to write a new production sequence (by transmitting to the tag via the dispensing device) to the tag based on the last read value. In step 2912a, if the writing of the label is successful, the process ends. On the other hand, in step 2912b, if the rewriting of the label fails, the process goes to step 2940. In step 2913, the application displays a message asking the user to verify that a cartridge is in a correct channel and the dispensing device automatically opens the cover in step 2914. In other words, if the problem was that no cartridge was inserted, this step remedies that possibility. In step 2915, the user confirms the presence of a cartridge in the channel. If reading is still impossible, in step 2916, the user is asked to select a cartridge color corresponding to a sticker on the cartridge. In step 2917, the user is asked to enter the batch identifier and serial number of the cartridge, and to verify if the cartridge is new. In step 2918, the SDK creates a virtual cartridge for the channel number. Dispensing operations can take place based on the virtual cartridge used as a proxy for the NFC tag correctly read on the real cartridge. At step 2919, the virtual cartridge will be stopped if the cartridge suddenly becomes readable for a predetermined number of dispensing operations in a row, or if the entire set of cartridges is changed.

[GAME]

The distribution device described above may include multiple "game" features that are not only useful for entertaining the user, but also provide valuable data and feedback to optimize system features and provide personalized results to the user.

Color wheel games

Figures 30A through 30C show a game that uses the color wheel interface described above.

In a first game, shown in [Fig. 30A], a photograph of a mixed color is shown to the user (before being applied to a face). The user is asked to select a point on the color wheel that matches the displayed color. Once the user has made their selection on the color wheel, the result is shown to the user in terms of the percentage match with the shade actually applied ([Fig. 30B]).

The "difference" between the user's selection on the color wheel and the color actually displayed may be based on a difference in CIELAB coordinates. For example, a Euclidean distance between points L*, a*, b* can be determined based on the relative perceptual differences between any two colors in L*a*b*, which can be approximated by treating each color as a point in a three-dimensional space (with three components: L*, a*, b*) and taking the Euclidean distance between them.

In another form of this game, [Fig. 30C] shows a challenge where the user is asked to make a selection based on an image of a model wearing lipstick after a recipe has been dispensed by the dispensing device and mixed.

The benefit of this game is to train the user to better understand the color wheel so that there is not too much variation between the user's desired selection and the actual result.

Another advantage is that user selections can be used to determine whether the displayed color wheel is itself correctly calibrated. For example, if a large number of users do not consistently make selections within a suitable threshold of the actual mixed color distributed, then adjustments can be made to the displayed color wheel.

Additionally, if the user's device is collected, it may be known whether displays on different devices are set differently so that users' selections diverge depending on their device. Using this data, the application can make adjustments to the displayed color wheel based on the user's device or operating system type.

For example, the shows a graph where data is collected regarding the user's selections on the color wheel for a displayed image such as those shown in Figures 30A or 30C. Additionally, the correct position of the color on the color wheel is shown in comparison. We can see that in this example the user's selection group is not centered on the correct color. If a centroid of a user selection group is offset by a coordinate amount from an assumed correct color position on the color wheel, color correction may be necessary for the mapping of colors displayed on the color wheel. colors.

There shows a flowchart based on the game calibration feature above. In step 3101, the image shown in [Fig. 30A] or 30C is shown to a plurality of users for each separate instance of the game. As each user plays the game and provides input to the color wheel, data from each user's selection point on the color wheel is transmitted to a central server (step 3012). This data can be analyzed once a threshold number of users have provided input to the same image. A group may be formed based on the total collected user input and a centroid of the group is determined and compared to a coordinate position of the presumed correct point on the color wheel that would give rise to the specific recipe to generate the displayed cosmetic formulation in the image by the distribution device. If the distance between the centroid and the correct position is greater than a predetermined threshold, the color wheel is recalibrated in step 3104. Otherwise, the process repeats.

In one example, "adjustment" involves remaping the associated color value in a color space (such as CIELAB) for each position on the displayed color wheel to a new color value in the color space to more accurately reflect what the user sees displayed on their screen. In other words, the "error" in the values displayed on the color wheel compared to what the actual color will look like when a color is dispensed by the system, or even on the displayed images shown in-game , represents a vector shift between the displayed color and the color value stored in the gaming application. Therefore, a vector shift can be performed for all color values associated with the color positions displayed on the color wheel that is based on the difference in color space values between the centroid of the group described above and the color of the target image.

There shows a second type of “color wheel” set. In this game, three colors of ingredients that are dispensed by the cartridge are shown separately to the user. The user is then asked to guess the resulting color on the color wheel which will be made based on the combination of colors.

Once the user makes a selection on the color wheel, the result is shown to the user as the actual hue is based on the combination of colors with a percentage match of the user's selection.

The advantage of this game is to train the user to understand what the result will be based on the combination of colors when the user looks at the colors separately. This can make the user more skilled in selecting specific cartridges to produce a desired shade.

There shows a third type of game that also uses the color wheel. In this game, the user attempts to guess which color to select on the color wheel by seeing other cosmetics applied to the model while the model's lips are hidden. The hidden selection may be a selection made by a professional makeup artist. After selecting the user's entry on the color wheel, the actual hidden shade of lipstick will be revealed and a percentage match will be proven to the user. Over time, the match percentages for the user will be averaged to determine an overall score.

The first advantage of the game shown on the is that the user can develop an eye for how lipstick colors coordinate with other cosmetics. The game can vary in such a way that the user can select different professional makeup artists, allowing them to target a particular style or taste in the industry.

A second advantage of the game shown in is that each user's selections can be collected by a central server. This data can be very useful. For example, they can be used to find out the preferences of the general public. For example, with additional user data, such as user age, location, and other lifestyle habits, a cosmetics company can learn if there are trends in user preferences based on different categories and locations of users.

The data can also be useful if the peculiarities of the model in the photo are taken into account. When large amounts of user selections are collected, it is possible to see if there is a trend in user selections based on the model's appearance (such as hair color, skin tone, nose type, cheekbone structure, and the like.)

User Design Challenges

A second category of game is shown at . The game involves a user design challenge which may be based on a theme which may be described in an introductory screen 3501. The interface 3502 shows selectable regions of a model's face, such as lips, eyes, cheeks, face, eyebrows, and/or backdrop.

Once the user selects the region for adjusting a cosmetic shade on the displayed model's face, a screen 3503 is displayed which shows a color wheel that can adjust the displayed shade of the selected cosmetic.

Once the user has made additional selections and adjustments to a different region of the face (e.g., moving to the eye region on screen 3504), the user may submit the "style" to participate in the challenge (see [Fig. 36A]).

[Fig. 36B] shows that a screen can be displayed to the user asking them to vote on different styles. A community of users can vote on the best style for the challenge on a screen shown in [Fig. 36B] to determine a winner or ranking of submissions.

For each submission, style statistics can be displayed, showing the color hue used for each cosmetic region. Additionally, a web link may be provided so that a user viewing a submitted style can purchase the cosmetic shades used in the style statistics.

There shows a challenge variant with screens 3701, 3702, 3703 and 3704 which are analogous to the challenge shown on the . There shows that the game can offer different adjustments other than changing colors on the color wheel. For example, on screen 3704, when modifying the eyes, we can “draw” liner, eye shadow or mascara on the image using a specific virtual tool.

Figures 38 and 39 show example screens for different types of specific challenges for different themes. For each theme, a first screen (3801 or 3901) may provide the user with the option to play the challenge, a second screen (3802 or 3902) may show the description, requirements and rewards for the challenge. Additional screens to display may include a voting screen (3803 or 3903) which shows different "styles" created by community users. Finally, a results screen (3804 or 3904) can be displayed to show the challenge winning styles as well as trending shades based on the data collected during the challenge.

The design challenge games described above are not just for entertaining users. The voting system used in the game is more of a form of crowdsourcing on the different cosmetic shades and styles that users in a community prefer. Additionally, based on the models' appearance (such as hair color, skin tone, nose type, cheekbone structure, and the like), style submissions and voting can provide insight. about what colors and styles work best for different face types.

This data can be used for practical application such as learning and creating recommendations when users seek advice on which shades to use on their own face. For example, as shown in , and similarly to the process described in [Fig. 22A] above, in step 4001, the user can take a self-portrait photo, a 360° self-portrait photo, or a series of photos at different angles using the camera capability of the smartphone. In step 4001, the system performs an analysis of the user's skin to detect the user's particularities. In step 4003, the system determines an image of a model used in the design challenges that matches the user's particularities. In step 4004, the system determines the shade(s) having received the most votes that have been applied by the users to the image of the model and provides as output to the user the shade(s) having received the most votes determined as a recommendation for the user.

Game-Based Manufacturing Optimization

The above games collect valuable data on popular color hues selected by the user community, which is also valuable for configuring the production and supply of cartridges used in the dispensing device described above.

For example, a popular color shade selected by users will be based on a specific blend of two or three cosmetic formulations used in the dispensing device. As these formulations gain frequency as source ingredients for the colors selected in the sets described above, this data can be used for at least the following two practical applications:

1. Efficient grouping of formulations into predetermined sets of cartridges for sale.

2. Prioritization of the manufacturing and distribution of specific cartridges.

There shows a method of efficiently grouping a set of cartridges for sale together based on game results when the objective is to group the most popular source ingredients.

In step 4101, data is collected on the top X most frequent ingredients in colors selected by a community or users, where X is an integer. In one example, X can be 3 since the dispensing device described above contains 3 cartridges. However, In step 4102, the first X ingredients are set to be included in a single package sold. This adjustment can be made in a packaging and distribution facility.

Although the concerns the grouping of the most common ingredients in a single package, other ways of grouping ingredients in a single package may be preferable. For example, to allow users to create a very popular color that emerges as a result of the games or challenges described above, bundling may involve grouping the specific cartridges needed to make the popular color into a purchasable package. On the , in step 4202, data is collected on the X most popular mixed colors determined in the games or challenges. X may be an integer equal to or greater than 1. In step 4202, the ingredients required to make the

Alternatively, a plurality of distinct three-cartridge packages may be set for a plurality of distinct popular colors. In another alternative, a package can be created based on the most popular primary colors among the colors selected in the games or contests, while a separate package is created for the most popular auxiliary colors in the games or competitions. competition.

As noted above, while creating ingredient combination packages is one practical application of the games described above, another practical application is tuning actual manufacturing volumes to prioritize the manufacturing of individual cartridges that match the ingredients determined in either of Figures 41 and 42.

Additionally, the flowcharts in Figures 41 and 42 can be configured to work for specific regions of the world based on the isolation of data collected in the regions of the world. Additionally, the flowcharts of Figures 41 and 42 can set the determination steps 4101 and 4201 to be performed periodically or seasonally. For example, a particular challenge may be initiated just before a certain season or event (such as a particular holiday), and the end date of the challenge may automatically trigger determination steps 4001 and 4101, where determination is focused on the results of the challenge. In this way, the available supply of salable packaging for the above distribution arrangement will be available in a timely manner, coinciding with the end of the challenge or the start of a particular season or event. For example, as shown in , when the challenge is completed and a screen is displayed showing the winners and the most popular shades (see Figures 38 and 39), then a graphic can be displayed allowing a user to purchase the bundled packages of cartridges on the basis of the challenge results. Additionally, in order for the manufacturing process to have time to begin manufacturing the packages according to the processes described above, there may be a predetermined delay (preferably a day or more) between the actual end of the competition voting and the display to the public of the screen shown on the .

The structural components for realizing the aforementioned game concept are similar to the architecture shown in one of Figures 14, 16, 17, 19 or 21. Thus, each user's smartphone is connected to a cloud platform ( performed by one or more servers), and the selections made by a user during a game or design challenge are transmitted to the cloud platform. The cloud platform processes the collected information with processing circuitry as defined above, and generates the calibration orders to update the app software for each user or generates the recommendation for an individual user for the process shown on the . Additionally, the cloud platform may connect directly to a plurality of manufacturing, filling and/or distribution facilities to send orders to control the distribution and packaging of cartridges based on the results of the processes of the cartridges. Figures 41 and 42. The manufacturing facility can directly receive updates to change the ingredients dispensed on a filling line, similar to the process described in US Publication No. 2020/0277181. Thus, changes to increased production and packaging of cartridges can be carried out in a fully automated manner, without human intervention if necessary.

Obviously, numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore understood that the invention can be implemented other than in the manner specifically described here

Claims (10)

A system including processing circuitry configured to execute a contest that includes:

• receiving inputs from a user to adjust a color of a mixed cosmetic;
• displaying the user input to a plurality of users and providing the plurality of users with an option to submit a vote on the user input and the inputs of other users; And
• outputting a result of a competition based on one or more entries receiving a greater number of votes;

in which the processing circuitry is further configured to:

• determining a plurality of color ingredients used for the adjusted colors in one or more entries receiving the highest number of votes, wherein the color ingredients correspond to cartridges used in a dispensing device to produce the mixed cosmetic product; And
• transmitting an instruction to a cartridge manufacturing facility to create a multi-pack of cartridges for the determined plurality of color ingredients.

System according to claim 1, wherein the competition further includes:

• displaying an image of a face of one of a plurality of models to a user;
• receiving user inputs to adjust a color of a mixed cosmetic product to apply to the model's face;
• displaying the model with the adjusted color selected by the user; And
• receiving the model's face image with the adjusted color as user input.

A system according to claim 1, wherein a number of cartridges in the cartridge bundle corresponds to a number of cartridges that are stored simultaneously in the dispensing device. System according to claim 1, wherein the processing circuitry is further configured to:

• determining a particular color among the adjusted colors in one or more entries receiving the greatest number of votes; And
• transmitting an instruction to the cartridge manufacturing facility to create a batch pack of cartridges to produce the particular color determined with the dispensing device.

System according to claim 1, wherein the processing circuitry is further configured to:

• determining a plurality of most frequent ingredients in the adjusted colors in the one or more inputs; And
• transmitting an instruction to the cartridge manufacturing facility to create a cartridge bundle that includes the plurality of the most common ingredients.

The system of claim 1, wherein the processing circuitry is further configured to transmit an instruction to a cartridge manufacturing facility to adjust manufacturing volumes to prioritize production of cartridges corresponding to the determined plurality of color ingredients . The system of claim 1, wherein the processing circuitry is further configured to transmit the instruction to a particular cartridge manufacturing facility in a specific geographic region based on the collection of contest voting data from of the specific geographic region. The system of claim 1, wherein the contest is configured to end before a season or event, and the end of the contest automatically triggers the processing circuitry to transmit the instruction to the manufacturing facility. The system of claim 8, wherein the processing circuitry is further configured to display a link to purchase a mixed cosmetic product corresponding to the entry receiving the highest number of votes. The system of claim 9, wherein the processing circuitry is configured to transmit the instruction to the manufacturing facility a predetermined time before displaying the link.