Ensembling multiple semantic segmentation models #813

ruipimentelfigueiredo · 2023-09-23T15:39:38Z

ruipimentelfigueiredo
Sep 23, 2023

Hello,
I was wondering if this library provides any way of averaging / voting the output of different models. If so could anyone provide an example?
Thanks

cagey-squirrel · 2023-12-14T12:49:48Z

cagey-squirrel
Dec 14, 2023

Do you have a binary segmentation or multiple classes?
There's a simple way to implement binary segmentation ensembling by taking mean of segmentation probabilities from all models. Although this is not exactly the same as voting, it can sometimes give even better results. Multiclass segmentation can be implemented in a similar way as well.

0 replies

ruipimentelfigueiredo · 2023-12-14T13:10:06Z

ruipimentelfigueiredo
Dec 14, 2023
Author

Could you provide some sample code with how to do it? i.e. how to extract the probabilities of multiple networks and use them for voting A quinta, 14/12/2023, 12:50, cagey-squirrel ***@***.***> escreveu:

…

Do you have a binary segmentation or multiple classes? There's a simple way to implement binary segmentation ensembling by taking mean of segmentation probabilities from all models. Although this is not exactly the same as voting, it can sometimes give even better results. Multiclass segmentation can be implemented in a similar way as well. — Reply to this email directly, view it on GitHub <#813 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABVNAN5HECF4THYUBVALUGDYJLYXPAVCNFSM6AAAAAA5EIWVMWVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TQNJTGI4DE> . You are receiving this because you authored the thread.Message ID: <qubvel/segmentation_models.pytorch/repo-discussions/813/comments/7853282@ github.com>

0 replies

cagey-squirrel · 2023-12-14T13:22:44Z

cagey-squirrel
Dec 14, 2023

Sure thing.
For example, for binary classification you can train multiple unet models with sigmoid activation function:
model = smp.Unet(encoder_name='resnet34', encoder_depth=5, encoder_weights='imagenet', activation='sigmoid')
When you finish training each of these models you save their weights so you can load them later.

Now, to make an ensemble
You can load you models into a list:
ensemble = [load_model(model_path) for model_path in list_of_model_paths]
Then for each batch you can call each model once and aggregate the results:

for data_features in data_loader:
    ensemble_prediction = torch.zeros((BATCH_SIZE, CHANNEL_SIZE, WIDTH, HEIGHT))
    for model in ensemble:
        prediction_probabilities = model(data_features)
        ensemble_prediction += prediction_probabilities

     ensemble_prediction /= len(ensemble)
     ensemble_prediction = ensemble_prediction > 0.5 # Getting 0/1 values from probabilities with 0.5 treshold

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Ensembling multiple semantic segmentation models #813

Uh oh!

{{title}}

Uh oh!

Replies: 3 comments

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

Ensembling multiple semantic segmentation models #813

Uh oh!

ruipimentelfigueiredo Sep 23, 2023

Replies: 3 comments

Uh oh!

cagey-squirrel Dec 14, 2023

Uh oh!

ruipimentelfigueiredo Dec 14, 2023 Author

Uh oh!

cagey-squirrel Dec 14, 2023

ruipimentelfigueiredo
Sep 23, 2023

cagey-squirrel
Dec 14, 2023

ruipimentelfigueiredo
Dec 14, 2023
Author

cagey-squirrel
Dec 14, 2023