8000 CI reduce verbosity of build_doc.sh by ogrisel · Pull Request #23557 · scikit-learn/scikit-learn · GitHub
[go: up one dir, main page]
Skip to content

CI reduce verbosity of build_doc.sh #23557

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jun 7, 2022
Merged

CI reduce verbosity of build_doc.sh #23557

Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
e5b3adf
CI make build_doc.sh less verbose reduce log scrolling needs
ogrisel Jun 7, 2022
5d7c852
DEBUG insert doc change in example
ogrisel Jun 7, 2022
3cb5252
Remove set -v and silence the scikit-learn dev build
ogrisel Jun 7, 2022
493793d
Set conda-lock log level to WARNING instead of INFO
ogrisel Jun 7, 2022
8cba9c3
Display ccache summary after build
ogrisel Jun 7, 2022
3c313d4
Revert debug doc change
ogrisel Jun 7, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 12 additions & 10 deletions build_tools/github/build_doc.sh
View file
Open in desktop
< 53AE /tr>
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
#!/usr/bin/env bash
set -x
set -e

# Decide what kind of documentation build to run, and run it.
Expand Down Expand Up @@ -154,32 +153,35 @@ sudo -E apt-get -yq update --allow-releaseinfo-change
sudo -E apt-get -yq --no-install-suggests --no-install-recommends \
install dvipng gsfonts ccache zip optipng

# deactivate circleci virtualenv and setup a miniconda env instead
# deactivate circleci virtualenv and setup a conda env instead
if [[ `type -t deactivate` ]]; then
deactivate
fi

MINICONDA_PATH=$HOME/miniconda
# Install dependencies with miniconda
wget https://github.com/conda-forge/miniforge/releases/latest/download/Mambaforge-Linux-x86_64.sh \
-O miniconda.sh
chmod +x miniconda.sh && ./miniconda.sh -b -p $MINICONDA_PATH
export PATH="/usr/lib/ccache:$MINICONDA_PATH/bin:$PATH"
MAMBAFORGE_PATH=$HOME/mambaforge
# Install dependencies with mamba
wget -q https://github.com/conda-forge/miniforge/releases/latest/download/Mambaforge-Linux-x86_64.sh \
-O mambaforge.sh
chmod +x mambaforge.sh && ./mambaforge.sh -b -p $MAMBAFORGE_PATH
export PATH="/usr/lib/ccache:$MAMBAFORGE_PATH/bin:$PATH"

ccache -M 512M
export CCACHE_COMPRESS=1

# pin conda-lock to latest released version (needs manual update from time to time)
mamba install conda-lock==1.0.5 -y
conda-lock install --name $CONDA_ENV_NAME $LOCK_FILE
conda-lock install --log-level WARNING --name $CONDA_ENV_NAME $LOCK_FILE
source activate $CONDA_ENV_NAME

mamba list

# Set parallelism to 3 to overlap IO bound tasks with CPU bound tasks on CI
# workers with 2 cores when building the compiled extensions of scikit-learn.
export SKLEARN_BUILD_PARALLEL=3
python setup.py develop
pip install -e . --no-build-isolation

echo "ccache build summary:"
ccache -s

export OMP_NUM_THREADS=1

Expand Down
0