-
-
Notifications
You must be signed in to change notification settings - Fork 18.7k
CI: Linting with azure instead of travis #22854
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
46620f2
dc8c528
adeb0ca
dcfb203
b765df8
3c77fc9
3d8af7d
ed1064d
8cb7b0f
dee5a08
54f9e98
20cb360
50d2757
19a213c
0cf5da9
4d10702
a356f03
50cb867
091193c
4a2ddba
e7c276a
8f73c08
87b5048
dc2e3a6
5ab03ab
ca9e12a
c591a17
c671da5
a6eed3e
3b853f9
850202d
a896532
bed55be
e555ce0
101f7f3
fce22e6
167f6dc
d44f189
906da22
9fb3999
c72c0e5
de1f52f
e4aa371
f33b6e6
63cfd5b
eb558df
371f06e
ca6e910
d262a04
fc4574c
168ec55
2f1b270
798698d
a3f601c
5ea21c6
46d281c
faf49e9
fa4f16c
c05f6b7
9162aeb
5640907
0286099
629a209
588d153
bc9c3b3
324b1e2
5bf1709
7cf2d68
2f8441e
30ba23e
85172b3
450f84a
7b4b1ea
5d69e8b
3ce1aa0
ee01df4
e353e8a
92a3921
9e34037
5a82f59
6cbb31b
2617696
75ad473
7af04e1
cc4331c
c5df401
4eac8bb
00032d1
e9ab754
e47b4e1
d0d4ae1
a225d44
d6d5c66
f7a6048
9aa18d0
283233d
991304d
3a71185
19c396f
a69e667
59d55d8
df50c58
455e77c
7f48ac2
078a987
d7883a1
c2be491
910825a
35c7d99
d321a42
4328b04
4c57f48
497f032
c88911a
75b89eb
011950e
01942b9
0a14165
705eb9d
498cebb
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
…m work
- Loading branch information
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -27,12 +27,8 @@ jobs: | |
- job: 'Checks_and_doc' | ||
pool: | ||
vmImage: ubuntu-16.04 | ||
timeoutInMinutes: 90 | ||
steps: | ||
- task: UsePythonVersion@0 | ||
inputs: | ||
versionSpec: '3.7' | ||
architecture: 'x64' | ||
|
||
- script: | | ||
# XXX not sure why setting $PATH here does not work | ||
# echo '##vso[task.setvariable variable=PATH]$HOME/miniconda3/bin:$PATH' | ||
|
@@ -44,7 +40,6 @@ jobs: | |
# Do not require a conda environment | ||
- script: | | ||
export PATH=$HOME/miniconda3/bin:$PATH | ||
source activate pandas-dev | ||
ci/code_checks.sh patterns | ||
displayName: 'Looking for unwanted patterns' | ||
condition: true | ||
|
@@ -114,16 +109,23 @@ jobs: | |
condition: true | ||
|
||
- script: | | ||
if [ "$(Build.SourceBranch)" == "refs/heads/master" ]; then | ||
export NAME="master" | ||
else | ||
export NAME=$(System.PullRequest.PullRequestId) | ||
fi | ||
echo $CONNECTION_STRING | wc -c | ||
az extension add --name storage-preview | ||
az storage blob upload-batch --account-name=$ACCOUNT_NAME --account-key=$ACCOUNT_KEY -s $SOURCE_PATH -d '$web' | ||
az storage blob upload-batch --connection-string $CONNECTION_STRING \ | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. A difference I see is that I'm relying on - script: |
az extension add --name storage-preview
az storage blob upload-batch -s some/path/ -d '$web'
env:
AZURE_STORAGE_CONNECTION_STRING: $(CONNECTION_STRING) But I think this may be a red herring... will reply with another comment on what I think is going on. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. FYI @datapythonista the correct environment variable is now called There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. (In the process of writing out the below instructions, I just realized what's happening. Will follow up with another comment.) Since the pipeline variable now has the correct name, this should work: - script: | if [ "$(Build.SourceBranch)" == "refs/heads/master" ]; then export NAME="master" else export NAME=$(System.PullRequest.PullRequestId) fi az extension add --name storage-preview az storage blob upload-batch --source $SOURCE \ --destination '$web' --destination-path "docs/$NAME" displayName: 'Publishing docs (Azure storage)' condition: true env: AZURE_STORAGE_CONNECTION_STRING: $(AZURE_STORAGE_CONNECTION_STRING) # this should map in the secret explicitly SOURCE: $(Build.SourcesDirectory)/doc/build/html/ |
||
--source $SOURCE \ | ||
--destination $DESTINATION \ | ||
--destination-path $NAME | ||
displayName: 'Publishing docs (Azure storage)' | ||
condition: true | ||
env: | ||
SOURCE_PATH: $(Build.SourcesDirectory)/doc/build/html/ | ||
# Moving connection data to arguments | ||
# AZURE_STORAGE_CONNECTION_STRING: $(AZURE_STORAGE_CONNECTION_STRING) | ||
ACCOUNT_NAME: $(AZURE_STORAGE_ACCOUNT) | ||
ACCOUNT_KEY: "$(AZURE_STORAGE_ACCESS_KEY)=" | ||
CONNECTION_STRING: $(AZURE_STORAGE_CONNECTION_STRING) | ||
SOURCE: $(Build.SourcesDirectory)/doc/build/html/ | ||
DESTINATION: 'docs' | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I realize we haven't gotten to the bottom of the secrets/connection string thing, but also, the Azure static sites feature requires that your destination container be the string |
||
|
||
- script: | | ||
if [ "$(Build.SourceBranch)" == "refs/heads/master" ]; then | ||
|
@@ -156,19 +158,16 @@ jobs: | |
if git diff upstream/master --name-only | grep -q "^asv_bench/"; then | ||
cd asv_bench | ||
asv machine --yes | ||
asv dev | ||
ASV_ERRORS=$(asv dev > /dev/null) | ||
echo "Captured ASV_ERRORS:" | ||
echo $ASV_ERRORS | ||
if [[ $ASV_ERRORS ]]; then | ||
echo "##vso[task.logissue type=error]Benchmarks failed to run" | ||
ASV_OUTPUT=$(asv dev) | ||
if [[ $(echo $ASV_OUTPUT | grep "failure") ]]; then | ||
echo "##vso[task.logissue type=error]Benchmarks run with errors" | ||
echo $ASV_ERRORS | ||
exit 1 | ||
else | ||
echo "Benchmark run without errors" | ||
echo "Benchmarks run without errors" | ||
fi | ||
else | ||
echo "Benchmark not running, no changes detected" | ||
echo "Benchmarks did not run, no changes detected" | ||
fi | ||
displayName: 'Running benchmarks' | ||
condition: true | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Why did you add running benchmarks when the original issue was just to migrate Also, as your changes did not actually modify any Python benchmark code, it was not possible to review how it would look in the Azure logs. This log here from another PR (#23752) is unfortunately impossible to read: https://dev.azure.com/pandas-dev/pandas/_build/results?buildId=4580 There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Also, it's somewhat debatable as to whether we even want to just run benchmarks when there's only a diff in |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
FWIW, you can
echo "##vso[task.prependpath]$HOME/miniconda3/bin"
here to make the path change durable for the job.