10000 Simplify the process of creating baselines using Kaleido and improve image & other export test systems by archmoj · Pull Request #5724 · plotly/plotly.js · GitHub
[go: up one dir, main page]

Skip to content

Simplify the process of creating baselines using Kaleido and improve image & other export test systems #5724

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 59 commits into from
Jun 25, 2021
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
59 commits
Select commit Hold shift + click to select a range
0aced42
generate baselines by new system and using kaleido
archmoj Jun 10, 2021
f166d35
provide googleFonts for image test
archmoj Jun 11, 2021
96b3d5e
provide liberation2 fonts for image test
archmoj Jun 10, 2021
9fb28a3
provide noto font for japanese and gl3d_world-cals baselines
archmoj Jun 10, 2021
71cb928
Revise exports & baseline creation and testing using Kaleido
archmoj Jun 10, 2021
0f9292c
pin down versions in export test similar to image test
archmoj Jun 11, 2021
23ff879
add info on how to draft new baselines
archmoj Jun 14, 2021
ff9b12f
remove image viewer - one could use GitHub os vs-code
archmoj Jun 14, 2021
f23e4cb
move important info on making baselines and remove fat docker readme
archmoj Jun 14, 2021
e8f3d88
remove redundant start-test_dashboard
archmoj Jun 14, 2021
0dc8a41
Merge remote-tracking branch 'origin/master' into switch-to-kaleido
archmoj Jun 15, 2021
ca18710
Update test/image/make_baseline.py
archmoj Jun 15, 2021
fe0502c
Update test/image/make_baseline.py
archmoj Jun 15, 2021
02248d4
Update test/image/make_baseline.py
archmoj Jun 15, 2021
027323e
esp > eps
archmoj Jun 15, 2021
13322c5
test eps export on ci
archmoj Jun 15, 2021
7a44a8e
simplify exclude black lists
archmoj Jun 15, 2021
b1de0bb
reduce pixelmatch threshold to 0 for non-mapbox also fail on mapbox b…
archmoj Jun 17, 2021
4a28781
Merge remote-tracking branch 'origin/master' into switch-to-kaleido
archmoj Jun 18, 2021
82b0ead
update master new baselines using kaleido
archmoj Jun 18, 2021
f0c9e24
adjust bar_show_narrow test
archmoj Jun 18, 2021
4b1b383
Revert "adjust bar_show_narrow test"
archmoj Jun 21, 2021
74853f4
do not keep liberation2 fonts on the repo
archmoj Jun 23, 2021
6522bd5
install liberation2 fonts in docker
archmoj Jun 23, 2021
1786204
do not keep NotoSerifCJK fonts on the repo
archmoj Jun 23, 2021
9f705f7
install NotoSansCJK fonts in docker
archmoj Jun 23, 2021
083f9be
update japanese baseline
archmoj Jun 23, 2021
bb6abea
do not keep Raleway fonts on the repo
archmoj Jun 23, 2021
28077d1
add script to download some google fonts
archmoj Jun 23, 2021
856009e
update baselines using new Raleway fonts
archmoj Jun 23, 2021
f7f4cf1
do not keep Roboto fonts on the repo
archmoj Jun 23, 2021
21e262f
download Roboto fonts
archmoj Jun 23, 2021
9c71d22
update legend_horizontal_autowrap using new Roboto fonts
archmoj Jun 23, 2021
141e40d
do not keep PT_Sans-Narrow fonts on the repo
archmoj Jun 23, 2021
c1341fa
download PT_Sans-Narrow-Web
archmoj Jun 23, 2021
e791887
wip to download OpenSans fonts - could cause big diff
archmoj Jun 23, 2021
0c5d366
do not keep OldStandard fonts on the repo
archmoj Jun 23, 2021
d7548b1
download Old_Standar_dTT
archmoj Jun 24, 2021
09eb8fa
update baselines using new Old_Standard_TT fonts
archmoj Jun 24, 2021
2100fe9
Merge remote-tracking branch 'origin/master' into switch-to-kaleido
archmoj Jun 24, 2021
be8b865
generate baselines using new system
archmoj Jun 24, 2021
1a7461f
do not keep Droid_Sans fonts on the repo
archmoj Jun 24, 2021
1afa2fe
download NotoSans fonts instead of Driod_Sans
archmoj Jun 24, 2021
2a7071f
use NotoSans fonts instead of Driod_Sans
archmoj Jun 24, 2021
ab4b4f9
update baselines using NotoSans instead of Driod_Sans
archmoj Jun 24, 2021
8ad4a68
do not keep Droid_Serif fonts on the repo
archmoj Jun 24, 2021
3bfb395
download NotoSerif fonts instead of Driod_Serif
archmoj Jun 24, 2021
db307f6
use NotoSerif fonts instead of Driod_Serif
archmoj Jun 24, 2021
a4996d0
update baselines using NotoSerif instead of Driod_Serif
archmoj Jun 24, 2021
d1dcafb
do not keep Droid_Sans_Mono font on the repo
archmoj Jun 24, 2021
e98ce87
download NotoSansMono fonts instead of Driod_Sans_Mono
archmoj Jun 24, 2021
d65ee01
use NotoSansMono fonts instead of Driod_Sans_Mono
archmoj Jun 24, 2021
d99dd7f
update baselines using NotoSansMono instead of Driod_Sans_Mono
archmoj Jun 24, 2021
5996af1
do not keep Gravitas_One font on the repo
archmoj Jun 24, 2021
2b8d3ba
download GravitasOne
archmoj Jun 24, 2021
6a15c9e
do not keep Balto fonts on the repo
archmoj Jun 24, 2021
dd1dc35
use Roboto instead of Balto - Roboto used to be in legend_horizontal_…
archmoj Jun 24, 2021
b6a881e
update baselines using Roboto instead of Balto
archmoj Jun 24, 2021
5756afe
update CircleCi task description
archmoj Jun 24, 2021
8000
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove image viewer - one could use GitHub os vs-code
  • Loading branch information
archmoj committed Jun 14, 2021
commit ff9b12f6869865766ddc3562953575f8fa9f0682
18 changes: 0 additions & 18 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -229,24 +229,6 @@ Please note that image pixel comparison tests run using circleci/python:3.8.9 do
Therefore the final baselines may need updates.
This could simply be done by downloading the `baselines.tar` stored in the `ARTIFACTS` tab of `test-baselines` job (if the test failed).

### Image pixel comparison tests

Image pixel comparison tests are run in a docker container. For more
information on how to run them locally, please refer to [image test
README](https://github.com/plotly/plotly.js/blob/master/test/image/README.md).

Running the test locally outputs the generated png images in `build/test_images/` and the png diffs in `build/test_images_diff/` (two git-ignored directories).

To view the image pixel comparison test results, run

```
npm run start-image_viewer
```

which shows the baseline image, the generated image, the diff and the json mocks of test cases that failed.

To view the results of a run on CircleCI, download the `build/test_images/` and `build/test_images_diff/` artifacts into your local repo and then run `npm run start-image_viewer`.

### Using the developer console in karma to write/debug jasmine tests

- Click on the `DEBUG` button
Expand Down
12 changes: 0 additions & 12 deletions 8000 devtools/image_viewer/index.html

This file was deleted.

51 changes: 0 additions & 51 deletions devtools/image_viewer/server.js

This file was deleted.

104 changes: 0 additions & 104 deletions devtools/image_viewer/viewer.js

This file was deleted.

1 change: 0 additions & 1 deletion package.json
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,6 @@
"test-plain-obj": "node tasks/test_plain_obj.js",
"test": "npm run test-jasmine -- --nowatch && npm run test-bundle && npm run test-image && npm run test-export && npm run test-syntax && npm run lint",
"start-test_dashboard": "node devtools/test_dashboard/server.js",
"start-image_viewer": "node devtools/image_viewer/server.js",
"start": "npm run start-test_dashboard",
"baseline": "node test/image/make_baseline.js",
"noci-baseline": "npm run cibuild && ./tasks/noci_test.sh image && git checkout dist && echo 'Please do not commit unless the change was expected!'",
Expand Down
1 change: 0 additions & 1 deletion tasks/util/constants.js
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,6 @@ module.exports = {
pathToCSSBuild: path.join(pathToBuild, 'plotcss.js'),

pathToTestDashboardBundle: path.join(pathToBuild, 'test_dashboard-bundle.js'),
pathToImageViewerBundle: path.join(pathToBuild, 'image_viewer-bundle.js'),

pathToImageTest: pathToImageTest,
pathToTestImageMocks: path.join(pathToImageTest, 'mocks/'),
Expand Down
0