8000 SV4D: add gradio demo · CodersSampling/generative-models@734195d · GitHub
[go: up one dir, main page]

Skip to content

Commit 734195d

Browse files
committed
SV4D: add gradio demo
1 parent 854bd4f commit 734195d

19 files changed

+484
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@
99
- We are releasing **[Stable Video 4D (SV4D)](https://huggingface.co/stabilityai/sv4d)**, a video-to-4D diffusion model for novel-view video synthesis. For research purposes:
1010
- **SV4D** was trained to generate 40 frames (5 video frames x 8 camera views) at 576x576 resolution, given 5 context frames (the input video), and 8 reference views (synthesised from the first frame of the input video, using a multi-view diffusion model like SV3D) of the same size, ideally white-background images with one object.
1111
- To generate longer novel-view videos (21 frames), we propose a novel sampling method using SV4D, by first sampling 5 anchor frames and then densely sampling the remaining frames while maintaining temporal consistency.
12+
- You can run the community-build gradio demo locally by running `python -m scripts.demo.gradio_app_sv4d`.
1213
- Please check our [project page](https://sv4d.github.io), [tech report](https://sv4d.github.io/static/sv4d_technical_report.pdf) and [video summary](https://www.youtube.com/watch?v=RBP8vdAWTgk) for more details.
1314

1415
**QUICKSTART** : `python scripts/sampling/simple_video_sample_4d.py --input_path assets/test_video1.mp4 --output_folder outputs/sv4d` (after downloading [sv4d.safetensors](https://huggingface.co/stabilityai/sv4d) and [sv3d_u.safetensors](https://huggingface.co/stabilityai/sv3d) from HuggingFace into `checkpoints/`)
47.1 KB
Binary file not shown.

assets/sv4d_example_video/dolphin.mp4

33.9 KB
Binary file not shown.
50.3 KB
Binary file not shown.
72.3 KB
Binary file not shown.

assets/sv4d_example_video/human5.mp4

133 KB
Binary file not shown.

assets/sv4d_example_video/human7.mp4

123 KB
Binary file not shown.
Binary file not shown.
74.1 KB
Binary file not shown.

0 commit comments

Comments
 (0)
0