Skip to content

Conversation

@SamitHuang
Copy link
Collaborator

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Provide a simpler example with less arguments to run image generatin with vllm-omni

Test Plan

run the basic usage code in the docs

Test Result

INFO 12-06 05:42:21 [parallel_state.py:1208] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, TP rank 0, EP rank 0
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:08<00:00,  2.76s/it]
WARNING 12-06 05:42:36 [__init__.py:755] Current vLLM config is not set.
INFO:vllm_omni.model_executor.model_loader.weight_utils:Using model weights format ['*']
INFO:vllm_omni.model_executor.model_loader.weight_utils:Time spent downloading weights for Tongyi-MAI/Z-Image-Turbo: 0.561067 seconds
INFO:vllm_omni.diffusion.worker.gpu_worker:Worker 0: Initialized device, model, and distributed environment.
INFO:vllm_omni.diffusion.worker.gpu_worker:Worker 0: Model loaded successfully.
INFO:vllm_omni.diffusion.worker.gpu_worker:Worker 0: Scheduler loop started.
INFO:vllm_omni.diffusion.worker.gpu_worker:Worker 0 ready to receive requests via shared memory
INFO:vllm_omni.diffusion.scheduler:SyncScheduler initialized result MessageQueue
INFO:vllm_omni.diffusion.omni_diffusion:Prepared 1 requests for generation.
INFO:vllm_omni.diffusion.diffusion_engine:Generation completed successfully.
Image saved to coffee.png
/usr/lib/python3.12/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '
/usr/lib/python3.12/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 2 leaked shared_memory objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
  • (Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

@SamitHuang SamitHuang changed the title [docs] Add basic usage examples for diffusion [Docs] Add basic usage examples for diffusion Dec 6, 2025
@SamitHuang SamitHuang requested review from Gaohan123 and removed request for hsliuustc0106 December 6, 2025 06:16
@SamitHuang SamitHuang added the documentation Improvements or additions to documentation label Dec 6, 2025
## Offline Inference

Please refer to [offline inference](../user_guide/examples/offline_inference/qwen2_5_omni.md)
Text-to-image generation quickstart with vllm-omni:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think in the quickstart, we may need to provide two examples:

  1. Qwen-Image example: Text-to-image generation quickstart with vllm-omni
  2. Qwen3-Omni example: Omni-modality understanding and generation quickstart with vllm-omni
    we need to make it better for users to undestand the usage of our API at the first glance.

## Offline Inference

Please refer to [offline inference](../user_guide/examples/offline_inference/qwen2_5_omni.md)
Text-to-image generation quickstart with vllm-omni:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Text-to-image generation quickstart with vllm-omni:
Text-to-image generation quickstart with vLLM-Omni:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants