8000 remove func · grimoire/lmdeploy@7282a84 · GitHub
[go: up one dir, main page]

Skip to content

Commit 7282a84

Browse files
committed
remove func
1 parent 4878718 commit 7282a84

File tree

1 file changed

+0
-5
lines changed

1 file changed

+0
-5
lines changed

lmdeploy/pytorch/engine/model_agent.py

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -406,11 +406,6 @@ def __update_inputs(next_token_ids, model_metas):
406406
if sampling_inputs.random_offsets is not None:
407407
sampling_inputs.random_offsets += 1
408408

409-
async def __await_distworker(worker, timeout: float = 0.001):
410-
while not worker.is_completed():
411-
await asyncio.sleep(timeout)
412-
worker.wait()
413-
414409
def __try_copy_everything():
415410
"""try copy all inputs."""
416411
nonlocal inputs, all_ids, guided_input_ids, sampling_inputs, num_appendable_ids, num_ignore_eos

0 commit comments

Comments
 (0)
0