8000 Feature Request: (webui) do not throw away message if there is error in stream · Issue #13709 · ggml-org/llama.cpp · GitHub
[go: up one dir, main page]

Skip to content
Feature Request: (webui) do not throw away message if there is error in stream #13709
Open
@ngxson

Description

@ngxson

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Currently, if the UI got an error while it's generating the text, it will throw away the generating message.

The most simple way to test is to Ctrl+C to kill the server while it's generating a response.

The expected behavior is to show a meaningful error like what they do on chatgpt

Image

Motivation

N/A

Possible Implementation

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0