Model not responding.

[miguepollo]

Hi, when I was trying your model tinyllama with gradio server, the server crashed and showed me this error:

Traceback (most recent call last):
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/routes.py", line 1307, in predict
    output = await route_utils.call_process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<5 lines>...
    )
    ^
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/route_utils.py", line 354, in call_process_api
    output = await app.get_blocks().process_api(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<11 lines>...
    )
    ^
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/blocks.py", line 2117, in process_api
    data = await self.postprocess_data(block_fn, result["prediction"], state)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/blocks.py", line 1894, in postprocess_data
    prediction_value = block.postprocess(prediction_value)
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/components/chatbot.py", line 690, in postprocess
    self._check_format(value)
    ~~~~~~~~~~~~~~~~~~^^^^^^^
  File "/home/orangepi/.local/lib/python3.13/site-packages/gradio/components/chatbot.py", line 400, in _check_format
    raise Error(
        "Data incompatible with messages format. Each message should be a dictionary with 'role' and 'content' keys or a ChatMessage object."
    )
gradio.exceptions.Error: "Data incompatible with messages format. Each message should be a dictionary with 'role' and 'content' keys or a ChatMessage object."
´´´



And with rkllm command: 

<img width="1105" height="259" alt="Image" src="https://github.com/user-attachments/assets/0871df66-1dca-4e81-9c71-9ea1fa4fbce9" />

[miguepollo]

And with rkllm command