Pywayne Llm Chat Ollama Gradio

👤 wangyendt 📦 v0.1.0 ⭐ 3.6 ⬇️ 1.3K 下载
💻 开发编程 免费

📖 技能介绍


name: pywayne-llm-chat-ollama-gradio description: Gradio-based chat interface for Ollama with multi-session management. Use when working with pywayne.llm.chat_ollama_gradio module to create a web-based chat UI that connects to Ollama models, supports multiple chat sessions, model selection, and streaming responses. Integrates with ChatManager for session management.


Pywayne Chat Ollama Gradio

小葱技能7w4.net有更新,你可以访问看下。

This module provides a Gradio-based web chat interface for Ollama models with multi-session support.

Quick Start

from pywayne.llm.chat_ollama_gradio import OllamaChatGradio

# Create and launch chat interface
app = OllamaChatGradio(
    base_url="http://localhost:11434/v1",
    server_port=7870
)
app.launch()

Configuration

Parameter Default Description
base_url "http://localhost:11434/v1" Ollama API base URL
server_name "0.0.0.0" Server host name
server_port 7870 Server port
root_path "" Root path for reverse proxy
api_key "ollama" API key (for Ollama compatibility)

Model Discovery

Automatically discovers available Ollama models by running ollama list:

  • Excludes models with 'embed' in the name
  • Falls back to qwen2.5:0.5b if no models found

Session Management

Creating New Sessions

# UI method: Click "新建会话" button
new_chat_id, new_history, new_choices = app.create_new_chat()

Switching Sessions

# UI method: Select from "历史会话" radio list
history = app.switch_chat(selected_chat_id)

API Reference

OllamaChatGradio

Method Description
get_ollama_models() Get list of available Ollama models
init_chat_manager() Initialize ChatManager instance
create_new_chat() Create new chat session, returns (chat_id, history, radio_update)
switch_chat(chat_id) Switch to specified chat session
format_history(history) Format history for display
chat(message, history, model_name) Process chat message with streaming
create_demo() Create Gradio interface
launch() Launch Gradio server

UI Components

Component Description
chatbot Main chat display area
msg Message input textbox
model_dropdown Model selection dropdown
chat_id_text Current session ID (read-only)
new_chat_btn Button to create new session
chat_history_list Radio list for session switching

Requirements

  • gradio - Web UI framework
  • pywayne.llm.chat_bot - ChatManager and LLMConfig
  • ollama CLI - Must be installed and accessible

Notes

  • Uses ChatManager for multi-session support
  • Streaming responses update UI in real-time
  • Session history persists in memory (not persistent)
  • Requires Ollama to be running before launching

🤖 AI 评测

这个 Skill 文档写得不错,但实际用不了——它只有说明文档,缺少核心代码,就像买了一本菜谱却没有配方。建议等开发者补充完整代码后再使用。

📊 多维度评分

适应性3.7
规范性3.8
有效性3.4
可靠性3
可信度4.7

📁 包含文件 (2 个)

📄 SKILL.md 2.8 KB
📄 _meta.json 137 B