Persistence Overview
PraisonAI supports automatic database persistence for conversations, knowledge, and state management across 22 database backends.Quick Start
Enable persistence in 2 lines:Installation
Supported Backends
| Category | Backends | Count |
|---|---|---|
| Conversation | PostgreSQL, MySQL (including MySQLConversationStore), SQLite, SingleStore, Supabase, SurrealDB, Turso | 7+ |
| Knowledge | Qdrant, ChromaDB, Pinecone, Weaviate, LanceDB, Milvus, PGVector, Redis, Cassandra, ClickHouse, MongoDB Vector, Couchbase, SingleStore Vector, SurrealDB Vector, Upstash Vector, LightRAG, LangChain, LlamaIndex, CosmosDB | 19 |
| State | Redis, MongoDB, DynamoDB, Firestore, Upstash, Memory, GCS | 7 |
Backend Aliases
The persistence registry provides user-friendly aliases for common databases: Conversation stores:neon,cockroachdb,xata→postgresasyncpg,postgres_async→async_postgresaiomysql,mysql_async→async_mysqlsqlite_sync→sync_sqliteaiosqlite,sqlite_async→async_sqlitelibsql→turso
chromadb→chromamongodb_atlas,cosmos,azure_cosmos→ Vector store variantsllama_index,langchain_adapter→ Framework adapters
motor,mongodb_async→async_mongodb
Architecture
Key Features
- Zero Config: SQLite works out of the box with
memory=True - Session Resume: Same
session_id= continue conversation - Runtime State Mirroring: lightweight per-turn artefacts for native↔plugin handoff (opt-in via
SessionConfig.mirror_runtime_state) - Lazy Loading: No performance impact until used
- CLI Support:
praisonai persistence doctor/run/resume
Concurrency & Thread Safety
Persistence sync wrappers (get_session, add_message, get, set, delete, list_keys, clear, close, …) are safe to call from any context — plain sync scripts, worker threads, or code running inside a live event loop (FastAPI, Streamlit, background tasks). They route through a canonical async bridge, so you will not see RuntimeError: This event loop is already running anymore.
Async hooks offloading (PR #1829): Sync conversation stores plugged into async hooks are now automatically offloaded via asyncio.to_thread() rather than blocking the event loop. The orchestrator uses isinstance(store, AsyncConversationStore) to determine whether to await the store directly or wrap it in thread execution.
As of PR #1763, you can also opt into the dedicated sync_sqlite backend (mode="sync") — it provides per-call connection locking (threading.RLock) for multi-agent scenarios where you’d rather not depend on the legacy sync wrappers.
The DbAdapter’s lazy store initialisation is also race-free: the first thread to touch the adapter constructs the stores, and subsequent threads see the ready instance.
The session cache inside PersistenceOrchestrator is also thread-safe as of PR #1609. Reads return a deepcopy of the cached ConversationSession, so multiple agents sharing one orchestrator can read/update sessions concurrently without races.
The JSON session store (DefaultSessionStore) reloads from disk under FileLock for
every mutator as of PR #1709 (metadata) and PR #1724 (agent info, gateway info, clear).
Two processes pointed at the same ~/.praisonai/sessions/ directory can now interleave
add_message and set_agent_info / clear_session / set_gateway_info calls without
losing messages. Reads reload from disk under lock on every get_chat_history / get_session call.
HierarchicalSessionStore inherits the JSON store’s reload-under-lock guarantees and additionally preserves parent_id, children_ids, and snapshots across all mutators (PR #1745). UI hosts that fork sessions or take snapshots are safe to run alongside an agent’s auto_save writer.
These improvements were added in PraisonAI PR #1466, #1609, #1709, #1724, and #1727 to ensure robust multi-threaded operation in production environments.
DefaultSessionStore) reloads from disk under FileLock for every mutator as of PR #1709 (metadata), PR #1724 (agent info, gateway info, clear), and PR #1727 (LocalManagedAgent._persist_state). PRs #1759 and #1764 extended the same FileLock-guarded reload to the read path (get_chat_history, get_session, get_sessions_by_agent), so two processes pointed at the same ~/.praisonai/sessions/ directory observe each other’s writes without any stale-cache window.
Schema Versioning (PR #1829)
New unified schema system: All SQL conversation stores now inherit from_SQLConversationStoreBase with consistent SCHEMA_VERSION = "1.0.0". This applies to PostgreSQL, MySQL (new), and all existing SQL backends uniformly.
The base class provides:
- Standardized table schemas for sessions and messages
- Dialect-specific type mappings (
_id_type,_json_type,_float_type) - Unified retry logic with
max_retriesandretry_delayparameters - Automatic serverless database detection and exponential backoff
- Consistent
table_prefixhandling across all SQL stores
MySQLConversationStore (from praisonai.persistence.conversation.mysql_new) includes PlanetScale auto-retry with exponential backoff for serverless cold-starts.
Schema Migration (PR #1597)
If you ran an async store before this release, either:- Pass
table_prefix="praisonai_"explicitly to keep your old tables, or - Rename existing tables:
ALTER TABLE praisonai_sessions RENAME TO praison_sessions;(and likewise for_messages).
state (sessions), and tool_calls + tool_call_id (messages). The store creates them automatically on first connect via CREATE TABLE IF NOT EXISTS. Existing tables on a pre-#1597 schema will not auto-migrate; add the columns with:
Custom Stores & Aliases
Register custom storage backends with the persistence registry, including optional aliases:The
register_store() method is the canonical API. The register() method is preserved as a backward-compatible alias.Next Steps
- Quickstart - Get started in 5 minutes
- Session Resume - Continue conversations
- Session Runtime State - Per-turn runtime artefacts for replay and handoff
- Async Conversation Store - AsyncConversationStore protocol for non-blocking persistence
- CLI Reference - Command-line usage
- Backend Plugins - Custom storage backends

