CLI Reference

CLI Reference

liter-llm

LiterLLM proxy server and MCP tool server

Options

Name	Flags	Type	Default	Description
tokio_worker_threads	--tokio-worker-threads	Option<NonZeroUsize>		Number of Tokio worker threads (default: physical CPU count).
tokio_max_blocking_threads	--tokio-max-blocking-threads	Option<NonZeroUsize>		Maximum number of Tokio blocking threads (default: 512).

liter-llm api

Start the OpenAI-compatible proxy server.

Options

Name	Flags	Type	Default	Description
config	--config	Option<PathBuf>		Path to config file (default: auto-discover liter-llm-proxy.toml).
host	--host	String	0.0.0.0	Override bind host.
port	--port	u16	4000	Override bind port.
master_key	--master-key	Option<String>		Master API key (overrides config/env).
debug	--debug	bool		Enable debug logging.
watch	--watch	bool		Enable hot-reload of the configuration file.
etcd_endpoint	--etcd-endpoint	Vec<String>		etcd endpoint URL(s) for distributed config (comma-separated).
etcd_key	--etcd-key	String	/liter-llm/config	etcd key to watch for proxy configuration (default: /liter-llm/config).

liter-llm mcp

Start the MCP server exposing LLM operations as tools.

Options

Name	Flags	Type	Default	Description
config	--config	Option<PathBuf>		Path to config file.
transport	--transport	String	stdio	Transport mode: stdio or http.
host	--host	String	127.0.0.1	Host for HTTP transport.
port	--port	u16	3001	Port for HTTP transport.