Class: LlamaDeuce
Llama2 LLM implementation
Implements
Constructors
constructor
• new LlamaDeuce(init?)
Parameters
| Name | Type |
|---|---|
init? | Partial<LlamaDeuce> |
Defined in
llm/LLM.ts:189
Properties
maxTokens
• Optional maxTokens: number
Defined in
llm/LLM.ts:186
model
• model: "Llama-2-70b-chat" | "Llama-2-13b-chat" | "Llama-2-7b-chat"
Defined in
llm/LLM.ts:184
replicateSession
• replicateSession: ReplicateSession
Defined in
llm/LLM.ts:187
temperature
• temperature: number
Defined in
llm/LLM.ts:185
Methods
chat
▸ chat(messages, _parentEvent?): Promise<ChatResponse>
Get a chat response from the LLM
Parameters
| Name | Type |
|---|---|
messages | ChatMessage[] |
_parentEvent? | Event |
Returns
Promise<ChatResponse>
Implementation of
Defined in
llm/LLM.ts:209
complete
▸ complete(prompt, parentEvent?): Promise<ChatResponse>
Get a prompt completion from the LLM
Parameters
| Name | Type | Description |
|---|---|---|
prompt | string | the prompt to complete |
parentEvent? | Event | - |
Returns
Promise<ChatResponse>
Implementation of
Defined in
llm/LLM.ts:234
mapMessageType
▸ mapMessageType(messageType): string
Parameters
| Name | Type |
|---|---|
messageType | MessageType |
Returns
string
Defined in
llm/LLM.ts:196