Package com.hw.langchain.llms.openai

Class OpenAIChat

java.lang.Object

com.hw.langchain.llms.base.BaseLLM

com.hw.langchain.llms.openai.OpenAIChat

All Implemented Interfaces:

BaseLanguageModel

public class OpenAIChat
extends BaseLLM

Wrapper around OpenAI Chat large language models.

Author:

HamaWhite

Field Summary

Fields

Modifier and Type	Field	Description
protected OpenAiClient	client
protected float	frequencyPenalty	Penalizes repeated tokens according to frequency.
protected Map<String,Float>	logitBias	Adjust the probability of specific tokens being generated.
protected int	maxRetries	Maximum number of retries to make when generating.
protected int	maxTokens	The maximum number of tokens to generate in the completion.
protected String	model	Model name to use.
protected int	n	How many completions to generate for each prompt.
protected String	openaiApiBase	Base URL for OpenAI API.
protected String	openaiApiKey	API key for OpenAI.
protected OpenaiApiType	openaiApiType	Api type for Azure OpenAI API.
protected String	openaiApiVersion	Api version for Azure OpenAI API.
protected String	openaiOrganization	Organization ID for OpenAI.
protected String	openaiProxy	Support explicit proxy for OpenAI
protected float	presencePenalty	Penalizes repeated tokens.
protected long	requestTimeout	Timeout for requests to OpenAI completion API.
protected boolean	stream	Whether to stream the results or not.
protected float	temperature	What sampling temperature to use.
protected float	topP	Total probability mass of tokens to consider at each step.

Constructor Summary

Constructors

Constructor	Description
OpenAIChat()

Method Summary

Modifier and Type	Method	Description
protected reactor.core.publisher.Flux<AsyncLLMResult>	asyncInnerGenerate(List<String> prompts, List<String> stop)	Run the LLM on the given prompts async.
OpenAIChat	init()
protected LLMResult	innerGenerate(List<String> prompts, List<String> stop)	Run the LLM on the given prompts.
String	llmType()	Return type of llm.

Methods inherited from class com.hw.langchain.llms.base.BaseLLM

asyncGeneratePrompt, asyncPredict, call, call, generate, generatePrompt, predict, predictMessages

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.hw.langchain.base.language.BaseLanguageModel

asyncGeneratePrompt, asyncPredict, asyncPredictMessages, predict, predictMessages

Field Details

client

protected OpenAiClient client

model

protected String model

Model name to use.

temperature

protected float temperature

What sampling temperature to use.

maxTokens

protected int maxTokens

The maximum number of tokens to generate in the completion. -1 returns as many tokens as possible given the prompt and the model's maximal context size.

topP

protected float topP

Total probability mass of tokens to consider at each step.

frequencyPenalty

protected float frequencyPenalty

Penalizes repeated tokens according to frequency.

presencePenalty

protected float presencePenalty

Penalizes repeated tokens.

n

protected int n

How many completions to generate for each prompt.

openaiApiKey

protected String openaiApiKey

API key for OpenAI.

openaiApiBase

protected String openaiApiBase

Base URL for OpenAI API.

openaiApiType

protected OpenaiApiType openaiApiType

Api type for Azure OpenAI API.

openaiApiVersion

protected String openaiApiVersion

Api version for Azure OpenAI API.

openaiOrganization

protected String openaiOrganization

Organization ID for OpenAI.

openaiProxy

protected String openaiProxy

Support explicit proxy for OpenAI

maxRetries

protected int maxRetries

Maximum number of retries to make when generating.

requestTimeout

protected long requestTimeout

Timeout for requests to OpenAI completion API. Default is 16 seconds.

logitBias

protected Map<String,Float> logitBias

Adjust the probability of specific tokens being generated.

stream

protected boolean stream

Whether to stream the results or not.

Constructor Details

OpenAIChat

public OpenAIChat()

Method Details

init

public OpenAIChat init()

llmType

public String llmType()

Description copied from class: BaseLLM

Return type of llm.

Specified by:

llmType in class BaseLLM

innerGenerate

protected LLMResult innerGenerate(List<String> prompts,
 List<String> stop)

Description copied from class: BaseLLM

Run the LLM on the given prompts.

Specified by:

innerGenerate in class BaseLLM

asyncInnerGenerate

protected reactor.core.publisher.Flux<AsyncLLMResult> asyncInnerGenerate(List<String> prompts,
 List<String> stop)

Description copied from class: BaseLLM

Run the LLM on the given prompts async.

Specified by:

asyncInnerGenerate in class BaseLLM