Skip to main content

Model

This is a Machine Learning Model, that will give readable information about the Machine Learning Model Used.

Properties

NameTypeDescriptionNotes
var_schemaEmbeddedModelSchema[optional]
idstruuid
versionstrthis is a version of the model.
createdGroupedTimestamp
namestrThis is an Optional Name of the Model.
descriptionstrAn Optional Description of the model itself.[optional]
cloudboolThis will inform the user if this was a model that is hosted in the cloud
typeModelTypeEnum
usageModelUsageEnum
bytesByteDescriptor[optional]
ramByteDescriptor[optional]
quantizationstrquantization is a string like: q8f16_0, q4f16_1, etc...[optional]
foundationModelFoundationEnum[optional]
downloadedboolThis is an optional bool to let us know if this model has been downloaded locally.[optional]
loadedboolThis is a boolean that represents if the model is loaded into memory.(this is not persisted, and is calculated on the fly.)[optional]
uniquestrThis is the unique model name used to load the model.[optional]
parametersfloatThis is the number of parameters in terms of billions.[optional]
providerExternalMLProviderEnum[optional]
cpuboolThis is an optional bool that is optimized for CPU usage.[optional]
downloadingboolThis is a calculated property, that will say if this is currently downloading.[optional]
max_tokensModelMaxTokens[optional]
custombool[optional]