...
| Code Block | ||
|---|---|---|
| ||
app // Name of the application; in this case, "gridrepublic:text-inference" commandLine // JSON string of the prompt in an array named "input"inputs"; double-quotes must be escaped hours // Runtime limit for the job; by default, use: 1 tag // Name of the model to use for inference |
...
| Code Block | ||
|---|---|---|
| ||
{
"app": "gridrepublic:text-inference",
"commandLine": "{'input'\"inputs\": ['\"When does 1+1=10?'\"] }",
"hours": 1,
"tag": "gemma:2b"
} |
When the job is submitted, the API returns a success indicator and either an array of job "ids", when success is true, or a string indicating an "error", when success is false. For example:
...
|
In the following example, \{ids\} was replaced with 9f22472031ef57c3fd517061d116ad68; the output of the inference process is contained in the "log" property and is updated as the process runs:
...