fix: handle complex nested schemas in gemini function calling & structured outputs #1233
Conversation
|
DescriptionSummary By MatterAI
🔄 What ChangedThis PR addresses an issue where nested models weren’t working with Gemini tool parameters due to schemas with 🔍 Impact of the ChangeThis change ensures that complex nested schemas, particularly those utilizing 📁 Total Files Changed
🧪 Test AddedN/A (This specific PR does not introduce new tests in its patch. However, comprehensive unit tests covering schema dereferencing and transformation for complex nested schemas were added in a related previous pull request, ensuring this fix is adequately covered.) 🔒Security VulnerabilitiesN/A MotivationThis PR is motivated by the need to ensure the robustness and correctness of schema transformation logic for Gemini function calling, especially for complex nested data structures. Adding comprehensive tests helps prevent regressions and ensures reliable interaction with the Gemini API. Type of Change
How Has This Been Tested?
Screenshots (if applicable)N/A Checklist
Tip Quality Recommendations
Tanka Poem ♫
|
![matter-code-review[bot]](https://avatars.githubusercontent.com/in/474549?s=60&v=4){kind=small}
| } else if ( | ||
| key === 'anyOf' && | ||
| Array.isArray(value) && | ||
| value.length === 2 |
There was a problem hiding this comment.
does google not support nullable field with more than one anyOf fields?
There was a problem hiding this comment.
Yes, type: null is not allowed. If we want to imply a field is optional, we should use nullable field
References I found:
- Nullable types not supported in pydantic classes for json googleapis/python-genai#62
- https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/function-calling#schema
Input should be 'TYPE_UNSPECIFIED', 'STRING', 'NUMBER', 'INTEGER', 'BOOLEAN', 'ARRAY' or 'OBJECT'
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
| if (Object.hasOwn(schema, '$schema')) { | ||
| delete schema['$schema']; | ||
| } |
There was a problem hiding this comment.
This has been already handled at recursivelyDeleteUnsupportedParameters, hence removed
pnkvalavala
changed the title
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
@narengogi have added tests, updated code to fix both function calling and structured outputs |
| for (const [key, value] of Object.entries(node)) { | ||
| if (key === 'enum' && Array.isArray(value)) { | ||
| transformed.enum = value; | ||
| transformed.format = 'enum'; |
There was a problem hiding this comment.
I dont see enum as supported format in vertex docs
There was a problem hiding this comment.
I have tested by removing format: enum customization for both function calling and structured outputs that I followed from instructor library, it worked. Hence removed and updated PR
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
| if (stack.has(defKey)) return node; | ||
| stack.add(defKey); | ||
| const resolved = derefer(target, activeDefs, stack); | ||
| stack.delete(defKey); |
There was a problem hiding this comment.
I think stack will always be empty here?
There was a problem hiding this comment.
stack won’t always be empty here, it is shared across the current recursion path. After stack.delete(defKey) we’ve only removed the current key, but ancestor defKeys from higher frames can still be in the set.
Example:
A -> B -> A (cycle)
After B finishes: stack = {A}
| if (defKey && target) { | ||
| if (stack.has(defKey)) return node; | ||
| stack.add(defKey); | ||
| const resolved = derefer(target, activeDefs, stack); |
There was a problem hiding this comment.
Please correct me if wrong, the derefered object won't be having any $ref key right? atleast I didn't find from the schema you've attached in test file. Why are we trying to derefer the object with no $ref.
There was a problem hiding this comment.
target itself often has no $ref at the root, but it can contain nested $refs. I updated the tests to show this: contact -> $ref: ContactInfo, and inside ContactInfo we have address: { $ref: "#/$defs/PostalAddress" }.
Calling derefer(target, …) walks that subtree so contact.properties.address becomes an inline object.
If a def truly has no nested refs (like Job / StatusEnum), the call is a quick no-op (we just traverse its fields and return unchanged), but it keeps the behavior consistent.
| const defKey = getDefFromRef(node.$ref); | ||
| const target = getDefObject(activeDefs, defKey); | ||
| if (defKey && target) { | ||
| if (stack.has(defKey)) return node; |
There was a problem hiding this comment.
if at all stack is not empty and we find defKey in stack we're returning node, does node we're returning is already defered?
There was a problem hiding this comment.
This return is intentional, when stack.has(defKey) is true, it means we have hit a cycle. We keep the $ref to avoid infinite recursion rather than fully expanding it again.
There was a problem hiding this comment.
Example:
from pydantic import BaseModel
class A(BaseModel):
field1: Optional["A"] = None
schema = A.model_json_schema()const schema = {
"$defs": {
"A": {
"properties": {
"field1": {
"anyOf": [
{"$ref": "#/$defs/A"},
{"type": "null"}
],
"default": null
}
},
"title": "A",
"type": "object"
}
},
"$ref": "#/$defs/A"
};
let derefed = derefer(schema);
delete derefed.$defs;
console.log(JSON.stringify(derefed, null, 2));{
"properties": {
"field1": {
"anyOf": [
{
"properties": {
"field1": {
"anyOf": [ {"$ref": "#/$defs/A"}, {"type": "null"} ],
"default": null
}
},
"title": "A",
"type": "object"
},
{ "type": "null" }
],
"default": null
}
},
"title": "A",
"type": "object"
}There was a problem hiding this comment.
Got it, I think this will still cause failure at vertex as anyOf is not at all supported.
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
| const keys = Object.keys(node); | ||
| if (keys.length === 1) return resolved; | ||
| const { $ref: _, ...siblings } = node; | ||
| return derefer({ ...resolved, ...siblings }, activeDefs, stack); |
There was a problem hiding this comment.
I'm not sure if this intended or not, why do we need to de-ref the siblings when there's a loop for every iteration that does part? L231-235(diff), am I missing something?
There was a problem hiding this comment.
My bad, fixed it. Thanks for flagging.
|
Important PR Review SkippedPR review skipped as per the configuration setting. Run a manually review by commenting /matter review 💡Tips to use Matter AICommand List
|
4 participants
Description
This PR fixes multiple issues of using function calling and structured outputs with gemini models.
Primarily supporting / fixing enums, nested schemas, null property and completely removing $defs and $ref which were sent as is in most cases
Motivation
Without this, it is not possible to use Gemini's structured data / function calling except with simplest schemas - with absolutely no complexity like:
Type of Change
How Has This Been Tested?
Testing code:
Base code:
Using Function calling:
Current
mainbranch:Request sent from Portkey, wrapped up as request is too long (click to expand)
{ "model": "gemini-1.5-flash-002", "contents": [ { "role": "user", "parts": [ { "text": "Extract all the information about this person and structure it using the UserProfile schema.\n\nJohn Doe is a 32-year-old software engineer (id: u12345). He is currently active.\nHe can be reached at [email protected] or +12345678901. \nHis address is 42 Galaxy Way, Springfield. \nHe has worked at Acme Corp (title: Engineer, start: 2016-01, end: 2020-05, not currently working), \nand at FutureTech (title: Senior Engineer, start: 2020-06, currently working). \nHe has a cat named Luna (age 2, microchipped). \nJohn subscribes to newsletters, prefers English and French, and gets notifications weekly.\nHe has a Twitter account (@johnny) and a LinkedIn (john-doe).\nJohn holds a US passport, number 123456789, expiring 2030-12-31.\nIn case of emergency, contact Jane Doe (wife) at +10987654321.\n" } ] } ], "tools": [ { "functionDeclarations": [ { "name": "UserProfile", "description": "Correctly extracted `UserProfile` with all the required parameters with correct types", "parameters": { "$defs": { "ContactInfo": { "properties": { "email": { "description": "User's email address", "title": "Email", "type": "string" }, "phone": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Phone number (E.164 format)", "title": "Phone" }, "address": { "description": "Address", "title": "Address", "type": "string" } }, "required": [ "email", "address" ], "title": "ContactInfo", "type": "object" }, "EmergencyContact": { "properties": { "name": { "title": "Name", "type": "string" }, "relation": { "title": "Relation", "type": "string" }, "phone": { "title": "Phone", "type": "string" } }, "required": [ "name", "relation", "phone" ], "title": "EmergencyContact", "type": "object" }, "Job": { "properties": { "title": { "title": "Title", "type": "string" }, "company": { "title": "Company", "type": "string" }, "start_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Start Date" }, "end_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "End Date" }, "currently_working": { "description": "True if the person is currently employed in this job", "title": "Currently Working", "type": "boolean" } }, "required": [ "title", "company", "currently_working" ], "title": "Job", "type": "object" }, "NationalID": { "properties": { "country": { "title": "Country", "type": "string" }, "id_number": { "title": "Id Number", "type": "string" } }, "required": [ "country", "id_number" ], "title": "NationalID", "type": "object" }, "Passport": { "properties": { "country": { "title": "Country", "type": "string" }, "number": { "title": "Number", "type": "string" }, "expiry": { "title": "Expiry", "type": "string" } }, "required": [ "country", "number", "expiry" ], "title": "Passport", "type": "object" }, "Pet": { "properties": { "name": { "title": "Name", "type": "string" }, "species": { "enum": [ "dog", "cat", "bird", "other" ], "title": "Species", "type": "string" }, "age": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "title": "Age" }, "microchipped": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": null, "title": "Microchipped" } }, "required": [ "name", "species" ], "title": "Pet", "type": "object" }, "Preferences": { "properties": { "newsletter_subscribed": { "default": true, "title": "Newsletter Subscribed", "type": "boolean" }, "preferred_languages": { "items": { "enum": [ "en", "es", "fr", "de", "other" ], "type": "string" }, "title": "Preferred Languages", "type": "array" }, "notification_frequency": { "anyOf": [ { "enum": [ "daily", "weekly", "monthly" ], "type": "string" }, { "type": "null" } ], "default": null, "title": "Notification Frequency" } }, "required": [ "preferred_languages" ], "title": "Preferences", "type": "object" }, "SocialAccount": { "properties": { "platform": { "enum": [ "twitter", "linkedin", "github", "other" ], "title": "Platform", "type": "string" }, "username": { "title": "Username", "type": "string" }, "url": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Url" } }, "required": [ "platform", "username" ], "title": "SocialAccount", "type": "object" }, "StatusEnum": { "enum": [ "ACTIVE", "INACTIVE", "BANNED" ], "title": "StatusEnum", "type": "string" } }, "properties": { "id": { "description": "Unique user ID", "title": "Id", "type": "string" }, "name": { "title": "Name", "type": "string" }, "status": { "$ref": "#/$defs/StatusEnum" }, "age": { "title": "Age", "type": "integer" }, "contact": { "$ref": "#/$defs/ContactInfo" }, "jobs": { "items": { "$ref": "#/$defs/Job" }, "title": "Jobs", "type": "array" }, "social": { "anyOf": [ { "items": { "$ref": "#/$defs/SocialAccount" }, "type": "array" }, { "type": "null" } ], "default": null, "title": "Social" }, "preferences": { "$ref": "#/$defs/Preferences" }, "pets": { "anyOf": [ { "items": { "$ref": "#/$defs/Pet" }, "type": "array" }, { "type": "null" } ], "default": null, "title": "Pets" }, "identity": { "anyOf": [ { "$ref": "#/$defs/Passport" }, { "$ref": "#/$defs/NationalID" } ], "title": "Identity" }, "emergency_contacts": { "items": { "$ref": "#/$defs/EmergencyContact" }, "title": "Emergency Contacts", "type": "array" }, "notes": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Notes" } }, "required": [ "age", "contact", "emergency_contacts", "id", "identity", "jobs", "name", "preferences", "status" ], "type": "object" } } ] } ], "tool_config": { "function_calling_config": { "mode": "ANY", "allowed_function_names": [ "UserProfile" ] } } }{ "error": { "message": "google error: Invalid JSON payload received. Unknown name \"$defs\" at 'tools[0].function_declarations[0].parameters': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[2].value': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[4].value': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[5].value.items': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[6].value.any_of[0].items': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[7].value': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[8].value.any_of[0].items': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[9].value.any_of[0]': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[9].value.any_of[1]': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'tools[0].function_declarations[0].parameters.properties[10].value.items': Cannot find field.", "type": "INVALID_ARGUMENT", "param": null, "code": 400 }, "provider": "google" }fix/response-schemas-for-gemini-modelsbranch:Request sent from Portkey (click to expand)
{ "model": "gemini-1.5-flash-002", "contents": [ { "role": "user", "parts": [ { "text": "Extract all the information about this person and structure it using the UserProfile schema.\n\nJohn Doe is a 32-year-old software engineer (id: u12345). He is currently active.\nHe can be reached at [email protected] or +12345678901. \nHis address is 42 Galaxy Way, Springfield. \nHe has worked at Acme Corp (title: Engineer, start: 2016-01, end: 2020-05, not currently working), \nand at FutureTech (title: Senior Engineer, start: 2020-06, currently working). \nHe has a cat named Luna (age 2, microchipped). \nJohn subscribes to newsletters, prefers English and French, and gets notifications weekly.\nHe has a Twitter account (@johnny) and a LinkedIn (john-doe).\nJohn holds a US passport, number 123456789, expiring 2030-12-31.\nIn case of emergency, contact Jane Doe (wife) at +10987654321.\n" } ] } ], "tools": [ { "functionDeclarations": [ { "name": "UserProfile", "description": "Correctly extracted `UserProfile` with all the required parameters with correct types", "parameters": { "properties": { "id": { "description": "Unique user ID", "title": "Id", "type": "string" }, "name": { "title": "Name", "type": "string" }, "status": { "enum": [ "ACTIVE", "INACTIVE", "BANNED" ], "format": "enum", "title": "StatusEnum", "type": "string" }, "age": { "title": "Age", "type": "integer" }, "contact": { "properties": { "email": { "description": "User's email address", "title": "Email", "type": "string" }, "phone": { "type": "string", "nullable": true, "default": null, "description": "Phone number (E.164 format)", "title": "Phone" }, "address": { "description": "Address", "title": "Address", "type": "string" } }, "required": [ "email", "address" ], "title": "ContactInfo", "type": "object" }, "jobs": { "items": { "properties": { "title": { "title": "Title", "type": "string" }, "company": { "title": "Company", "type": "string" }, "start_date": { "type": "string", "nullable": true, "default": null, "title": "Start Date" }, "end_date": { "type": "string", "nullable": true, "default": null, "title": "End Date" }, "currently_working": { "description": "True if the person is currently employed in this job", "title": "Currently Working", "type": "boolean" } }, "required": [ "title", "company", "currently_working" ], "title": "Job", "type": "object" }, "title": "Jobs", "type": "array" }, "social": { "items": { "properties": { "platform": { "enum": [ "twitter", "linkedin", "github", "other" ], "format": "enum", "title": "Platform", "type": "string" }, "username": { "title": "Username", "type": "string" }, "url": { "type": "string", "nullable": true, "default": null, "title": "Url" } }, "required": [ "platform", "username" ], "title": "SocialAccount", "type": "object" }, "type": "array", "nullable": true, "default": null, "title": "Social" }, "preferences": { "properties": { "newsletter_subscribed": { "default": true, "title": "Newsletter Subscribed", "type": "boolean" }, "preferred_languages": { "items": { "enum": [ "en", "es", "fr", "de", "other" ], "format": "enum", "type": "string" }, "title": "Preferred Languages", "type": "array" }, "notification_frequency": { "enum": [ "daily", "weekly", "monthly" ], "format": "enum", "type": "string", "nullable": true, "default": null, "title": "Notification Frequency" } }, "required": [ "preferred_languages" ], "title": "Preferences", "type": "object" }, "pets": { "items": { "properties": { "name": { "title": "Name", "type": "string" }, "species": { "enum": [ "dog", "cat", "bird", "other" ], "format": "enum", "title": "Species", "type": "string" }, "age": { "type": "integer", "nullable": true, "default": null, "title": "Age" }, "microchipped": { "type": "boolean", "nullable": true, "default": null, "title": "Microchipped" } }, "required": [ "name", "species" ], "title": "Pet", "type": "object" }, "type": "array", "nullable": true, "default": null, "title": "Pets" }, "identity": { "anyOf": [ { "properties": { "country": { "title": "Country", "type": "string" }, "number": { "title": "Number", "type": "string" }, "expiry": { "title": "Expiry", "type": "string" } }, "required": [ "country", "number", "expiry" ], "title": "Passport", "type": "object" }, { "properties": { "country": { "title": "Country", "type": "string" }, "id_number": { "title": "Id Number", "type": "string" } }, "required": [ "country", "id_number" ], "title": "NationalID", "type": "object" } ], "title": "Identity" }, "emergency_contacts": { "items": { "properties": { "name": { "title": "Name", "type": "string" }, "relation": { "title": "Relation", "type": "string" }, "phone": { "title": "Phone", "type": "string" } }, "required": [ "name", "relation", "phone" ], "title": "EmergencyContact", "type": "object" }, "title": "Emergency Contacts", "type": "array" }, "notes": { "type": "string", "nullable": true, "default": null, "title": "Notes" } }, "required": [ "age", "contact", "emergency_contacts", "id", "identity", "jobs", "name", "preferences", "status" ], "type": "object" } } ] } ], "tool_config": { "function_calling_config": { "mode": "ANY", "allowed_function_names": [ "UserProfile" ] } } }Response:
{ "id": "portkey-437855d5-84fe-4fc2-befc-bd82e1416e9c", "object": "chat.completion", "created": 1753634510, "model": "gemini-1.5-flash-002", "provider": "google", "choices": [ { "message": { "role": "assistant", "tool_calls": [ { "id": "portkey-e037b126-7668-4ca0-ace1-f79280201f32", "type": "function", "function": { "name": "UserProfile", "arguments": "{\"pets\":[{\"microchipped\":true,\"age\":2,\"species\":\"cat\",\"name\":\"Luna\"}],\"age\":32,\"preferences\":{\"preferred_languages\":[\"en\",\"fr\"],\"newsletter_subscribed\":true,\"notification_frequency\":\"weekly\"},\"social\":[{\"username\":\"johnny\",\"platform\":\"twitter\"},{\"platform\":\"linkedin\",\"username\":\"john-doe\"}],\"status\":\"ACTIVE\",\"name\":\"John Doe\",\"emergency_contacts\":[{\"phone\":\"+10987654321\",\"name\":\"Jane Doe\",\"relation\":\"wife\"}],\"contact\":{\"phone\":\"+12345678901\",\"address\":\"42 Galaxy Way, Springfield\",\"email\":\"[email protected]\"},\"id\":\"u12345\",\"jobs\":[{\"start_date\":\"2016-01\",\"currently_working\":false,\"end_date\":\"2020-05\",\"title\":\"Engineer\",\"company\":\"Acme Corp\"},{\"title\":\"Senior Engineer\",\"company\":\"FutureTech\",\"currently_working\":true,\"start_date\":\"2020-06\"}],\"identity\":{\"country\":\"US\",\"number\":\"123456789\",\"expiry\":\"2030-12-31\"}}" } } ] }, "index": 0, "finish_reason": "STOP" } ], "usage": { "prompt_tokens": 487, "completion_tokens": 176, "total_tokens": 663, "completion_tokens_details": { "reasoning_tokens": 0 } } }Using Gemini Structured outputs (JSON Schema) - Ignore system prompt being added, that is from instructor library being added in JSON_SCHEMA mode
Current
mainbranch:Request sent from Portkey (click to expand)
{ "model": "gemini-1.5-flash-002", "contents": [ { "role": "user", "parts": [ { "text": "Extract all the information about this person and structure it using the UserProfile schema.\n\nJohn Doe is a 32-year-old software engineer (id: u12345). He is currently active.\nHe can be reached at [email protected] or +12345678901. \nHis address is 42 Galaxy Way, Springfield. \nHe has worked at Acme Corp (title: Engineer, start: 2016-01, end: 2020-05, not currently working), \nand at FutureTech (title: Senior Engineer, start: 2020-06, currently working). \nHe has a cat named Luna (age 2, microchipped). \nJohn subscribes to newsletters, prefers English and French, and gets notifications weekly.\nHe has a Twitter account (@johnny) and a LinkedIn (john-doe).\nJohn holds a US passport, number 123456789, expiring 2030-12-31.\nIn case of emergency, contact Jane Doe (wife) at +10987654321.\n" } ] } ], "systemInstruction": { "parts": [ { "text": "\n As a genius expert, your task is to understand the content and provide\n the parsed objects in json that match the following json_schema:\n\n\n {\n \"$defs\": {\n \"ContactInfo\": {\n \"properties\": {\n \"email\": {\n \"description\": \"User's email address\",\n \"title\": \"Email\",\n \"type\": \"string\"\n },\n \"phone\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"description\": \"Phone number (E.164 format)\",\n \"title\": \"Phone\"\n },\n \"address\": {\n \"description\": \"Address\",\n \"title\": \"Address\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"email\",\n \"address\"\n ],\n \"title\": \"ContactInfo\",\n \"type\": \"object\"\n },\n \"EmergencyContact\": {\n \"properties\": {\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"relation\": {\n \"title\": \"Relation\",\n \"type\": \"string\"\n },\n \"phone\": {\n \"title\": \"Phone\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"name\",\n \"relation\",\n \"phone\"\n ],\n \"title\": \"EmergencyContact\",\n \"type\": \"object\"\n },\n \"Job\": {\n \"properties\": {\n \"title\": {\n \"title\": \"Title\",\n \"type\": \"string\"\n },\n \"company\": {\n \"title\": \"Company\",\n \"type\": \"string\"\n },\n \"start_date\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Start Date\"\n },\n \"end_date\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"End Date\"\n },\n \"currently_working\": {\n \"description\": \"True if the person is currently employed in this job\",\n \"title\": \"Currently Working\",\n \"type\": \"boolean\"\n }\n },\n \"required\": [\n \"title\",\n \"company\",\n \"currently_working\"\n ],\n \"title\": \"Job\",\n \"type\": \"object\"\n },\n \"NationalID\": {\n \"properties\": {\n \"country\": {\n \"title\": \"Country\",\n \"type\": \"string\"\n },\n \"id_number\": {\n \"title\": \"Id Number\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"country\",\n \"id_number\"\n ],\n \"title\": \"NationalID\",\n \"type\": \"object\"\n },\n \"Passport\": {\n \"properties\": {\n \"country\": {\n \"title\": \"Country\",\n \"type\": \"string\"\n },\n \"number\": {\n \"title\": \"Number\",\n \"type\": \"string\"\n },\n \"expiry\": {\n \"title\": \"Expiry\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"country\",\n \"number\",\n \"expiry\"\n ],\n \"title\": \"Passport\",\n \"type\": \"object\"\n },\n \"Pet\": {\n \"properties\": {\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"species\": {\n \"enum\": [\n \"dog\",\n \"cat\",\n \"bird\",\n \"other\"\n ],\n \"title\": \"Species\",\n \"type\": \"string\"\n },\n \"age\": {\n \"anyOf\": [\n {\n \"type\": \"integer\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Age\"\n },\n \"microchipped\": {\n \"anyOf\": [\n {\n \"type\": \"boolean\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Microchipped\"\n }\n },\n \"required\": [\n \"name\",\n \"species\"\n ],\n \"title\": \"Pet\",\n \"type\": \"object\"\n },\n \"Preferences\": {\n \"properties\": {\n \"newsletter_subscribed\": {\n \"default\": true,\n \"title\": \"Newsletter Subscribed\",\n \"type\": \"boolean\"\n },\n \"preferred_languages\": {\n \"items\": {\n \"enum\": [\n \"en\",\n \"es\",\n \"fr\",\n \"de\",\n \"other\"\n ],\n \"type\": \"string\"\n },\n \"title\": \"Preferred Languages\",\n \"type\": \"array\"\n },\n \"notification_frequency\": {\n \"anyOf\": [\n {\n \"enum\": [\n \"daily\",\n \"weekly\",\n \"monthly\"\n ],\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Notification Frequency\"\n }\n },\n \"required\": [\n \"preferred_languages\"\n ],\n \"title\": \"Preferences\",\n \"type\": \"object\"\n },\n \"SocialAccount\": {\n \"properties\": {\n \"platform\": {\n \"enum\": [\n \"twitter\",\n \"linkedin\",\n \"github\",\n \"other\"\n ],\n \"title\": \"Platform\",\n \"type\": \"string\"\n },\n \"username\": {\n \"title\": \"Username\",\n \"type\": \"string\"\n },\n \"url\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Url\"\n }\n },\n \"required\": [\n \"platform\",\n \"username\"\n ],\n \"title\": \"SocialAccount\",\n \"type\": \"object\"\n },\n \"StatusEnum\": {\n \"enum\": [\n \"ACTIVE\",\n \"INACTIVE\",\n \"BANNED\"\n ],\n \"title\": \"StatusEnum\",\n \"type\": \"string\"\n }\n },\n \"properties\": {\n \"id\": {\n \"description\": \"Unique user ID\",\n \"title\": \"Id\",\n \"type\": \"string\"\n },\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"status\": {\n \"$ref\": \"#/$defs/StatusEnum\"\n },\n \"age\": {\n \"title\": \"Age\",\n \"type\": \"integer\"\n },\n \"contact\": {\n \"$ref\": \"#/$defs/ContactInfo\"\n },\n \"jobs\": {\n \"items\": {\n \"$ref\": \"#/$defs/Job\"\n },\n \"title\": \"Jobs\",\n \"type\": \"array\"\n },\n \"social\": {\n \"anyOf\": [\n {\n \"items\": {\n \"$ref\": \"#/$defs/SocialAccount\"\n },\n \"type\": \"array\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Social\"\n },\n \"preferences\": {\n \"$ref\": \"#/$defs/Preferences\"\n },\n \"pets\": {\n \"anyOf\": [\n {\n \"items\": {\n \"$ref\": \"#/$defs/Pet\"\n },\n \"type\": \"array\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Pets\"\n },\n \"identity\": {\n \"anyOf\": [\n {\n \"$ref\": \"#/$defs/Passport\"\n },\n {\n \"$ref\": \"#/$defs/NationalID\"\n }\n ],\n \"title\": \"Identity\"\n },\n \"emergency_contacts\": {\n \"items\": {\n \"$ref\": \"#/$defs/EmergencyContact\"\n },\n \"title\": \"Emergency Contacts\",\n \"type\": \"array\"\n },\n \"notes\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Notes\"\n }\n },\n \"required\": [\n \"id\",\n \"name\",\n \"status\",\n \"age\",\n \"contact\",\n \"jobs\",\n \"preferences\",\n \"identity\",\n \"emergency_contacts\"\n ],\n \"title\": \"UserProfile\",\n \"type\": \"object\"\n}\n\n Make sure to return an instance of the JSON, not the schema itself\n" } ], "role": "system" }, "generationConfig": { "responseMimeType": "application/json", "responseSchema": { "properties": { "id": { "description": "Unique user ID", "title": "Id", "type": "string" }, "name": { "title": "Name", "type": "string" }, "status": { "enum": [ "ACTIVE", "INACTIVE", "BANNED" ], "title": "StatusEnum", "type": "string" }, "age": { "title": "Age", "type": "integer" }, "contact": { "properties": { "email": { "description": "User's email address", "title": "Email", "type": "string" }, "phone": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": {}, "description": "Phone number (E.164 format)", "title": "Phone" }, "address": { "description": "Address", "title": "Address", "type": "string" } }, "required": [ "email", "address" ], "title": "ContactInfo", "type": "object" }, "jobs": { "items": { "properties": { "title": { "title": "Title", "type": "string" }, "company": { "title": "Company", "type": "string" }, "start_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": {}, "title": "Start Date" }, "end_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": {}, "title": "End Date" }, "currently_working": { "description": "True if the person is currently employed in this job", "title": "Currently Working", "type": "boolean" } }, "required": [ "title", "company", "currently_working" ], "title": "Job", "type": "object" }, "title": "Jobs", "type": "array" }, "social": { "anyOf": [ { "items": { "$ref": "#/$defs/SocialAccount" }, "type": "array" }, { "type": "null" } ], "default": {}, "title": "Social" }, "preferences": { "properties": { "newsletter_subscribed": { "default": {}, "title": "Newsletter Subscribed", "type": "boolean" }, "preferred_languages": { "items": { "enum": [ "en", "es", "fr", "de", "other" ], "type": "string" }, "title": "Preferred Languages", "type": "array" }, "notification_frequency": { "anyOf": [ { "enum": [ "daily", "weekly", "monthly" ], "type": "string" }, { "type": "null" } ], "default": {}, "title": "Notification Frequency" } }, "required": [ "preferred_languages" ], "title": "Preferences", "type": "object" }, "pets": { "anyOf": [ { "items": { "$ref": "#/$defs/Pet" }, "type": "array" }, { "type": "null" } ], "default": {}, "title": "Pets" }, "identity": { "anyOf": [ { "$ref": "#/$defs/Passport" }, { "$ref": "#/$defs/NationalID" } ], "title": "Identity" }, "emergency_contacts": { "items": { "properties": { "name": { "title": "Name", "type": "string" }, "relation": { "title": "Relation", "type": "string" }, "phone": { "title": "Phone", "type": "string" } }, "required": [ "name", "relation", "phone" ], "title": "EmergencyContact", "type": "object" }, "title": "Emergency Contacts", "type": "array" }, "notes": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": {}, "title": "Notes" } }, "required": [ "id", "name", "status", "age", "contact", "jobs", "preferences", "identity", "emergency_contacts" ], "title": "UserProfile", "type": "object" } } }Response:
{ "error": { "message": "google error: Invalid JSON payload received. Unknown name \"$ref\" at 'generation_config.response_schema.properties[6].value.any_of[0].items': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'generation_config.response_schema.properties[8].value.any_of[0].items': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'generation_config.response_schema.properties[9].value.any_of[0]': Cannot find field.\nInvalid JSON payload received. Unknown name \"$ref\" at 'generation_config.response_schema.properties[9].value.any_of[1]': Cannot find field.", "type": "INVALID_ARGUMENT", "param": null, "code": 400 }, "provider": "google" }fix/response-schemas-for-gemini-modelsbranch:Request sent from Portkey (click to expand)
{ "model": "gemini-1.5-flash-002", "contents": [ { "role": "user", "parts": [ { "text": "Extract all the information about this person and structure it using the UserProfile schema.\n\nJohn Doe is a 32-year-old software engineer (id: u12345). He is currently active.\nHe can be reached at [email protected] or +12345678901. \nHis address is 42 Galaxy Way, Springfield. \nHe has worked at Acme Corp (title: Engineer, start: 2016-01, end: 2020-05, not currently working), \nand at FutureTech (title: Senior Engineer, start: 2020-06, currently working). \nHe has a cat named Luna (age 2, microchipped). \nJohn subscribes to newsletters, prefers English and French, and gets notifications weekly.\nHe has a Twitter account (@johnny) and a LinkedIn (john-doe).\nJohn holds a US passport, number 123456789, expiring 2030-12-31.\nIn case of emergency, contact Jane Doe (wife) at +10987654321.\n" } ] } ], "systemInstruction": { "parts": [ { "text": "\n As a genius expert, your task is to understand the content and provide\n the parsed objects in json that match the following json_schema:\n\n\n {\n \"$defs\": {\n \"ContactInfo\": {\n \"properties\": {\n \"email\": {\n \"description\": \"User's email address\",\n \"title\": \"Email\",\n \"type\": \"string\"\n },\n \"phone\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"description\": \"Phone number (E.164 format)\",\n \"title\": \"Phone\"\n },\n \"address\": {\n \"description\": \"Address\",\n \"title\": \"Address\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"email\",\n \"address\"\n ],\n \"title\": \"ContactInfo\",\n \"type\": \"object\"\n },\n \"EmergencyContact\": {\n \"properties\": {\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"relation\": {\n \"title\": \"Relation\",\n \"type\": \"string\"\n },\n \"phone\": {\n \"title\": \"Phone\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"name\",\n \"relation\",\n \"phone\"\n ],\n \"title\": \"EmergencyContact\",\n \"type\": \"object\"\n },\n \"Job\": {\n \"properties\": {\n \"title\": {\n \"title\": \"Title\",\n \"type\": \"string\"\n },\n \"company\": {\n \"title\": \"Company\",\n \"type\": \"string\"\n },\n \"start_date\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Start Date\"\n },\n \"end_date\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"End Date\"\n },\n \"currently_working\": {\n \"description\": \"True if the person is currently employed in this job\",\n \"title\": \"Currently Working\",\n \"type\": \"boolean\"\n }\n },\n \"required\": [\n \"title\",\n \"company\",\n \"currently_working\"\n ],\n \"title\": \"Job\",\n \"type\": \"object\"\n },\n \"NationalID\": {\n \"properties\": {\n \"country\": {\n \"title\": \"Country\",\n \"type\": \"string\"\n },\n \"id_number\": {\n \"title\": \"Id Number\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"country\",\n \"id_number\"\n ],\n \"title\": \"NationalID\",\n \"type\": \"object\"\n },\n \"Passport\": {\n \"properties\": {\n \"country\": {\n \"title\": \"Country\",\n \"type\": \"string\"\n },\n \"number\": {\n \"title\": \"Number\",\n \"type\": \"string\"\n },\n \"expiry\": {\n \"title\": \"Expiry\",\n \"type\": \"string\"\n }\n },\n \"required\": [\n \"country\",\n \"number\",\n \"expiry\"\n ],\n \"title\": \"Passport\",\n \"type\": \"object\"\n },\n \"Pet\": {\n \"properties\": {\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"species\": {\n \"enum\": [\n \"dog\",\n \"cat\",\n \"bird\",\n \"other\"\n ],\n \"title\": \"Species\",\n \"type\": \"string\"\n },\n \"age\": {\n \"anyOf\": [\n {\n \"type\": \"integer\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Age\"\n },\n \"microchipped\": {\n \"anyOf\": [\n {\n \"type\": \"boolean\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Microchipped\"\n }\n },\n \"required\": [\n \"name\",\n \"species\"\n ],\n \"title\": \"Pet\",\n \"type\": \"object\"\n },\n \"Preferences\": {\n \"properties\": {\n \"newsletter_subscribed\": {\n \"default\": true,\n \"title\": \"Newsletter Subscribed\",\n \"type\": \"boolean\"\n },\n \"preferred_languages\": {\n \"items\": {\n \"enum\": [\n \"en\",\n \"es\",\n \"fr\",\n \"de\",\n \"other\"\n ],\n \"type\": \"string\"\n },\n \"title\": \"Preferred Languages\",\n \"type\": \"array\"\n },\n \"notification_frequency\": {\n \"anyOf\": [\n {\n \"enum\": [\n \"daily\",\n \"weekly\",\n \"monthly\"\n ],\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Notification Frequency\"\n }\n },\n \"required\": [\n \"preferred_languages\"\n ],\n \"title\": \"Preferences\",\n \"type\": \"object\"\n },\n \"SocialAccount\": {\n \"properties\": {\n \"platform\": {\n \"enum\": [\n \"twitter\",\n \"linkedin\",\n \"github\",\n \"other\"\n ],\n \"title\": \"Platform\",\n \"type\": \"string\"\n },\n \"username\": {\n \"title\": \"Username\",\n \"type\": \"string\"\n },\n \"url\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Url\"\n }\n },\n \"required\": [\n \"platform\",\n \"username\"\n ],\n \"title\": \"SocialAccount\",\n \"type\": \"object\"\n },\n \"StatusEnum\": {\n \"enum\": [\n \"ACTIVE\",\n \"INACTIVE\",\n \"BANNED\"\n ],\n \"title\": \"StatusEnum\",\n \"type\": \"string\"\n }\n },\n \"properties\": {\n \"id\": {\n \"description\": \"Unique user ID\",\n \"title\": \"Id\",\n \"type\": \"string\"\n },\n \"name\": {\n \"title\": \"Name\",\n \"type\": \"string\"\n },\n \"status\": {\n \"$ref\": \"#/$defs/StatusEnum\"\n },\n \"age\": {\n \"title\": \"Age\",\n \"type\": \"integer\"\n },\n \"contact\": {\n \"$ref\": \"#/$defs/ContactInfo\"\n },\n \"jobs\": {\n \"items\": {\n \"$ref\": \"#/$defs/Job\"\n },\n \"title\": \"Jobs\",\n \"type\": \"array\"\n },\n \"social\": {\n \"anyOf\": [\n {\n \"items\": {\n \"$ref\": \"#/$defs/SocialAccount\"\n },\n \"type\": \"array\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Social\"\n },\n \"preferences\": {\n \"$ref\": \"#/$defs/Preferences\"\n },\n \"pets\": {\n \"anyOf\": [\n {\n \"items\": {\n \"$ref\": \"#/$defs/Pet\"\n },\n \"type\": \"array\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Pets\"\n },\n \"identity\": {\n \"anyOf\": [\n {\n \"$ref\": \"#/$defs/Passport\"\n },\n {\n \"$ref\": \"#/$defs/NationalID\"\n }\n ],\n \"title\": \"Identity\"\n },\n \"emergency_contacts\": {\n \"items\": {\n \"$ref\": \"#/$defs/EmergencyContact\"\n },\n \"title\": \"Emergency Contacts\",\n \"type\": \"array\"\n },\n \"notes\": {\n \"anyOf\": [\n {\n \"type\": \"string\"\n },\n {\n \"type\": \"null\"\n }\n ],\n \"default\": null,\n \"title\": \"Notes\"\n }\n },\n \"required\": [\n \"id\",\n \"name\",\n \"status\",\n \"age\",\n \"contact\",\n \"jobs\",\n \"preferences\",\n \"identity\",\n \"emergency_contacts\"\n ],\n \"title\": \"UserProfile\",\n \"type\": \"object\"\n}\n\n Make sure to return an instance of the JSON, not the schema itself\n" } ], "role": "system" }, "generationConfig": { "responseMimeType": "application/json", "responseSchema": { "properties": { "id": { "description": "Unique user ID", "title": "Id", "type": "string" }, "name": { "title": "Name", "type": "string" }, "status": { "enum": [ "ACTIVE", "INACTIVE", "BANNED" ], "format": "enum", "title": "StatusEnum", "type": "string" }, "age": { "title": "Age", "type": "integer" }, "contact": { "properties": { "email": { "description": "User's email address", "title": "Email", "type": "string" }, "phone": { "type": "string", "nullable": true, "default": null, "description": "Phone number (E.164 format)", "title": "Phone" }, "address": { "description": "Address", "title": "Address", "type": "string" } }, "required": [ "email", "address" ], "title": "ContactInfo", "type": "object" }, "jobs": { "items": { "properties": { "title": { "title": "Title", "type": "string" }, "company": { "title": "Company", "type": "string" }, "start_date": { "type": "string", "nullable": true, "default": null, "title": "Start Date" }, "end_date": { "type": "string", "nullable": true, "default": null, "title": "End Date" }, "currently_working": { "description": "True if the person is currently employed in this job", "title": "Currently Working", "type": "boolean" } }, "required": [ "title", "company", "currently_working" ], "title": "Job", "type": "object" }, "title": "Jobs", "type": "array" }, "social": { "items": { "properties": { "platform": { "enum": [ "twitter", "linkedin", "github", "other" ], "format": "enum", "title": "Platform", "type": "string" }, "username": { "title": "Username", "type": "string" }, "url": { "type": "string", "nullable": true, "default": null, "title": "Url" } }, "required": [ "platform", "username" ], "title": "SocialAccount", "type": "object" }, "type": "array", "nullable": true, "default": null, "title": "Social" }, "preferences": { "properties": { "newsletter_subscribed": { "default": true, "title": "Newsletter Subscribed", "type": "boolean" }, "preferred_languages": { "items": { "enum": [ "en", "es", "fr", "de", "other" ], "format": "enum", "type": "string" }, "title": "Preferred Languages", "type": "array" }, "notification_frequency": { "enum": [ "daily", "weekly", "monthly" ], "format": "enum", "type": "string", "nullable": true, "default": null, "title": "Notification Frequency" } }, "required": [ "preferred_languages" ], "title": "Preferences", "type": "object" }, "pets": { "items": { "properties": { "name": { "title": "Name", "type": "string" }, "species": { "enum": [ "dog", "cat", "bird", "other" ], "format": "enum", "title": "Species", "type": "string" }, "age": { "type": "integer", "nullable": true, "default": null, "title": "Age" }, "microchipped": { "type": "boolean", "nullable": true, "default": null, "title": "Microchipped" } }, "required": [ "name", "species" ], "title": "Pet", "type": "object" }, "type": "array", "nullable": true, "default": null, "title": "Pets" }, "identity": { "anyOf": [ { "properties": { "country": { "title": "Country", "type": "string" }, "number": { "title": "Number", "type": "string" }, "expiry": { "title": "Expiry", "type": "string" } }, "required": [ "country", "number", "expiry" ], "title": "Passport", "type": "object" }, { "properties": { "country": { "title": "Country", "type": "string" }, "id_number": { "title": "Id Number", "type": "string" } }, "required": [ "country", "id_number" ], "title": "NationalID", "type": "object" } ], "title": "Identity" }, "emergency_contacts": { "items": { "properties": { "name": { "title": "Name", "type": "string" }, "relation": { "title": "Relation", "type": "string" }, "phone": { "title": "Phone", "type": "string" } }, "required": [ "name", "relation", "phone" ], "title": "EmergencyContact", "type": "object" }, "title": "Emergency Contacts", "type": "array" }, "notes": { "type": "string", "nullable": true, "default": null, "title": "Notes" } }, "required": [ "id", "name", "status", "age", "contact", "jobs", "preferences", "identity", "emergency_contacts" ], "title": "UserProfile", "type": "object" } } }Response:
{ "id": "portkey-4d181706-d546-4f15-a80e-e8375e261282", "object": "chat.completion", "created": 1753634770, "model": "gemini-1.5-flash-002", "provider": "google", "choices": [ { "message": { "role": "assistant", "content": "{\"age\": 32, \"contact\": {\"address\": \"42 Galaxy Way, Springfield\", \"email\": \"[email protected]\", \"phone\": \"+12345678901\"}, \"emergency_contacts\": [{\"name\": \"Jane Doe\", \"phone\": \"+10987654321\", \"relation\": \"wife\"}], \"id\": \"u12345\", \"identity\": {\"country\": \"US\", \"expiry\": \"2030-12-31\", \"number\": \"123456789\"}, \"jobs\": [{\"company\": \"Acme Corp\", \"currently_working\": false, \"title\": \"Engineer\", \"end_date\": \"2020-05\", \"start_date\": \"2016-01\"}, {\"company\": \"FutureTech\", \"currently_working\": true, \"title\": \"Senior Engineer\", \"start_date\": \"2020-06\"}], \"name\": \"John Doe\", \"preferences\": {\"preferred_languages\": [\"en\", \"fr\"], \"newsletter_subscribed\": true, \"notification_frequency\": \"weekly\"}, \"status\": \"ACTIVE\", \"pets\": [{\"name\": \"Luna\", \"species\": \"cat\", \"age\": 2, \"microchipped\": true}], \"social\": [{\"platform\": \"twitter\", \"username\": \"@johnny\"}, {\"platform\": \"linkedin\", \"username\": \"john-doe\"}]}" }, "index": 0, "finish_reason": "STOP" } ], "usage": { "prompt_tokens": 2831, "completion_tokens": 326, "total_tokens": 3157, "completion_tokens_details": { "reasoning_tokens": 0 } } }Checklist
Related Issues
#837 (comment)
https://discord.com/channels/1143393887742861333/1317117120676364390/1317125306124992523