Skip to content

AI UI Designer & Tool Generation Feature #874

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 49 commits into from
Closed

AI UI Designer & Tool Generation Feature #874

wants to merge 49 commits into from

Conversation

synapsecode
Copy link
Contributor

PR Description

This PR includes the work done on AI UI Designer and Tool Generation Feature.
Tool Generation is fully complete.
AI UI Designer works but needs multiple system prompt optimizations such as:

  • narrowing down to a limited list of supported widgets for better accuracy
  • SDUI Error Handling and fallback (need to manually modify Stac package by forking)
  • improving the system prompt to generate a better UI on the first try using layout knowledge
  • handling cases where SDUI output is too big and model output is getting clipped

Checklist

  • I have gone through the contributing guide
  • I have updated my branch and synced it with project main branch before making this PR
  • I am using the latest Flutter stable branch (run flutter upgrade and verify)
  • I have run the tests (flutter test) and all tests are passing

Added/updated tests?

We encourage you to add relevant test cases.

  • Yes
  • No, and this is why: TBD

OS on which you have developed and tested the feature?

  • Windows
  • macOS
  • Linux

synapsecode and others added 30 commits August 6, 2025 08:35
@synapsecode
genai: Created Package & implemented LLM Config, Manager & Request
effe414
@synapsecode
Implemented SaveObject, LLMModel class & OllamaProvider
a6d1c41
@synapsecode
Providers: Implemented anthropic, gemini, openai & azureopenai
69e3882
@synapsecode
AIRequestModel & AIResponseModel Created
26d27eb
@synapsecode
REFACTOR: Improved Package Structure
7a9afc6
@synapsecode
models.json added for RemoteModel Fetch feature
c05a42b
@synapsecode
genai: Example Project added + README
dc5af42
@synapsecode
genai modified to use the latest streamHttpRequest
058d95a
@synapsecode
Added LLMSelectorWidget & Integrated with APIDash Settings
90b4b99
@synapsecode
AIProviderSelector Impl & AI Models added to RequestModel
d923996
@synapsecode
AIRequestFeature: Added Prompt, Authorization & Configuration Tabs
22b8168
@synapsecode
initializeAIRequest on AIRequest Creation & ControllerUpdate issues f…
ce56897 
…ixed
@synapsecode
AIRequests: URL is not modifiable for requests
3882052
@synapsecode
initializeAIRequest: ModelController instantiation changed to use .in…
8a12ca7 
…stance
@synapsecode
AI Configuration Widgets simplified & separated
b890769
@synapsecode
AIRequests: Removed AIResponseModel & sendRequest implemented
97d4a7a
@synapsecode
AI Request History & Duplication Feature
452020f
@synapsecode
Implemented AnswerTab for AI Output
2c756df
@synapsecode
AIRequests: Duplication Bug Fixed
49a93ca
@synapsecode
initializeAIRequest moved out of api_type_dropdown & cleaned
ab2a9d5
@synapsecode
Improved ShallowCopy of AIRequestModel and substructures
4209569
@synapsecode
LLMSelector: Implemented ability to add and remove LLMs dynamically
d0dc563
@synapsecode
Added SSE(Streaming) to Native AI Requests
f60836e
@synapsecode
Streaming Option added to AI Request Configurations
db599b3
@synapsecode
StreamingDone Error Fixed & added Streaming Config to all
8bc2cbe
@synapsecode
SSEDislay: SelectedModel provided via parameter & StreamingFixes
e06bddc
@animator
Move example to genai_example
d8d5f70 
Renamed the example directory to genai_example, updated package name in pubspec.yaml, and added pubspec_overrides.yaml for local dependency overrides. Updated pubspec.lock to reflect new and overridden dependencies.
@synapsecode
genai: README & License Updated
eb852df
@synapsecode
genai: Minor Refactoring and Corrections
30075a6
@synapsecode
genai: Fixed ModelSelector InkWell Bleed & made it visible in History
db326b4
@synapsecode
DefaultLLMSelectorDialog: ResponsiveUI added
36f58ba
@synapsecode
Basic Agentic Infrastructure created
e6c6e03
@synapsecode
AI_UI_Designer_Prototype: Basic UI Implementation
ddecf89
@synapsecode
ADDED: AgenticServices & AI_UI_DESIGNER Agents
41fd79d
@synapsecode
INTEGRATED: SA_GEN, IR_GEN & STAC_GEN
7628e18
@synapsecode
Agentic Calls corrected to comply with new Architecture
0e7eba7
@synapsecode
Implemented Flutter Code Export Functionality
b516edb
@synapsecode
Implemented STAC_MODIFIER to enabled UI Modifications
5acc58b
@synapsecode
Downgraded to Stac 0.10 and Initialized Stac
3ea28f8
@synapsecode
Consolidator & Tool Templates Done
48c0ed7
@synapsecode
Some MinorRefactors & AIToolGen Dialog Implementation
97b17da
@synapsecode
AIToolGenerator v0 Completed & AIUIDesigner added SDUI-Scrollable:
8751c52
@synapsecode
AI UI-Designer & ToolGenerator: Added ErrorHandling
77172a8
@synapsecode
ResponseBody: isPartOfHistory added for conditional UI hiding
dbb9739
@synapsecode
STACGEN & STACMODIFIER: SystemPrompt Complete Revamp to improve SDUI …
c40eea0 
…generation
@synapsecode
Further SystemPrompt Changes
945771c
@synapsecode
ToolGen: LightMode Support added & LLMSelector included
d624529
@synapsecode
GenerateUIDialog: made the dialog lightmode friendly
dfd9cfd
@animator
Copy link
Member

Taken up by #880

@animator animator closed this Aug 29, 2025
@animator animator linked an issue Aug 29, 2025 that may be closed by this pull request
AI UI Designer for APIs #617
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
gsoc25
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

AI UI Designer for APIs
2 participants
@synapsecode @animator