Back to list
AI-Powered UI Test Automation Agent
FreeAI TestingFrameworkSeleniumMCP
About
The AI-driven UI Test Automation Agent offers an innovative method for GUI testing by integrating natural-language test specifications, Generative AI, Retrieval-Augmented Generation (RAG), and computer vision within a unified Java-based framework. It removes the fragility associated with selector-based scripts by learning UI components through semantic embeddings and images, subsequently mimicking human-like interactions consistently in both attended (training) and unattended (CI/CD) modes.
Key Features
- Utilizes LangChain4j to connect with instruction and vision AI models, distributing tasks so that one model determines testing actions while another manages visual validation.
- Compatible with Google AI Studio/Vertex AI and Azure OpenAI, adjustable through config.properties or AgentConfig.java (including model names, API keys, endpoints, temperature settings, maximum tokens, and retry attempts).
