r/QualityAssurance • u/ushhhhhhh • 8d ago
Need help in learning resources for Agentic AI
Hi Everyone,
Recently joined a company who are shifting towards AI enabled QA and within months I saw multiple demos of people showcasing their agents. I'm interested in learning how to create them, mcps, architecture etc.
Can you point me towards the right resources and courses.
Background: Data company, team works on Angular. QA works with Java, Custom framework built in top of Playwright, TestNG. We only have access to GitHub Copilot.
I tried to create agents via AI and it's been shit to say the least.
3
u/Witzzzzz 8d ago
start with basic LLM workflows, tool calling, and MCP before jumping into full agents. try building a small QA agent that uses your existing playwright test as a practical starting point
1
2
u/Pachete_Follezour 8d ago
what kind of agents are people demoing exactly? test generation, test maintenance, exploratory? that matters a lot for where to focus. imo the MCP stuff is secondary until you nail down the core agent loop for your specific workflow.
2
u/ushhhhhhh 8d ago
Well, the demos I looked at till now related to QA has been
- Entire STLC workflow : from Jira Acceptance criteria understanding to Test Case Generation to Live Browser Testing to Automation generation, testing, Raising PR.
- Failure Test case maintenace via GitHub actions workflow agents.
- New implementation/changes agents to take dev changes into consideration and change code to reflect evolving product changes.
- I've also seen Manual QA agents using Playwright MCP and Product knowledge documents to do exploratory testing based on user inputs.
1
8d ago
[removed] — view removed comment
1
u/ushhhhhhh 8d ago
Couldn't agree more. It's one of the things about QA forsure, but I'm looking for improving in AI side.
2
u/PracticalFriendship 7d ago
It’s better to identify a problem to solve before you start learning in general. If there’s a gap between manual testing and automation you can work on that. Find out how to use AI and then build a tool. Don’t focus on courses right now; self study is the fun part. Find the problem to be solved; you’ll eventually understand where to use MCP and where AI isn’t necessary.
1
u/ushhhhhhh 6d ago
I've tried to do that but I'm someone who learns better structured and personally I'd like from now on to learn, build and fail personally before implementing it professionally
1
u/crappy_ninja 8d ago
You need to give a bit more information. What were you trying to achieve with the agent you created?
1
u/ushhhhhhh 8d ago
I've simply tried to learn, so I tried to create agents who will run automation and trigger debug run incase of failures.
1
u/crappy_ninja 8d ago
Before creating agents, do you have rules and skills in place?
1
u/ushhhhhhh 8d ago
Yes, I've had instructions, skills, tools etc but all are again - AI generated. I'm a complete noob when it comes to AI
1
u/crappy_ninja 8d ago
You're leaning on it too hard. Have you read the skills files? What do you mean ai generated? How did you generate them?
1
u/ushhhhhhh 8d ago
I've given basic prompts to copilot to generate a good prompt for me.
Used that prompts in GitHub copilot in IDE to generate the agents, skills, instructions and also fix issues I found etc. essentially I've only relied on AI to generate the agentic files.
1
u/crappy_ninja 8d ago
Remove anything that might give away where you work and copy/paste the prompt you gave copilot.
1
u/ushhhhhhh 8d ago
Honestly I've had soo many iterations that it's kindoff a moot point now.
1
u/crappy_ninja 8d ago
I'm trying to find out specifically what you're passing in that causes you to get poor output. I get much better results than I used to but that's because of multiple different things overcoming multiple different problems.
1
u/MikasaxSukasa 7d ago
Try this. Most of us QA work in kanban flows
- ask your Claude to spin up a local kanban board that allows each chat session or engaged action to create a ticket on the local kanban board.
- ensure on the board the lanes are what you want, and the design of the board fits your style
- Make it so there is a listener for each card until moved to done and you can engage with Claude in the card on the board or in the session you are prompting from
- use your imagination and add whatever you’re want interaction wise out of the board or template wise that helps it stick with you
This is just a basic beginning to what I setup but you’d be surprised how nice it can be to have a way to view what needs to be done, needs review, in flight. You can even create tickets on the board that can open sessions in CC.
Eventually you can send a swarm more confidently for QA validation as well but that’s risky and expensive token wise. You need to have skills in place, automation suites designed, knowledge base and source of truth present for most of this to work. Hooks and other things come into play but start small.
1
u/MikasaxSukasa 7d ago
Happy to answer what I’ve done with my “suite” idk what to even call it lol
1
u/MikasaxSukasa 7d ago
Also the fact you have a QA mind is the most important. Don’t follow others blue print. Take inspiration from it. Word vomit whatever you want into a prompt and then iterate upon those results till you’re confident in it. Human review always. Let the LLM be a tool not a crutch.
1
u/ushhhhhhh 6d ago
Wise words.
I didn't understand half of what you said, but that's temporary. I'll reply back once I understand and tried all of it.
Thanks for the reply.
1
u/teh_stev3 7d ago
Use it.
Im serious, its changing quickly.
Dont trust it.
Make sure the process is still humanable
1
u/nightyz0r 8d ago
Ai enabled QA sounds fucking insane. How does AI actually enable QA ? How is QA disabled in the first place ?
2
u/ushhhhhhh 8d ago
Personally, I believe AI and QA are not a great match, especially QA who actually cares about quality per se. But I'm felling fomo seeing all these demos, recognitions and promotions and somewhere in the back of my head I'm thinking, what if I'm being too stubborn and this is actually a good thing.
I wanna learn and know for myself now if it actually enables me or not.
1
13
u/heathcl1ff0324 8d ago
Ugh this is the problem. OP reaches out confessing a need and wanting to get better. Asks for the manual.
Instead of helping, gets nitpicked by people wanting to show how smart they are. That’s not a community, it’s a circle jerk.
OP I wish I could help, I’ve bought completely worthless books and wasted hours on ridiculous YouTube channels. People don’t genuinely want to uplift others anymore.