This Playwright test script uses AI to test if there's smoke coming out of the Sistine Chapel chimney and whether that smoke is white. The test only passes if the smoke is white.
Currently, set to use Google Gemini Flash 2.0, but you can switch it to use other LLM providers/models by setting the environment variable in the Github actions workflow: https://github.com/donobu-inc/donobu-papal-election-tests/bl...
I've set it to run every minute during the Papal Conclave election times - https://github.com/donobu-inc/donobu-papal-election-tests/ac...
Alternative version: check for dings on my phone from every news outlet sending a notification about it.
What was your motivation to use AI for this instead of simple image analysis?
Writing prompts is much simpler than image analysis plus they make a AI test framework thingy
Image analysis would be better. I just wanted to test it quickly with different models (Gemini, GPT 4o, etc.) using an AI testing framework I am building
AI’s cool
AI is for cool fools
Test should be passing now
It passed right when the smoke started coming out - https://github.com/donobu-inc/donobu-papal-election-tests/bl...
How much did you end up spending on API credits for Flash 2.0?
$0.29 over the past 2 days