new_drawing
Play demoTry asking
- Start a new drawing
- clear the canvas
- new blank drawing
ghost skill run ghost/paint new_drawing Fossify Paint (F-Droid): draw lines and fill areas on a canvas by percent coordinates, pick a colour, set the brush size, read back the ink coverage and colours. Offline, no account.
Agent run: finished without the skill, finished with it (not independently checked).
One recorded run each way, claude-haiku-5-5, same phone and same prompt. Watch it in the Before / after tab.
11.5× fewer tokens, 1.4× faster with the skill. Agent run: finished without the skill, finished with it (not independently checked).
| Run | Time | Tokens | Tool calls | Result |
|---|---|---|---|---|
| No skill: agent drives by hand | 92.3 s | 979,588 | 30 | finished |
| With skill: find_skill, run_skill | 66.7 s | 84,846 | 8 | finished |
Prompt: Draw a red triangle on my phone's drawing app and fill it with blue. Do not use the Play Store, no installs, no sign-in.
Same prompt, same phone, clean app state per side. Left: no skill, the agent drives the UI by hand. Right: find_skill + run_skill. 'ok' means the agent finished its turn; the result was not independently checked.
One recorded pair on samsung-a03s, claude-haiku-5-5; tokens count every input, cache and output token once per assistant message. Not a signed run: it adds no run evidence.
Control Fossify Paint on Android with an AI agent. Draw on your phone: an agent picks a colour, draws lines, fills shapes and checks what is on the canvas.
Target search phrase: AI agent draws on Android
Demo shows: set_color (color=red)
Ghost in the Droid seed skill for Fossify Paint (
org.fossify.paint), an offline drawing app. The canvas has no accessibility nodes, so the skill draws by percent coordinates and reads the result back from a screenshot (ink coverage and colour mix). Offline, no account.
| Action | What it does | Params |
|---|---|---|
new_drawing | Clear the canvas (needs confirm=yes) | confirm |
set_color | Pick red, blue, green, yellow or orange | color |
draw_path | Draw connected segments through percent points (x,y;x,y) | points |
fill | Flood-fill the area at a percent point with the current colour | x, y |
get_canvas | Read ink coverage and colour mix | none |
An agent can drive the whole app with these; compose them.
| Role | Action |
|---|---|
| Entry | new_drawing |
| Primitives | set_color, draw_path, fill |
| Read state | get_canvas (ink coverage and colour mix, from a screenshot) |
The app: F-Droid, or https://f-droid.org/packages/org.fossify.paint/. The skill:
pip install "ghost-in-the-droid>=1.6.0" # 1.6.0 is not on PyPI yet: until it ships, git clone the repo and `pip install -e .`
ghost skill install ghost/paint
ghost skill run ghost/paint set_color --param color=red --device <serial>
ghost skill run ghost/paint draw_path --param 'points=20,70;50,20;80,70;20,70' --device <serial>
run_skill(name="ghost/paint", action="draw_path", params={"points": "20,70;50,20;80,70;20,70"})
# {"result": {"segments": 3, "canvas": {"ink_pct": 6.5, "colours": {"red": 6.4}}}}
Try asking: "Draw a red triangle and fill it with blue."
Real Samsung phone, Android 13 (720x1600, 300 dpi, en-GB), Fossify Paint 1.4.0. License: MIT.
| App version | Android | Device | Skill version | Dates |
|---|---|---|---|---|
| 1.4.0 | 13 | Samsung real phone (720x1600, 300 dpi, en-GB) | 1.0.0 | 2026-11-02 |
SOFT.md is the narrative an agent reads when the exact steps no longer match your app version and it has to adapt the skill.
What each action means, which UI landmarks it relies on and how success is recognised, so an agent can adapt it to another app of this kind or another version.
Package: org.fossify.paint (Fossify Paint, GPL-3.0, version 1.4.0 from the official F-Droid repository, sha256-verified)
Verified: 2026-11-02 on a real Samsung phone, Android 13, 720x1600 @ 300 dpi, en-GB. Offline, no account.
Skill class: HARD. No login, no checkpoints.
new_drawing(confirm)Taps Clear and confirms if asked. Success: ink coverage 0.
set_color(color)Opens the colour dialog, taps the preset swatch, OK. Verified by sampling the colour square.
draw_path(points)One swipe per segment. Success: ink coverage grew.
fill(x, y)Taps the bucket, then the point. Success: ink coverage grew.
get_canvas()Screenshot analysis with Pillow: ink_pct and a named colour histogram.
Coordinates are percent of the safe canvas band, so the same drawing works on other screens. A closed outline is needed before fill, otherwise the colour floods the whole canvas. Brush size and eraser are not driven by this version.
Try a sample prompt or run an action by name. Replace any parameters in braces with your own values.
new_drawingTry asking
ghost skill run ghost/paint new_drawing set_colorTry asking
ghost skill run ghost/paint set_color draw_pathTry asking
ghost skill run ghost/paint draw_path fillTry asking
ghost skill run ghost/paint fill get_canvasTry asking
ghost skill run ghost/paint get_canvas Each release is an immutable git tag. The tree hash pins the exact skill directory the installer verifies.
| Version | Released | App versions | Tree | Size | Provenance |
|---|---|---|---|---|---|
1.0.0latest | never | >=1.4.0 | pending | 17.7 KB | untagged |