ghost/paint

Fossify Paint (F-Droid): draw lines and fill areas on a canvas by percent coordinates, pick a colour, set the brush size, read back the ink coverage and colours. Offline, no account.

Proven 11.5× fewer tokens Score 36/100 Official hard skill python

Token savings

91% fewer tokens
Tokenswithout979,588with84,846 (91% fewer)
Timewithout92.3 swith66.7 s (28% less time)
Tool callswithout30with8 (73% fewer)

Agent run: finished without the skill, finished with it (not independently checked).

One recorded run each way, claude-haiku-5-5, same phone and same prompt. Watch it in the Before / after tab.

Recorded: new_drawing · live agent session on a real phone

Control Fossify Paint on Android with an AI agent — draw and paint

Control Fossify Paint on Android with an AI agent. Draw on your phone: an agent picks a colour, draws lines, fills shapes and checks what is on the canvas.

Target search phrase: AI agent draws on Android

Demo shows: set_color (color=red)

Ghost in the Droid seed skill for Fossify Paint (org.fossify.paint), an offline drawing app. The canvas has no accessibility nodes, so the skill draws by percent coordinates and reads the result back from a screenshot (ink coverage and colour mix). Offline, no account.

ActionWhat it doesParams
new_drawingClear the canvas (needs confirm=yes)confirm
set_colorPick red, blue, green, yellow or orangecolor
draw_pathDraw connected segments through percent points (x,y;x,y)points
fillFlood-fill the area at a percent point with the current colourx, y
get_canvasRead ink coverage and colour mixnone

Toolkit

An agent can drive the whole app with these; compose them.

RoleAction
Entrynew_drawing
Primitivesset_color, draw_path, fill
Read stateget_canvas (ink coverage and colour mix, from a screenshot)

Install

The app: F-Droid, or https://f-droid.org/packages/org.fossify.paint/. The skill:

pip install "ghost-in-the-droid>=1.6.0"   # 1.6.0 is not on PyPI yet: until it ships, git clone the repo and `pip install -e .`
ghost skill install ghost/paint

Use

ghost skill run ghost/paint set_color --param color=red --device <serial>
ghost skill run ghost/paint draw_path --param 'points=20,70;50,20;80,70;20,70' --device <serial>
run_skill(name="ghost/paint", action="draw_path", params={"points": "20,70;50,20;80,70;20,70"})
# {"result": {"segments": 3, "canvas": {"ink_pct": 6.5, "colours": {"red": 6.4}}}}

Try asking: "Draw a red triangle and fill it with blue."

Tested on

Real Samsung phone, Android 13 (720x1600, 300 dpi, en-GB), Fossify Paint 1.4.0. License: MIT.

Known failure modes and versions tested

Versions tested

App versionAndroidDeviceSkill versionDates
1.4.013Samsung real phone (720x1600, 300 dpi, en-GB)1.0.02026-11-02

Recorded failures

  • Colour names are limited to the 5 presets; the hex field is not used (it reformats while typing).
  • fill on an unclosed shape floods the whole canvas.
  • The state is read from a screenshot, so the screen must be on and unlocked.
  • Strokes are straight segments; curves need many short segments.
  • new_drawing wipes the canvas, so it needs confirm=yes; get_canvas is the non-destructive way in.

Popups and first-run screens handled

  • None.

Try a sample prompt or run an action by name. Replace any parameters in braces with your own values.

new_drawing

Play demo

Try asking

  • Start a new drawing
  • clear the canvas
  • new blank drawing
ghost skill run ghost/paint new_drawing

set_color

Play demo

Try asking

  • Switch the drawing colour to red
  • use blue
  • switch to orange
ghost skill run ghost/paint set_color

draw_path

Play demo

Try asking

  • Draw a triangle
  • draw a line
  • draw a zigzag
ghost skill run ghost/paint draw_path

fill

Play demo

Try asking

  • Fill the triangle
  • fill the shape
  • paint the inside
ghost skill run ghost/paint fill

get_canvas

Play demo

Try asking

  • What is on the canvas?
  • how much have I drawn
  • which colours are on the canvas
ghost skill run ghost/paint get_canvas