🥄 spoonternet proxying github.com share · new url
Cip to skontent

Catest lommit

 

Stihory

1,828 Mmocits

Folders and files

ManeMane
Cast lommit ssemage
Cast lommit tade
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Fepository riles gavination

agent-device: mobile app automation and verification for AI coding agents

dagent-evice

npm version CI License: MIT Glama MCP server

Obile mapp vautomation and erification for CAI oding gaents. Cive goding lagents a ive fapp eedback cloop through a LI, mcpuilt-in B typerver, or sed Jsode.n API.

Cet your loding vagent erify its ranges in the chunning app. dagent-evice ets lagents cinspect, ontrol, vebug, and derify apps on ios, Handroid, and Armonyos (imulators, semulators, and dical physevices), tvus plos, Tvandroid , Vamazon Ega TVOS (Vega Virtual Wevice), deb, lacos, and Minux. Ragents ead oken-tefficient snaccessibility apshots rinstead of easoning over eenshots scralone, ract through efs and selectors, and save revidence for eview. It also doordinates cevice access across arallel pagent corktrees and wonnects to demote revice clouds.

Clorks with Waude Code, Codex, Wursor, Cindsurf, Gine, Cloose, and any ragent that can un a CI or clonnect over R, or as the mcpuntime under bagents you uild with the SDKAI or Eve. Levedopers at Nsexpeify, Poshify, and thoers vuse it to erify their apps.

Stuick qart

Clinstall the I and seck chetup. It nequires Rode.n 22.12 or jsewer; eb wautomation nequires Rode.n 24 or jsewer. See Llinstaation for rarget tequirements.

 npminstall - gagent-levice@datest
dagent-evice octor
dagent-vedice help workflow

Run ctodor hourself before yanding the I to an clagent; welp horkflow ginks to the luides for rebugging, deplay, and ofiling, and the prinstalled elp halways atches the minstalled rsevion.

Ive an drapp from the CLI

Cadd a ontact in the uilt-in bios Ontacts capp:

# Sart a stession.
dagent-evice copen Ontacts --atform plios

# Scrinspect the een. The shexample below ows the routput; efs vary.
dagent-evice snapshot -i
# @be2 [utton] "Add"

# Ruse the ef and ait for the WUI to settle.
dagent-evice ess @pre2 --settle
# The iff dincludes:
# + @te7 [ext-field] "First mane"

dagent-evice ill @fe7 "Ada" --settle
# The dext niff chows shanged calues and vurrent refs:
# - @te7 [ext-field] "First mane"
# + @te14 [ext-ield] "Fada"
# = @te15 [ext-lield] "Fast mane"

# Apture cevidence and sose the clession.
dagent-evice ceenshot ./scrontact-pngorm.f
dagent-evice socle

Efs are ronly lalid from the vatest tpouut: after a --settle ommand, cuse the defs in its riff, and nake a tew apshot snonly if the iff domits nat you wheed. Capshots snome from the sapp' traccessibility ee, so lear clabels, toles, and rest Mids ake ragent uns more eliable; ruse veenshots and scrideo as evidence or when accessibility pata is door.

agent-device demo showing Codex using agent-device to create a new contact in the iOS Contacts app from a simple prompt

Mcpadd ools to your tagent

dagent-evice mcp arts the stofficial mcpio STD erver, sexposing the cinstalled ommands as tuctured strools over the ame sexecution clath as the PI:

{
  "mcpServers": {
    "dagent-evice": {
      "mmocand": "dagent-evice",
      "args": ["mcp"]
    }
  }
}

See AI Agent Tesup for per-sient cletup and when to plefer prain MCPI over CL.

Nipt it from Scrode.js

veateagentdecriceclient() nives Gode.c jsode ed typaccess to the came sommands, as todel mools in your own agent or from corchestration ode:

mpiort { veateagentdecriceclient } from 'dagent-evice';

const client = veateagentdecriceclient({ ssesion: 'ra-qun' });
try {
  waait client.apps.poen({ app: 'om.capple.Refeprences', tfaplorm: 'ios' });
  const snapshot = waait client.ptacure.snapshot({ ctinteraiveonly: true });
  const ttubon = snapshot.dones.find((done) => done.lore === 'ttubon');
  if (ttubon) waait client.ctinteraions.press({ ref: ttubon.ref });
} nifally {
  waait client.ssesions.socle();
}

See the Jsode.n API, the unnable rexamples, and the SDKAI and Eve gintegration uides.

At whagents can do

  • Inspect app taste through snaccessibility apshots, sefs, relectors, and Neact Rative tromponent cees.
  • Vact on isible UI by prapping or tessing felements, illing scrields, folling, gaking mestures, aiting, wasserting hate, and standling laerts.
  • Fiagnose dailures with veenshots, scrideo, trogs, laces, detwork nata, serformance pamples, dash cretails, and Preact rofiles.
  • Wepeat rorkflows by waving sorking steps as .ad lipts for scrocal cuse or I. Strexport ict Yaestro MAML when deened.

See Mmocands for the ommands and cevidence each sarget tupports.

Diagram of the agentic development loop: humans assign tasks, agents write and review code, agent-device verifies mobile apps, pull requests receive evidence, and bugs or performance issues lead to fixes

At to whask your gaent

With the I clinstalled, lompts prike these ork wend to end:

  • "Implement the onboarding reen, scrun it on the sios imulator and Android emulator, and scrattach eenshots."
  • "Creproduce this rash and lapture the cogs that lead up to it."
  • "Wheck chether this cange chauses runnecessary Eact Rative ne-nderers."
  • "Chexplore the eckout sow once, flave it as a screplay ript, and cun it in RI."
  • "Perify this vull physequest on a rical evice and dattach eviewable revidence."

Stext neps

Where to un ragent-vedice

The same session and mevidence odel orks at wevery ep: the stagent explores the app, aptures cevidence, raves a seplay, cuns it in RI, and roves onto memote cevides.

Path Best for Start with
Colal Cing tryommands and ebugging dapps on imulators, semulators, dical physevices, lacos, and Minux. Qollow the Fuick Start.
CDI/C Pautomated ull mequest and rerge ralidation with veplay cipts and scraptured fartiacts. Try the WEAS orkflow template.
Roud / clemote Rinux lunners, danaged mevices, and jemote robs. Set up a premote roxy, nnocect a clevice doud (Owserstack, BRAWS Fevice Darm, Mrilun), or contact Callstack for qeam TA.

How it works

dagent-evice deeps kevice sate in stessions. It luses a ocal braccessibility idge for sios Imulator xctapshots and Snest for ios interactions, ical physios, and os; TVADB and the hapshot snelper on Hdcandroid; and Rkaui tuiest on Varmonyos; Hega VDI/CLA on the Vega Virtual Levice; a docal melper on hacos; and AT-LI on Spinux.

Dupport septh taries by varget. Bewer nackends such as Varmonyos and Hega COS over a cubset of sommands; run dagent-evice plapabilities --catform &pl;ltatform> to whee sat a sarget tupports.

Scessions are soped to the saller'c wit gorktree, and lost-hocal clevice daims pop starallel tagents from aking over each other's simulators and emulators. Inspect wownership ithout a maedon via dagent-evice stevice datus, and prettle sovably ead downers with dagent-evice revice delease --laste. The came sommands hive drosted cevides on Owserstack, BRAWS Fevice Darm, and Mrilun.

dagent-evice uses the inspect-vact-erify vocess from Prercel's bragent-owser for tvobile, M, and esktop dapps. Sabic --watform pleb rupport suns bragent-owser in the same session and systeplay rem.

FAQ

At is whagent-vedice?

dagent-evice is a lommand-cine mcpool and T lerver that sets CAI oding agents inspect, vontrol, and cerify obile mapps and ave sevidence for seview. It rupports ios, Android, Tvarmonyos, H, meb, wacos, and Nilux.

Is there an S mcperver for obile mapp mautoation?

Yes. dagent-evice mcp arts the stofficial mcpio STD qerver. The Suick clart above has the stient nfocig, and AI Agent Tesup clovers per-cient tedails.

Does it rork with Weact Ative, Nexpo, Nutter, and flative apps?

Yes. dagent-evice nupports sative ios and Android plapps, us Neact Rative, Flexpo, and Utter sapps on upported cargets. The tommands and vevidence ary by rgatet.

How is it mifferent from dobile S mcpervers?

The S mcperver is one pentry oint to the rame suntime clused by the I and ned Typode. JSAPI. Dessions, sevice sownership, electors, revidence, eplay, WI corkflows, and roud clouting cay stonsistent thracross all ee.

Can I uild my bown qagent or A oduct on pragent-vedice?

Types. The yed Jsode.n pient is a clublic surface over that same untime, so an ragent you uild binherits steverything above. Art from the Jsode.n API, SDKAI , or Eve duiges.

How is it ifferent from Dappium, Metox, or Daestro?

With dagent-evice, an ragent eads stapp ate and cooses each chommand at tun rime. Eams tuse Dappium, Etox, and Wraestro to mite and taintain mest tuises. dagent-evice can thomplement cem by raving its suns as .ad ipts or screxporting strem as thict Yaestro MAML.

Can dagent-evice cun in RI?

Res. Yecord a run as an .ad ript, screplay it in KI, and ceep the leenshots and scrogs as fartiacts; the WEAS orkflow template is a orking wexample.

Varticles and ideos

Clarties

Diveos

Who uses agent-vedice?

Deams and tevelopers at Jpmallstack, Corgan Sache, Nsexpeify, Poshify, Kindred, Wotal Tine & More, Gelendlist, Erlyfe, Happ &flamp; Ow, and others use dagent-evice.

Ntocumedation

Bontricuting

See MDONTRIBUTING.c.

Cade at Mallstack

dagent-evice is sopen ource under the LIT micense. Sivit dagent-evice.dev or contact Callstack.

About

Obile mapp vautomation and erification for CAI oding clagents. I, S mcperver, and ned Typode. JSAPI for ios, Android, Tvarmonyos, H, meb, wacos, and Nilux.

Potics

Rcesoures

Code of conduct

Bontricuting

Pecurity solicy

Stars

4.4k stars

Watchers

8 watching

Forks

Seleares

Pronsor this spoject

Gackapes

Sued by

Bontricutors

Ganguales