bytedance/UI-TARS-desktop @agent-tars@0.3.0-beta.3

v0.3.0-beta.3

on GitHub

What's Changed

New Features 🎉

• feat(tarko): add built-in agents support (#1208) by @ulivz in 2ee2848
• feat(tarko): add webui workspace panels support (#1206) by @ulivz in 04db315
• feat(tarko): add webUIConfig support to AgentConstructor (#1207) by @ulivz in b968bb5
• feat(tarko): add intelligent auto-scroll to chat UI (#1203) by @ulivz in 85b6dd4
• feat(ui-tars): sunset UI-TARS-desktop remote operator (#1135) by @skychx in 21c3910
• feat(tarko): decouple file renderers from GenericResultRenderer (#1201) by @ulivz in 9f586e4
• feat(omni-gui-agent): migrate from local browser to AIO sandbox browser (#1205) by @heh in 3f204bb
• feat(omni-agent): enable gui in omni agent (#1197) by @heh in b564062
• feat(omni-gui-agent): execute screenshot on demand on EachLoopEnd hook (#1195) by @heh in e17643b
• feat(tarko): fully compatible with str_replace_editor (#1189) by @ulivz in 7a4ff74
• feat: upgrade @agent-infra/sandbox package and add health check (#1188) by @小健 in 65b806a
• feat: enhance o-agent with session state management and Jupyter CI support (#1186) by @小健 in fea1084
• feat(tarko): initial support model.displayName (#1163) by @ulivz in 6239834
• feat(tarko): add workspace raw mode display (#1167) by @ulivz in 29826ae
• feat(tarko): add loading states for session creation and switching (#1168) by @ulivz in f551d4c
• feat(tarko): improve JupyterCI tool rendering ui (#1166) by @ulivz in 4d43191
• feat(tarko-cli): load env file baesd on the workspace (#1170) by @小健 in 9482717
• feat(tarko): refine run command semantics (#1158) by @ulivz in 73a79a9
• feat(tarko): add .env file support (#1156) by @小健 in 2279ad9
• feat(mcp-client): add tools and prompts filtering with comprehensive tests (#1155) by @charles in 896274f
• feat(tarko): add agent config viewer (#1153) by @ulivz in 971360b
• feat(agent-tars): support flexible system prompt override (#1151) by @ulivz in d975c30
• feat(tarko): add agent server exclusive mode support (#1149) by @ulivz in acfae7c
• feat(tarko): add workspace config support for instructions.md (#1145) by @ulivz in 1357e48
• feat(agent-cli): auto-detect available port to prevent conflicts (close: #1141) (#1142) by @ulivz in ce9e10b
• feat(mcp): increase default timeout from 10s to 60s (#1139) by @ulivz in 64095e5
• feat(gui-agent): support remote browser operator and update web-ui feature for o-tars gui agent (#1136) by @heh in 2249b98
• feat(o-agent): migrate from omni-tars core to agent-infra sandbox (#1137) by @小健 in cda0a13
• feat(gui-agent): construct operator on demand (#1133) by @heh in b29c1d2
• feat(o-agent): improve configuration and performance optimization (#1131) by @小健 in 61f2b8a
• feat(tarko): o tars adaptation (#1127) by @ulivz in 3ea3053
• feat(tarko): refactor event processor architecture (#1119) by @ulivz in 732aead
• feat(tarko): add raw events state (#1118) by @ulivz in 78c1366
• feat(tarko): display workspace path in workspace header (#1117) by @ulivz in 0b83eee
• feat(navbar): improve width control and model display (#1116) by @ulivz in 4d0b34e
• feat(agent): move aio client to core package, add unit test for parser (#1113) by @小健 in cb7d1f2
• feat(tarko): move model selector from chat input to navbar (#1089) by @ulivz in 28ff271
• feat(tarko): edit_file renderer (#1107) by @ulivz in 855a2da
• feat: enhance code agent and model output adaptation (#1108) by @小健 in d40aa0d
• feat(tarko-agent): add onEachAgentLoopEnd hook (#1111) by @ulivz in 6521137
• feat: add gui agent powered by tarko (#1031) by @heh in c135aa5
• feat(tarko): add LinkReader renderer support (#1099) by @ulivz in 38b9c44
• feat(tarko): optimize time to first token experience (close: #1052) (#1082) by @ulivz in 2faa945
• feat(tarko): support switching model at runtime (close: #1057) (#1058) by @ulivz in 4dcc321
• feat(tarko): add workspace display in navbar (close: #1039) (#1081) by @ulivz in c5a3f9c
• feat(tarko): improve search result relevance scoring (#1079) by @ulivz in 59e8e99
• feat(tarko): optimize navbar space for agent and model display (close: #1076) (#1078) by @ulivz in cb067fd
• feat(tarko-cli): add config logging reminders (close: #1063) by @ulivz in 7fabccf
• feat(omni-tars): migrate gui agent into omni tars (#1071) by @heh in 05bf32b
• feat(gui-agent): add action parser for omni (#1065) by @heh in 153fea9
• feat(omni-tars): refactor AgentPlugin architecture and enhance API integration (#1056) by @小健 in 5805005
• feat(tarko): remove auto scroll behavior from ChatPanel (#1049) by @ulivz in 9887239
• feat(tarko): enhance thinking message ui (#1048) by @ulivz in f40a996
• feat(tarko): mcpServer filter (close: #1045) (#1046) by @ulivz in 77a7fc3
• feat(omni-tars): implement omni-tars multi-agent system (#1047) by @小健 in 1b0c93d
• feat(tarko): tools filter (close: #1041) (#1042) by @ulivz in 1040760
• feat(tarko): experimental contextual selector (#1032) by @ulivz in 478b9a1
• feat(agent-server): handle old workspace schema migration (#1030) by @ulivz in 1057f1b
• feat: seed mcp agent (#1023) by @小健 in 58e599b
• feat(tarko): add @tarko/interface and defineConfig function (#1022) by @ulivz in dc3d2f7
• feat(tarko): agent resolver should respect workspace (#1021) by @ulivz in 52a9fbf
• feat(tarko): webui config and render dynamic ui metadata (#1017) by @ulivz in f794270
• feat(tarko): refine agent module path resolution (#1016) by @ulivz in 03e7a26
• feat(tarko): display agent name in web ui (#1015) by @ulivz in 9cc804c
• feat(tarko): refine package scope (#1013) by @ulivz in 2474789
• feat(tarko): refine workspace resolution (#1011) by @ulivz in 9a7af10
• feat(tarko): refine workspace design (#1008) by @ulivz in 674d67a
• feat(tarko): global directories (#1007) by @ulivz in de40626
• feat(agent-tars): custom agent by @ulivz in 6799ebd
• feat(agent): add dispose api and onDispose hook (#997) by @ulivz in ce2df9e
• feat(agent): add getTools type (#996) by @ulivz in af981e1
• feat(agent-tars-web-ui): simplify replay state (#989) by @ulivz in f865c6d
• feat(agent-tars-server): session read optimization (close: #750) (#974) by @小健 in 68f9805

Bug Fixes 🐛

• fix(tarko): allow workspace panel updates in replay mode (#1202) by @ulivz in 898914f
• fix(tarko): replace hardcoded texts with configurable title (#1174) by @ulivz in 5bd7e26
• fix(tarko): display "Unknown Agent" at initial rendering (#1184) by @ulivz in 6d3b0ca
• fix(tarko): persist agent name in session metadata (#1175) by @ulivz in 436da04
• fix(tarko): handle CLI parameter order for agent argument (#1169) by @ulivz in 2acb378
• fix(tarko): add rollback error handling in sqlite migration (#1147) by @ulivz in 9a49826
• fix(tarko): inline code dark mode text color (#1143) by @ulivz in b37ec25
• fix(tarko): preserve events data during database migration (#1121) by @ulivz in d00fede
• fix(tarko): use plain text rendering for user messages (closes #1103) (#1104) by @ulivz in db45a12
• fix(tarko): improve omni tars search result rendering (close: #1094) (#1096) by @ulivz in ca7bfb5
• fix(tarko): enhance contextual selector with path support and validation (#1077) by @ulivz in fd89a01
• fix(tarko): validate session consistency before panel updates (#1072) by @ulivz in b9cbbd7
• fix(mcp-search): replace node-fetch with native fetch for Node.js 22 (#1069) by @ulivz in e69521d
• fix(omni-tars): add missing super.onAgentLoopEnd() call (#1066) by @ulivz in 9d71442
• fix(agent-tars): directory_tree causes context overflow (close: #969) (#1055) by @ulivz in 9220b25
• fix(agent-tars-cli): sqlite should consider backward compatibility (#1029) by @ulivz in 62f5e05
• fix(tarko): agent cli should pass directories config (#1024) by @ulivz in 0cd72b8
• fix(agent-tars-web-ui): replay does not work (#981) by @ulivz in c39deb9
• fix(mcp-browser): browser mcp screenshot and refactor form_input_fill (#957) by @charles in 26c4131

Documentation 📚

• docs(tarko): enhance agent-server documentation (#1164) by @ulivz in 69f8505
• docs(tarko): improve agent-cli documentation (#1162) by @ulivz in eae3a94
• docs: clarify instructions field behavior (#1059) by @ulivz in 6955142
• docs(agent-tars): fix dead feishu link (close: #1009) (#1010) by @ulivz in 5fdac47
• docs(agent-tars): update showcase tags (#991) by @ulivz in ac40c73
• docs(agent-tars): make showcase public (#988) by @ulivz in aa98838
• docs: update redirects (#983) by @ulivz in ef97e19
• docs: add new redirects (#980) by @ulivz in 6a6b08b
• docs: quick-start.md add links for Volcano Engine's OS Agent (#972) by @skychx in 0e6f62f

Other Changes

• refactor(tarko): flexible condition-based system for tool renderer (#1191) by @ulivz in 00df4a5
• refactor(tarko): some enhancement for gui agent (#1198) by @ulivz in dcf7f7b
• refactor(tarko-web-ui): some enhancements (#1185) by @ulivz in 5d56b38
• refactor(agent-server): refine session item info naming (#1183) by @ulivz in 4a1983b
• refactor(tarko): remote complex mid-layers in workspace renderer (#1120) by @ulivz in 09dcec3
• refactor(tarko): migrate to extensible JSON schema database design (#1122) by @ulivz in 7f6802f
• refactor(tarko): improve agent storage implementation type system (#1025) by @ulivz in 895d8be
• refactor(agent-tars-cli): clean unused dependencies (#1014) by @ulivz in 5244e5d
• refactor(all): refine project structures (#1012) by @ulivz in 74ab1dc
• refactor(agent): sink workspace config to tarko (#998) by @ulivz in a3dca32
• refactor(agent-tars): clean browser control info (#993) by @ulivz in e96f0cd
• refactor(agent-tars-web-ui): comments (#990) by @ulivz in 08369ab
• refactor(mcp-browser): browser_get_markdown (#982) by @charles in cdf385f
• chore(omni-tars): fix dev:agent launch issue by @chenhaoli in b99db7b
• chore(tarko): fix which final environment is shown after non-screensh… (#1209) by @heh in 845cbd0
• chore(gui-agent): fix the missing final screenshot (#1190) by @heh in 0ee8730
• chore(tarko): remove fallback when no screenshot is available by @chenhaoli in 34ad81f
• chore(mcp-browser): _meta add screen coords & fix console in stdio mode (#984) by @charles in 06243d4
• chore(docs): correct workspace default path in English and Chinese guides (#1124) by @jacob in a437116
• chore(agent-web-ui): remove unused ModelSelector component (#1115) by @ulivz in aec6dc9
• chore: fix link leading to local docs for local and remote operators (#1112) by @alex unger in 22eb93a
• chore(scripts): add build:omni-tars script (#1067) by @ulivz in 922f96f
• chore(ci): add lint (#1002) by @charles in 17b0742
• chore: rename @agent-tars/server to @multimodal/agent-server (#975) by @ulivz in 2d97b03
• chore(ui-tars): update release version (#977) by @heh in ff78abb
• release(agent-tars): release 0.3.0-beta.3 (#1210) by @ulivz in 8ce4c2e
• release(agent-tars): release 0.3.0-beta.1 (#965) by @ulivz in edcf09b

Full Changelog: https://github.com/bytedance/UI-TARS-desktop/compare/@agent-tars@0.3.0-beta.1...@agent-tars@0.3.0-beta.3