bytedance/UI-TARS-desktop v0.3.0 on GitHub

What's Changed

New Features 🎉

feat(gui-agent): add example for 2.0 version (#1732) by @ZhaoHeh in 39ee4a8
feat(gui-agent): add image detail calculator for enhanced screenshot processing (#1724) by @ZhaoHeh in 71e6e1a
feat(aio-operator): remove focus from the address bar after navigation (#1723) by @ZhaoHeh in 9fb722b
feat(o-gui-agent): add image's detail parameter into message (#1722) by @ZhaoHeh in 53bb572
feat(tarko-agent-ui): add copy link option to share conversation modal (#1706) by @ulivz in 89b0021
feat(tarko): add event stream viewer (#1374) by @ulivz in 41bf5b9
feat(game-mode): improve game agent mode error handling and user experience (#1673) by @ZhaoHeh in 41771b5
feat(tarko-agent-ui): improve raw mode renderer design (#1677) by @ulivz in 7aca7b3
feat(agent-tars): add welcome cards (#1685) by @ulivz in 20aefb1
feat(tarko-server-next): optimize parts of controller by avoiding go … (#1684) by @cjraft in 3e4dbb1
feat(omni-agent): fix img compressor dependency issues (#1683) by @cjraft in 135cf99
feat: TARS platform enhancements and compatibility fixes (#1680) by @cjraft in c350778
feat(tarko-agent-ui): add clickable url links in terminal renderer json output (#1655) by @ulivz in 3d18050
feat(tarko-agent-ui): replace plus icon with lightning bolt for agent mode selector (#1674) by @ulivz in 4375ec1
feat(omni-agent): zoom out game welcome card (#1672) by @ZhaoHeh in 9dc0d05
feat(o-gui-agent): set waiting time as 5s when initailize screenshot (#1671) by @ZhaoHeh in 3b6ca2b
feat(omni-agent): add functions prompt for game mode (#1668) by @ZhaoHeh in eab67bf
feat(omni-agent): optimize agent game mode UI (#1665) by @ZhaoHeh in db0aade
feat(tarko-agent-next): sync code from agent-server (#1663) by @cjraft in 2602b10
feat(tarko-agent-server, agent-ui): return initialization events from session create (#1662) by @ulivz in 008124a
feat(o-gui-agent): insert preset messages before real query from user (#1661) by @ZhaoHeh in 43ba4cf
feat(omni-agent): add default runtimeSettings (#1657) by @cjraft in 464ee9b
feat(o-gui-agent): support agent mode and game operator with enhanced error handling (#1656) by @ZhaoHeh in 4539b80
feat(tarko-agent-server, agent-ui): refine arch of agent options and settings from home to session (#1645) by @ulivz in 3a27504
feat(omni-agent): agentMode structure update; add game mode support (#1649) by @cjraft in f3ec7d4
feat(omni-agent): compress images for gui screenshot (#1647) by @cjraft in b8e3d68
feat(tarko-agent-ui): welcome cards (#1643) by @ulivz in 37babcc
feat(omni-agent): update agent mode config structure (#1642) by @cjraft in c3e8513
feat(tarko-agent): enhance runtime settings with enum labels and UI placement control (#1638) by @ulivz in 70571c2
feat(tarko-agent-ui): replaced generic tool renderer with terminal-style renderer (#1594) by @ulivz in 6367f5a
feat(tarko): add runtime settings api in server-next (#1634) by @cjraft in 8d6b08e
feat(tarko-agent-agent, agent-ui): add webui.base support (#1623) by @ulivz in dce0e7e
feat(tarko-agent-ui): add webui.layout.enableHome config (#1629) by @ulivz in d6673d5
feat(tarko-agent-ui): add webui.layout.enableSidebar config (#1624) by @ulivz in 530c435
feat(agent-tars): disable contextual selector by default (#1621) by @ulivz in 86f3da0
feat(tarko-agent): runtime settings (#1561) by @ulivz in a59d33d
feat(tarko-agent-cli): add --model.displayName option support (#1605) by @ulivz in dadfe4e
feat(tarko-agent-ui): mobile ui bottom sheet (#1563) by @ulivz in 0a1b7cf
feat(agent-tars): support aio sandbox environment (#1573) by @ulivz in 2e38422
feat(tarko-agent): remove engine-selector from agent kernel (#1576) by @ulivz in 76da098
feat(agent-server): support remote static html and add share for server-next (#1558) by @cjraft in 87dd3b9
feat(tarko-agent-cli): support unknown options passthrough (#1574) by @ulivz in f1f2ccd
feat(tarko-agent-ui): new layout design (#1553) by @ulivz in 21d59fb

Bug Fixes 🐛

fix(mcp): RCE Vuln: Remove DANGEROUSLY_OMIT_AUTH=true from dev scripts (#1731) by @jonathan Leitschuh in e71fce1
fix(agent-server-next): agent mode lost in agent options (#1725) by @cjraft in 06258c3
fix(tarko-agent-ui): unexpected file renderer behaviors (#1705) by @ulivz in ca267db
fix(tarko-agent-ui): preserve multimodal content format when navigating from home page (#1704) by @ulivz in d8bd7c0
fix(tarko-agent-server): remove redundant event logging (#1703) by @ulivz in eb22071
fix(tarko-agent-ui): optimize health check polling to prevent unnecessary API calls (#1562) by @ulivz in 1e14512
fix(gui-agent): return original result onAfterToolCall hook (#1681) by @ZhaoHeh in 0a38cba
fix(tarko-agent-ui): ugly tooltip (#1648) by @ulivz in 2b87a36
fix(tarko-agent-ui): render error in tool raw mode renderer (#1659) by @ulivz in 57e4606
fix(tarko-agent-ui): display environment input on session creation (#1667) by @ulivz in 2fb6c8f
fix(tarko-agent-server): system setting api 404 issues (#1669) by @cjraft in a14bf9a
fix(tarko-agent-server): fix agent events problem (#1666) by @cjraft in 3276766
fix(tarko-agent-server): ensure agent initialize events are persisted (#1660) by @ulivz in 221eb37
fix(tarko-agent-ui): make welcome cards prompt optional (#1658) by @ulivz in 9ec1243
fix(tarko-server-next): remove unexisted routes (#1650) by @cjraft in 7bb5945
fix(aio-hybrid-operator): transform arrowDirecton key to direction key (#1641) by @ZhaoHeh in 83998b1
fix(tarko-agent-ui): remove ugly container from ImageRenderer (#1639) by @ulivz in e35aa78
fix(tarko-agent-ui): code editor light mode highlighting (#1636) by @ulivz in 6037e0e
fix(tarko-agent-cli): merged webui config in script injection (close: #1626) (#1627) by @ulivz in c8e83ef
fix(tarko-agent-ui): restore container and navbar in replay mode (#1615) by @ulivz in 2afe334
fix(tarko-agent-ui): restore fallback image upload when no runtime settings (#1619) by @ulivz in cf4d88b
fix(tarko-agent-ui): improve read_multiple_files renderer parsing and error handling (#1606) by @ulivz in a243be9
fix(tarko-agent-ui): remove duplicate url actions bar from browser renderer (#1584) by @ulivz in c2466c1
fix(tarko-agent-ui): improve monaco editor line numbers spacing (#1571) by @ulivz in 77a2a27
fix(tarko-agent-ui): support all SSE line separators in streaming (#1568) by @ulivz in bdceb7c

Documentation 📚

docs(agent-tars): showcase build-time optimization (#1714) by @ulivz in 1fef3d7
docs(agent-tars): fix the wrong tsconfig paths (#1710) by @soon in e95134d
docs(agent-tars): fix showcase not found (#1708) by @ulivz in 06a3df7
docs(tarko): enhance agent api (#1689) by @ulivz in 45be44e
docs(tarko): refactor agent hooks (#1688) by @ulivz in 08e68d0
docs(tarko): remove troubleshooting (#1702) by @ulivz in 4cab415
docs(tarko): keep terminology untranslated in zh docs (#1695) by @ulivz in 804fd25
docs(tarko): using semantic model id for code examples (#1687) by @ulivz in 518da87
docs(tarko): agent ui config api reference (#1653) by @ulivz in 6c3cd74
docs(tarko): runtime settings api (#1654) by @ulivz in 1e168f3
docs(tarko): restructure cli documentation into separate sections (#1610) by @ulivz in 7c1f576
docs(tarko): fix agent options in examples (#1602) by @ulivz in 08701d8
docs(tarko): agent api documentation improvements (#1601) by @ulivz in 6e3c62b
docs(tarko): complete zh getting-started examples (#1603) by @ulivz in ed773e9
docs(tarko): sync zh agent api docs with en version (#1600) by @ulivz in df2ae59
docs(tarko): refactor agent options (#1596) by @ulivz in 9cafc95
docs(tarko): fix duplicate links and inaccurate interface examples (#1595) by @ulivz in 2a6e0d9
docs(tarko): merge agent snapshot (#1591) by @ulivz in b3aa66b
docs(agent-tars): ensure consistent background across all pages (#1589) by @ulivz in d082924
docs(tarko): refine agent hooks (#1586) by @ulivz in 8912c15
docs(tarko): migrate tool docs (#1585) by @ulivz in 8c13dd6
docs(agent-tars): add blog index page (#1588) by @ulivz in fc209a3
docs(tarko): refactor tool documentation (#1579) by @ulivz in 256d7d9
docs(tarko): align zh introduction with en version (#1581) by @ulivz in 42ecaef
docs(tarko-agent-cli): optimize README.md (#1578) by @ulivz in 165605e
docs(tarko-agent): init documentation (#1502) by @ulivz in b7af1e8
docs: remove duplicate header (#1559) by @ulivz in 52c0616

Other Changes

refactor(gui-agent): refactor browser operators architecture and fix deployment issues (#1682) by @ZhaoHeh in bde2444
refactor(tarko-agent-ui): show terminal ui for empty execute_bash results (#1676) by @ulivz in 44d0272
refactor(tarko-agent-ui): consolidate file display mode type definitions (#1637) by @ulivz in 6f595f4
refactor(gui-agent): refactor composable gui agent with improved stability and error handling (#1556) by @ZhaoHeh in 3a5eeb8
refactor(gui-agent): refactor SDK with new operators support and enhanced configuration (#1618) by @ZhaoHeh in 7d9ca1f
refactor(tarko-agent-cli): simplify setup ui logic (#1631) by @ulivz in 6cd5c08
refactor(tarko): optimize agent-server-next dao level (#1620) by @cjraft in 8af1a6d
refactor(gui-agent): enhance action parser and add comprehensive utilities (#1617) by @ZhaoHeh in 9f6930f
test(agent-tars): update browser control snapshots (#1707) by @ulivz in db9c02c
chore(tars-stack): release 0.3.0 by @chenjian.bzh in 54dc6f3
chore(gui-agent): update README for gui-agent 2.0 example (#1733) by @ZhaoHeh in 14db4c4
chore(tarko-agent): remove outdated gui-agent/basic example to avoid circular dependencies (#1726) by @ulivz in 4eb7ac7
chore: fix typos across codebase (#643) by @sukrucildirr in 3e31c89
chore(omni-agent): update games (#1670) by @ZhaoHeh in 43d3bb0
chore(o-gui-agent): optimize agent game mode's processing (#1664) by @ZhaoHeh in 8e01185
chore(tars-stack): release 0.3.0-beta.12 (#1569) by @ulivz in f4c4e0e
chore: remove unused and outdated files (#1566) by @ulivz in 1336f29
chore: fix expired lark link (close: #1564) (#1565) by @ulivz in f380287
ci(tarko-agent-server): add missing getOptions method to fix tests (#1675) by @ulivz in c1f3cab
ci(tarko-pnpm-toolkit): filter canary releases in release note generation (#1570) by @ulivz in 137eb18

Full Changelog: v0.3.0-beta.11-canary-e70d431f-20250917163005...v0.3.0