AFFiNE AI Release: Enhancing Productivity with GPT Vision 🛠️
Support us on https://www.producthunt.com/posts/affine-ai
We’re excited to announce the latest update to AFFiNE AI, integrating the GPT Vision model to revolutionize how you interact with your productivity tools. Built with the latest GPT Vision model, AFFiNE AI moves beyond text-based dialogue. Based on our infinite whiteboard and powerful block editor, AI naturally understands everything on your freeform canvas. In AFFiNE AI, whether it’s an image, an article, or a form, just right-click and select, and the AI can automatically understand your content and provide various outputs, it can even turn your doodles and prompts into an interactive app at the click of a button.
Key Updates:
- Enhanced Conversations with GPT: Your interactions aren’t limited to text anymore. Engage with GPT using documents, spreadsheets, and whiteboard spaces.
- Advanced Copywriting Tool: AFFiNE AI now assists with drafting, translating, summarizing, and proofreading to refine your documents.
- Visualization Tools: Easily convert complex ideas into structured mind maps or slides with our AI-powered visualization features.
- Interactive Transformations: Inspired by Tldraw, “Make it Real” lets you turn sketches or images into functional web pages or apps.
Embrace the power of non-linear thinking with our edgeless canvas and AI. Try it out and let us know how it transforms your workflow!
Feature
- Allow collections to be added to favorites (#6288) by @pengx17
- Fav item reordering (#6302) by @pengx17
- Make the synchronous animation trigger less frequently (#6412) by @CatsJuice in #6412
- Compatible with multiple subscriptions (#6277) by @CatsJuice in #6277
- Add cloud usage in sidebar avatar menu (#6400) by @CatsJuice in #6400
- Add new doc button to collection page (#6423) by @JimmFly in #6423
- Adjust telemetry config (#6424) by @EYHN in #6424
- Basic copilot plugin implement (#6229) by @darkskygit in #6229
- Add prompt service (#6241) by @darkskygit in #6241
- Add favorite operation to all collection (#6428) by @JimmFly in #6428
- Add confirm modal to add new doc button (#6436) by @JimmFly in #6436
- Pricing plans ai subscription ui (#6449) by @CatsJuice in #6449
- Avoid popup window being blocked (#6451) by @forehalo in #6451
- Add responsive styles to collection filter (#6486) by @JimmFly in #6486
- Ai subscription in billing page (#6476) by @CatsJuice in #6476
- Add sign in to not found page (#6496) by @JimmFly in #6496
- I18n for pricing plans (#6499) by @CatsJuice in #6499
- Remove toggle workspace onboarding dialog (#6501) by @CatsJuice in #6501
- Add session impl (#6254) by @darkskygit in #6254
- Add copilot impl (#6230) by @darkskygit in #6230
- Copilot controller (#6272) by @darkskygit in #6272
- Text to image impl (#6437) by @darkskygit in #6437
- Set the right sidebar to display TOC by default (#6503) by @JimmFly in #6503
- Ai images (#6506) by @fundon in #6506
- Add ai usage in account-setting (#6516) by @CatsJuice in #6516
- Add new doc button to collection item (#6521) by @JimmFly in #6521
- Adjust the display settings to be independent for each workspace (#6502) by @JimmFly in #6502
- Remove ai from experimental features (#6529) by @EYHN in #6529
- Add pro quota to dev user (#6532) by @EYHN in #6532
- Detailed copilot histories (#6523) by @darkskygit in #6523
- Create and open cloud workspace if not exists after logged in (#6511) by @CatsJuice in #6511
- Use zip snapshot for onboarding page (#6495) by @EYHN in #6495
- Move help island to workbench (#6535) by @EYHN in #6535
- Bump blocksuite (#6541) by @donteatfriedrice in #6541
- Copy to the clipboard whilst creating a shared link (#6555) by @JimmFly in #6555
- Add ai onboarding (#6544) by @CatsJuice in #6544
- Ai onboarding for edgeless mode (#6556) by @CatsJuice in #6556
- Ai create an image (#6538) by @fundon in #6538
- Add slide action (#6560) by @regischen in #6560
- Check quota correctly (#6561) by @darkskygit in #6561
- Refresh prompts (#6568) by @darkskygit in #6568
- Optimize ai onboarding trigger logic (#6579) by @CatsJuice in #6579
- Unsplash api proxy (#6572) by @darkskygit in #6572
- Support registering ai early access users (#6565) by @forehalo in #6565
- Framework by @EYHN
- Framework (#6403) by @EYHN in #6403
- Enrich pwa manifest.json (#6599) by @EYHN in #6599
- Adjust notify styles (#6578) by @JimmFly in #6578
- Add blob upload support for copilot (#6584) by @darkskygit in #6584
- Adopt createMessage upload api (#6596) by @pengx17 in #6596
- Add created timestamp to history (#6607) by @forehalo in #6607
- Check user's subscription at ai onboarding stage (#6608) by @CatsJuice in #6608
- Add subscribe link (#6610) by @EYHN in #6610
- Reduce profile loading time (#6616) by @EYHN in #6616
- Add local ai onboarding dialog (#6600) by @CatsJuice in #6600
- Remove message query (#6622) by @darkskygit in #6622
- Add stickers (#6629) by @EYHN in #6629
- Auto refresh session (#6613) by @EYHN in #6613
- Update chat prompt (#6639) by @darkskygit in #6639
- Add mixpanel tracking for ai (#6643) by @pengx17 in #6643
- Show login modal if not logged in when using ai (#6632) by @CatsJuice in #6632
- Adjust workspace avatar style (#6652) by @EYHN in #6652
- Adjust help island style (#6651) by @EYHN in #6651
- Try cloud link (#6660) by @EYHN in #6660
- Add ai subscription landing page (#6657) by @CatsJuice in #6657
- Open desktop directly in subscription landing page (#6661) by @CatsJuice in #6661
- Provide closeStream (#6659) by @regischen in #6659
- Handle stream error (#6653) by @darkskygit in #6653
- New prompt for expand mind map (#6678) by @doouding in #6678
- Optimize the shift multi-selection function of doc list (#6675) by @JimmFly in #6675
- Add indicator for general ai onboarding dialog (#6687) by @CatsJuice in #6687
- Add fallback component to member list (#6672) by @JimmFly in #6672
- Orm (#6536) by @forehalo in #6536
- Use default params if not provided (#6701) by @darkskygit in #6701
- Add ai pricing tip for plans page (#6704) by @CatsJuice in #6704
- Allow custom seed (#6709) by @darkskygit in #6709
- Add seed to fal (#6712) by @fundon in #6712
- Prefetch onboarding video (#6736) by @EYHN in #6736
- Add enable cloud failed notify (#6741) by @EYHN in #6741
- Add flag to disable new sign ups (#6752) by @forehalo in #6752
- Disable ai onboarding video loop (#6769) by @EYHN in #6769
- Adjust ai term (#6770) by @EYHN in #6770
- Improve query performence (#6764) by @darkskygit in #6764
- Update language resources (#6767) by @JimmFly in #6767
- Replace setting content scroll with radix ScrollArea (#6787) by @CatsJuice in #6787
- Bump blocksuite (#6789) by @donteatfriedrice in #6789
Bug Fix
- Fix sync issues on old ids (#6474)
- Give s3 client a default request timeout (#6483)
- Use post request to consume magic link token (#6656)
- Unexpected response style of shared page (#6383) by @JimmFly in #6383
- Missing deps (#6396) by @Brooooooklyn in #6396
- Optimize bundle size by removing unused dependencies (#6415) by @pengx17 in #6415
- Edit button missing in shared page (#6398) by @JimmFly in #6398
- Onboarding app should also setup app storage config (#6427) by @pengx17 in #6427
- Wayland build (#6404) by @pengx17 in #6404
- Fix build script (#6422) by @EYHN in #6422
- Unexpected editable state after trash page refresh (#6433) by @JimmFly in #6433
- Broken links in README.md (#6418) by @TaylorHo in #6418
- Selfhost redirect url (#6426) by @EYHN in #6426
- Selfhost should not use favicon from affine.pro (#6425) by @EYHN in #6425
- UseConfirmModal can't be closed automatically when 'onConfirm' is non-async (#6439) by @CatsJuice in #6439
- Unexpected collection item drag event (#6443) by @JimmFly in #6443
- Doc cache makes publish mode updating failed (#6444) by @forehalo in #6444
- Add max-height to tag filter (#6442) by @JimmFly in #6442
- Only auto apply coupon in pro subscription (#6452) by @forehalo in #6452
- Give s3 client a default request timeout (#6483) by @forehalo in #6483
- Avoid flicking when click sidebar user avatar (#6482) by @CatsJuice in #6482
- Remove duplicate windows controls when right sidebar is expanded (#6480) by @JimmFly in #6480
- Remove unexpected duplicate notification (#6477) by @JimmFly in #6477
- Fix sync issues on old ids (#6474) by @EYHN in #6474
- Unexpected horizontal scrolling after jump to block (#6475) by @JimmFly in #6475
- Sign up password max length notify (#6467) by @EYHN in #6467
- Viewport element not found in share page (#6453) by @L-Sun in #6453
- Re-create session should skip rewrite messages (#6513) by @darkskygit in #6513
- Unexpected routing jump behavior (#6524) by @JimmFly in #6524
- Should pass mode to AffineEditorContainer (#6522) by @pengx17 in #6522
- Chat panel display on cont in chat (#6527) by @pengx17 in #6527
- Disable micromark debug output (#6528) by @pengx17 in #6528
- Change action (#6519) by @regischen in #6519
- Restore lost activation state of sidebar menu items (#6520) by @JimmFly in #6520
- Pick copilot provider depend on model (#6540) by @darkskygit in #6540
- Cannot query chat history (#6539) by @darkskygit in #6539
- Use backend prompts (#6542) by @pengx17 in #6542
- Description of cancel is incorrect when cloud subscription is activated (#6530) by @CatsJuice in #6530
- Storybook build issue (#6554) by @pengx17 in #6554
- Close app while on fullscreen should be minimize instead (#6534) by @pengx17 in #6534
- Upgrade plan correctly (#6543) by @darkskygit in #6543
- Fix flaky e2e (#6559) by @EYHN in #6559
- The page flashes when click the share button (#6557) by @JimmFly in #6557
- Add action field in histories gql (#6558) by @regischen in #6558
- Bump bs (#6562) by @pengx17 in #6562
- Should choose different models based on content or attachments (#6567) by @fundon in #6567
- Temporary fix for running electron tests (#6576) by @pengx17 in #6576
- Move help land position (#6571) by @regischen in #6571
- SignIn page style (#6582) by @JimmFly in #6582
- Wrong pricing state in billing ai card (#6583) by @CatsJuice in #6583
- Missing feature upsert (#6585) by @darkskygit in #6585
- Unable to redirect to same origin paths (#6586) by @forehalo in #6586
- Give page reference correct link (#6587) by @forehalo in #6587
- Only returns active subscriptions (#6590) by @forehalo in #6590
- Revalidate subscription info when open ai usage panel by @EYHN
- Revalidate subscription info when open ai usage panel (#6591) by @EYHN in #6591
- Avoid store unpaid subscriptions by @forehalo
- Avoid store unpaid subscriptions (#6593) by @darkskygit in #6593
- Fix navigate not working (#6594) by @EYHN in #6594
- Remove storybook testing (#6595) by @EYHN in #6595
- App cannot start in graphql only flavor (#6598) by @forehalo in #6598
- Retrieve lost scroll bars in editor (#6597) by @JimmFly in #6597
- Ai error handling (#6588) by @pengx17 in #6588
- Provide photoengine (#6574) by @pengx17 in #6574
- Missing copilot param (#6602) by @pengx17 in #6602
- Provide user info for copilot (#6606) by @pengx17 in #6606
- Disable default save page as (#6548) by @soumyasen10 in #6548
- Should not swallow copilot errors (#6609) by @pengx17 in #6609
- Banner should not affect the editor layout (#6605) by @fundon in #6605
- Cookie expires too short (#6615) by @EYHN in #6615
- Fix unstable test (#6621) by @EYHN in #6621
- Always create message for ai (#6620) by @pengx17 in #6620
- Copilot blob process (#6612) by @darkskygit in #6612
- Dev user configuration issue (#6619) by @fundon in #6619
- Handle 401 errors (#6611) by @pengx17 in #6611
- Drag and drop files into doc (#6630) by @JimmFly in #6630
- Fix subscribe link for pro plan (#6627) by @EYHN in #6627
- Move toTextStream to affine (#6628) by @pengx17 in #6628
- Remove sidebar user avatar menu item's rightArrow icon (#6633) by @CatsJuice in #6633
- Copilot storage config (#6650) by @darkskygit in #6650
- Use post request to consume magic link token (#6656) by @forehalo in #6656
- Fix home page init cloud (#6654) by @EYHN in #6654
- Always return created timestamp of chat messages (#6658) by @forehalo in #6658
- Update prompts (#6664) by @pengx17 in #6664
- History attachment query (#6670) by @darkskygit in #6670
- Error handling in sse (#6663) by @pengx17 in #6663
- Should set type of uploaded file (#6689) by @fundon in #6689
- Adjust payment related copywriting (#6655) by @CatsJuice in #6655
- Fix react error (#6692) by @EYHN in #6692
- Update prompts (#6693) by @pengx17 in #6693
- Large transaction (#6695) by @darkskygit in #6695
- Skip throttle for currentUser (#6700) by @forehalo in #6700
- Stripe webhook calls in random order (#6702) by @forehalo in #6702
- Some event missing with multiple env webhook (#6705) by @darkskygit in #6705
- Open in chat does not work when the panel is not opened (#6703) by @pengx17 in #6703
- Incorrect mixpanel param (#6706) by @pengx17 in #6706
- Reduce workspace avatar request (#6713) by @EYHN in #6713
- Workspace avatar hover radius (#6717) by @CatsJuice in #6717
- Adjust notify style (#6724) by @EYHN in #6724
- Fix opt out telemetry cause error (#6723) by @EYHN in #6723
- Update prompts (#6738) by @pengx17 in #6738
- Show toast for requestRunInEdgeless (#6715) by @pengx17 in #6715
- Make it real action (#6745) by @pengx17 in #6745
- Blob controller permission (#6746) by @forehalo in #6746
- Prompt message tunning (#6747) by @pengx17 in #6747
- Input overflow issue (#6748) by @pengx17 in #6748
- Fix typo (#6750) by @EYHN in #6750
- Remove dnd for workspace list (#6754) by @pengx17 in #6754
- Ai chat session handling (#6751) by @pengx17 in #6751
- Ai related copywritting fix (#6766) by @CatsJuice in #6766
- Fix ai onboarding video missing (#6768) by @EYHN in #6768
- Do not throttle healthy checking api (#6771) by @forehalo in #6771
- Update prompts (find actions) (#6773) by @pengx17 in #6773
- Update prompts (#6779) by @pengx17 in #6779
- Do not allow registration through gql (#6775) by @forehalo in #6775
- Ensure the colorfulCallback of Avatar in different sizes behaves consistently (#6784) by @CatsJuice in #6784
- Adjust setting sidebar's workspace avatar (#6785) by @CatsJuice in #6785
- Do not create hash in frontend (#6788) by @pengx17 in #6788
Build
- Bump whoami from 1.4.1 to 1.5.1 (#6471) by @dependabot[bot] in #6471
- Add nsis script for windows installer (#6674) by @pengx17 in #6674
- Add nsis build to release-desktop workflow (#6677) by @pengx17 in #6677
- Nsis updater compatibility fix (#6681) by @pengx17 in #6681
- Nsis typo (#6697) by @pengx17 in #6697
Chore
- Add more telemetry (#6402) by @Brooooooklyn in #6402
- Upgrade cmdk to 1.0.0 (#6401) by @pengx17 in #6401
- Bump up undici version to v6.11.1 [SECURITY] (#6457) by @renovate[bot] in #6457
- Bump up css-loader version to v7 (#6458) by @renovate[bot] in #6458
- Bump up jotai-effect version to v1 (#6472) by @renovate[bot] in #6472
- Bump up vite version to v5.0.13 [SECURITY] (#6455) by @renovate[bot] in #6455
- Bump up style-loader version to v4 (#6490) by @renovate[bot] in #6490
- Bump blocksuite (#6448) by @EYHN in #6448
- Bump up stripe version to v15 (#6512) by @renovate[bot] in #6512
- Bump up @testing-library/react version to v15 (#6508) by @renovate[bot] in #6508
- Update description of the workspace member (#6492) by @JimmFly in #6492
- Bump up all non-major dependencies (#6235) by @renovate[bot] in #6235
- Bump up oxlint version to v0.2.17 (#5778) by @renovate[bot] in #5778
- Bump blocksuite (#6525) by @pengx17 in #6525
- Bump bs (#6553) by @pengx17 in #6553
- Update i18n resources (#6533) by @JimmFly in #6533
- Bump bs (#6563) by @pengx17 in #6563
- Bump blocksuite (#6566) by @regischen in #6566
- Bump up @testing-library/react version to v15 (#6531) by @renovate[bot] in #6531
- Remove vite from resolutions (#6580) by @Brooooooklyn in #6580
- Clean up throttler (#6326) by @forehalo in #6326
- Bump blocksuite (#6601) by @pengx17 in #6601
- Cleanup outdated api (#6604) by @darkskygit in #6604
- Bump blocksuite (#6626) by @pengx17 in #6626
- Apply backend-config to the graphql service (#6631) by @Brooooooklyn in #6631
- Enable ai feature in dev (#6618) by @darkskygit in #6618
- Bump blocksuite (#6635) by @pengx17 in #6635
- Remove useless free subscription enum (#6634) by @forehalo in #6634
- Bump up storybook-dark-mode version to v4 (#6136) by @renovate[bot] in #6136
- Lock file maintenance (#5249) by @renovate[bot] in #5249
- Bump up electron version to v30 (#6573) by @renovate[bot] in #6573
- Bump up oxlint version to v0.3.0 (#6636) by @renovate[bot] in #6636
- Bump up oxlint version to v0.3.1 (#6662) by @renovate[bot] in #6662
- Bump blocksuite (#6666) by @EYHN in #6666
- Add copilot vision dev mode polyfill (#6671) by @darkskygit in #6671
- Bump blocksuite (#6673) by @EYHN in #6673
- Bump up cssnano version to v7 (#6691) by @renovate[bot] in #6691
- Bump blocksuite (#6694) by @EYHN in #6694
- Bump up supertest version to v7 (#6690) by @renovate[bot] in #6690
- Bump rustls from 0.21.10 to 0.21.11 (#6683) by @dependabot[bot] in #6683
- Use default throttler replace strict throttler (#6698) by @darkskygit in #6698
- Bump blocksuite (#6707) by @EYHN in #6707
- Use native file-type implementation (#6686) by @Brooooooklyn in #6686
- Bump blocksuite (#6725) by @pengx17 in #6725
- Bump @pengx17/electron-forge-maker-appimage (#6726) by @pengx17 in #6726
- Replace ai onboarding videos (#6730) by @CatsJuice in #6730
- Upgrade Rust to 1.77.2 (#6732) by @Brooooooklyn in #6732
- Remove unused y-indexeddb (#6728) by @EYHN in #6728
- Delete removed next-auth patch (#6729) by @Brooooooklyn in #6729
- Enable source map on production (#6731) by @EYHN in #6731
- Bump blocksuite (#6742) by @EYHN in #6742
- Remove unused module (#6744) by @EYHN in #6744
- Bump blocksuite (#6753) by @pengx17 in #6753
- Update prompts (#6782) by @darkskygit in #6782
- Bump blocksuite (#6781) by @pengx17 in #6781
- Bump blocksuite (#6786) by @EYHN in #6786
- Bump up nrwl monorepo to v19 (major) (#6783) by @renovate[bot] in #6783
- Handle the telemetry warnings in console (#6793) by @Brooooooklyn in #6793
- Fix environment variables config in deploy/release (#6552) by @Brooooooklyn in #6552
- Bash escape vulnerability (#6640) by @random-dudde in #6640
Docs
Refactor
- Favorite adapter (#6285) by @pengx17
- New notification center implemented with sonner (#6416) by @CatsJuice in #6416
- Replace all notification relies on jotai (#6417) by @CatsJuice in #6417
- Remove copilot client from presets (#6546) by @pengx17 in #6546
- Cleanup secondary db logic (#6710) by @pengx17 in #6710
- Rename @affine/storage to @affine/server-native (#6682) by @Brooooooklyn in #6682
- Remove jump once (#6733) by @EYHN in #6733
- Remove once signed in event (#6740) by @EYHN in #6740
- Refine ai tracker (#6778) by @pengx17 in #6778
Style
- Remove button's shadow (#6481) by @CatsJuice in #6481
Test
- Add test for livedata with react (#6397) by @EYHN in #6397
- Copilot unit & e2e test (#6649) by @darkskygit in #6649
- Payment tests (#6737) by @forehalo in #6737
New Contributors
- @random-dudde made their first contribution in [#6640]((#6640)
- @soumyasen10 made their first contribution in [#6548]((#6548)
- @TaylorHo made their first contribution in [#6418]((#6418)