github ScrapeGraphAI/Scrapegraph-ai v0.11.0

latest releases: v1.32.0-beta.3, v1.32.0-beta.2, v1.32.0-beta.1...
6 months ago

0.11.0 (2024-05-14)

Features

  • parallel-exeuction: add asyncio event loop dispatcher with semaphore for parallel graph instances (627cbee)
  • webdriver-backend: add dynamic import scripts from module and file (db2234b)
  • add gpt-4o (52a4a3b), closes #232
  • add new prompt info (e2350ed)
  • proxy-rotation: add parse (IP address) or search (from broker) functionality for proxy rotation (2170131)
  • add support for deepseek-chat (156b67b), closes #222
  • Add support for passing pdf path as source (f10f3b1)
  • omni-search: added omni search graph and updated docs (fcb3abb)
  • added proxy rotation (0c36a7e)
  • safe-web-driver: enchanced the original AsyncChromiumLoader web driver with proxy protection and flexible kwargs and backend (768719c)
  • gpt-4o: image to text single node test (90955ca)
  • revert fetch_node (864aa91)
  • batchsize: tested different batch sizes and systems (a8d5e7d)
  • update info (4ed0fb8)
  • omni-scraper: working OmniScraperGraph with images (a296927)

Bug Fixes

  • pytest: add dependency for mocking testing functions (2f4fd45)
  • add json integration (0ab31c3)
  • Augment the information getting fetched from a webpage (f8ce3d5)
  • bug for claude (d0167de)
  • fetch_node: bug in handling local files (a6e1813)
  • chromium-loader: ensure it subclasses langchain's base loader (b54d984)
  • fixed bugs for csv and xml (324e977)
  • limit python version to < 3.12 (a37fbbc)
  • proxy-rotation: removed duplicated arg and passed the loader_kwarhs correctly to the node (1e9a564)
  • fetch-node: removed isSoup from default (0c15947)
  • proxy-rotation: removed max_shape duplicate (5d6d996)
  • asyncio: replaced deepcopy with copy due to serialization problems (dedc733)

chore

  • update models_tokens.py with new model configurations (d9752b1)

Docs

  • add diagram showing general structure/flow of the library (13ae918)
  • refactor: added proxy-rotation usage and refactor readthedocs (e256b75)
  • refactor: changed example (c7ec114)
  • concurrent: refactor theme and added benchmarck searchgraph (ced2bbc)
  • update overview diagram with more models (b441b30)

CI

  • release: 0.10.0-beta.3 [skip ci] (ad32298)
  • release: 0.10.0-beta.4 [skip ci] (548bff9)
  • release: 0.10.0-beta.5 [skip ci] (28c9dce)
  • release: 0.10.0-beta.6 [skip ci] (460d292)
  • release: 0.11.0-beta.1 [skip ci] (63c0dd9)
  • release: 0.11.0-beta.10 [skip ci] (218b8ed), closes #232
  • release: 0.11.0-beta.11 [skip ci] (8727d03)
  • release: 0.11.0-beta.2 [skip ci] (7ae50c0)
  • release: 0.11.0-beta.3 [skip ci] (106fb12), closes #222
  • release: 0.11.0-beta.4 [skip ci] (4ccddda)
  • release: 0.11.0-beta.5 [skip ci] (353382b)
  • release: 0.11.0-beta.6 [skip ci] (2724d3d)
  • release: 0.11.0-beta.7 [skip ci] (f0f7373)
  • release: 0.11.0-beta.8 [skip ci] (fa4edb4)
  • release: 0.11.0-beta.9 [skip ci] (d2877d8)

Don't miss a new Scrapegraph-ai release

NewReleases is sending notifications on new releases.