Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Dec 10, 2025

• capture more error code

  Show description for f2a326d
  ZhiyuanChen

  committed
  f2a326d

  Copy full SHA for f2a326d

Commits on Jun 30, 2025

• Merge from 'Patty-OFurniture:icrawler_master_patches'

  Show description for 835863e
  ZhiyuanChen

  committed
  835863e

  Copy full SHA for 835863e

• improve proxy & session

  Show description for d8bd2bf
  ZhiyuanChen

  committed
  d8bd2bf

  Copy full SHA for d8bd2bf

Commits on Mar 13, 2025

• add defaults for default headers, etc.

  Show description for 5b75e1b
  ZhiyuanChen

  committed
  5b75e1b

  Copy full SHA for 5b75e1b

Commits on Jan 2, 2025

• fix: improve downloader thread exit conditions

  Show description for f7f6107
  ZhiyuanChen

  committed
  f7f6107

  Copy full SHA for f7f6107

Commits on Oct 16, 2024

• bugfix: KeyError:'data' when using BaiduImageCrawler

  Show description for 2c3f6fd
  

  serser

  authored and

  ZhiyuanChen

  committed
  2c3f6fd

  Copy full SHA for 2c3f6fd

Commits on Jul 29, 2024

• fix Parser class does not accept kwargs, #128

  Show description for 4273064
  ZhiyuanChen

  committed
  4273064

  Copy full SHA for 4273064

Commits on May 31, 2024

• fix bug in GoogleImageCrawler

  Show description for f5c0acd
  ZhiyuanChen

  committed
  f5c0acd

  Copy full SHA for f5c0acd

Commits on May 15, 2024

• fix GoogleCrawler

  Show description for e062fd0
  ZhiyuanChen

  committed
  e062fd0

  Copy full SHA for e062fd0

Commits on Jun 30, 2023

• fix tests

  Show description for ad5633c
  ZhiyuanChen

  committed
  ad5633c

  Copy full SHA for ad5633c

• add GitHub action, pre-commit and format code

  Show description for 5248c34
  ZhiyuanChen

  committed
  5248c34

  Copy full SHA for 5248c34

Commits on Jun 27, 2023

• Fix Baidu m attribute KeyError

  

  drimpossible

  committed
  5127b77

  Copy full SHA for 5127b77

Commits on Apr 21, 2023

• Update google.py for date filter

  Show description for d21644b
  richylyq

  authored
  d21644b

  Copy full SHA for d21644b

Commits on Aug 14, 2021

• bump to v0.6.6, add support of python 3.9, remove python 2 support

  Show description for 3506401
  ZhiyuanChen

  committed
  3506401

  Copy full SHA for 3506401

• Merge pull request #101 from kethan1/master

  Show description for d1aee8f
  ZhiyuanChen

  authored
  d1aee8f

  Copy full SHA for d1aee8f

• bump to v0.6.5, fix bug in google crawler

  Show description for c0a78f3
  ZhiyuanChen

  committed
  c0a78f3

  Copy full SHA for c0a78f3

Commits on Jul 22, 2021

• Remove 2.7 and 3.0 - 3.3 Support

  kethan1

  authored
  e29c5c9

  Copy full SHA for e29c5c9

Commits on Jul 18, 2021

• Add 2.7 and 3.0 - 3.3 Support

  kethan1

  authored
  497a49d

  Copy full SHA for 497a49d

Commits on Jul 17, 2021

• Fix Google Image parser

  taoyudong

  committed
  2580b27

  Copy full SHA for 2580b27

Commits on Jul 15, 2021

• Move to newer html unescape

  Show description for aa3afff
  kethan1

  authored
  aa3afff

  Copy full SHA for aa3afff

Commits on Jul 5, 2021

• Merge pull request #75 from gcheron/fix-flick-few-results

  Show description for 7e78a9a
  ZhiyuanChen

  authored
  7e78a9a

  Copy full SHA for 7e78a9a

Commits on Mar 11, 2021

• update version

  ZhiyuanChen

  committed
  8f391c8

  Copy full SHA for 8f391c8

Commits on Feb 19, 2021

• Update User Agent

  Show description for 9f1b16e
  pasqLisena

  authored
  9f1b16e

  Copy full SHA for 9f1b16e

Commits on Jan 5, 2021

• fix google parser error

  Show description for f29d55e
  sleepless-se

  authored
  f29d55e

  Copy full SHA for f29d55e

Commits on Oct 26, 2020

• fixes #80

  Show description for ca195d8
  ZhiyuanChen

  authored
  ca195d8

  Copy full SHA for ca195d8

Commits on Oct 25, 2020

• fixes #74 with #84

  ZhiyuanChen

  authored
  de762cf

  Copy full SHA for de762cf

Commits on Aug 27, 2020

• In google.py fixed pattern in re.sub() so images can be parsed

  prairie-guy

  committed
  6e6d181

  Copy full SHA for 6e6d181

Commits on Jun 14, 2020

• fix bug that limits the number of flickr result urls

  gcheron

  committed
  0759e16

  Copy full SHA for 0759e16

Commits on May 11, 2020

• Fix GoogleParser - BeautifulSoup4 4.9.0

  Show description for 683f1b7
  knappmk

  authored
  683f1b7

  Copy full SHA for 683f1b7

Commits on Mar 15, 2020

• discard the support for py3.4 and bump version to 0.6.3

  hellock

  committed
  f2ab199

  Copy full SHA for f2ab199

• Merge pull request #68 from pasqLisena/master

  Show description for 47c1f4f
  hellock

  authored
  47c1f4f

  Copy full SHA for 47c1f4f

• fix baidu crawler

  hellock

  committed
  e704ddf

  Copy full SHA for e704ddf

Commits on Mar 13, 2020

• restored google crawler - fix #65

  pasqLisena

  committed
  bc9d324

  Copy full SHA for bc9d324

Commits on May 25, 2018

• fix setup issue

  hellock

  committed
  38c9257

  Copy full SHA for 38c9257

• fix tests

  hellock

  committed
  329d8a0

  Copy full SHA for 329d8a0