Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 1, 2025

• Update README with correct database username

  Show description for 002989b
  rashworld-max

  authored
  002989b

  Copy full SHA for 002989b

Commits on Sep 10, 2025

• Merge pull request #1 from rashworld-max/rashworld-max-patch-1

  Show description for 101e5c6
  rashworld-max

  authored
  101e5c6

  Copy full SHA for 101e5c6

Commits on Sep 8, 2025

• Update domain.py

  rashworld-max

  authored
  de2f7f9

  Copy full SHA for de2f7f9

• Update domain.py

  rashworld-max

  authored
  dcea032

  Copy full SHA for dcea032

Commits on Mar 27, 2013

• Updated script to find PD count after europeana updated their site design.

  

  cronuser@backup

  committed
  8a14f5e

  Copy full SHA for 8a14f5e

Commits on Jun 27, 2012

• Changed site URL for MIT Scratch to something more relevant.

  

  cronuser@backup

  committed
  7e6ecc6

  Copy full SHA for 7e6ecc6

• Added a script to scrape MIT Scratch for CC-licensed project counts.

  

  cronuser@backup

  committed
  cf6f021

  Copy full SHA for cf6f021

Commits on Jun 7, 2012

• Make search_engines a list intead of a tuple

  

  cronuser@backup

  committed
  c56f46a

  Copy full SHA for c56f46a

• Make that list instead of a tuple.

  

  cronuser@backup

  committed
  6871c36

  Copy full SHA for 6871c36

Commits on Jun 6, 2012

• Yahoo doesn't work any longer, so stop filling the db with counts of 0 for Yahoo.

  

  cronuser@backup

  committed
  762454f

  Copy full SHA for 762454f

• We want to manually specify which search engines to dump, since all the ones in the database may not be relevant any longer.

  

  cronuser@backup

  committed
  27b30bd

  Copy full SHA for 27b30bd

• Added a script to scrape CC-licensed video counts from Vimeo.

  

  cronuser@backup

  committed
  6294d0e

  Copy full SHA for 6294d0e

Commits on Jun 4, 2012

• Don't use try_thrice() for Google. It was slowing the stats runner down to the point of it not completing in even a few days time.

  

  cronuser@backup

  committed
  42d667d

  Copy full SHA for 42d667d

Commits on Mar 6, 2012

• Added simple script to scrape YouTube for cc-by count, and count of all content (for comparison)

  

  cronuser@backup

  committed
  45551fa

  Copy full SHA for 45551fa

Commits on Oct 26, 2011

• Tweak the Europeana regex to make it more flexible.

  

  cronuser@backup

  committed
  58d7706

  Copy full SHA for 58d7706

Commits on Sep 30, 2011

• Added script to scrape europeana.eu for PDM counts.

  

  cronuser@backup

  committed
  bac1398

  Copy full SHA for bac1398

Commits on Aug 15, 2011

• Added Google back to search engine list.

  

  cronuser@backup

  committed
  66d7e06

  Copy full SHA for 66d7e06

Commits on Aug 12, 2011

• Enabled TOR before each request to Google.

  

  cronuser@backup

  committed
  1c2e52f

  Copy full SHA for 1c2e52f

• Enabled TOR before each request to Yahoo.

  

  cronuser@backup

  committed
  c200868

  Copy full SHA for c200868

Commits on Aug 11, 2011

• Try getting Google counts again via scraping.

  

  cronuser@backup

  committed
  da018cd

  Copy full SHA for da018cd

Commits on Aug 9, 2011

• Add a function for scraping some basic link count info from Google.

  

  nkinkade

  committed
  7201b89

  Copy full SHA for 7201b89

Commits on Aug 8, 2011

• Small syntax change which for some reason causes only one timestamp per day, instead of 2.

  

  cronuser@backup

  committed
  bef38ca

  Copy full SHA for bef38ca

Commits on Aug 4, 2011

• If we can't find inlinks in scraped document just return 0 instead of raising an exception.

  

  cronuser@backup

  committed
  346dcc7

  Copy full SHA for 346dcc7

Commits on Aug 3, 2011

• Make scraping of SiteExplorer a bit more robust.

  

  cronuser@backup

  committed
  e5d4abd

  Copy full SHA for e5d4abd

• Doh. Don't URL encode the entire URL, but just the query string.

  

  cronuser@backup

  committed
  3ae437c

  Copy full SHA for 3ae437c

Commits on Aug 2, 2011

• Escape the query string before passing it to Yahoo.

  

  cronuser@backup

  committed
  556f3ba

  Copy full SHA for 556f3ba

Commits on Aug 1, 2011

• Remove Google and All The Web from search_engines.

  

  cronuser@backup

  committed
  4910e49

  Copy full SHA for 4910e49

• Coerce inlinks into an integer since some debug message need it as that type.

  

  cronuser@backup

  committed
  18792bb

  Copy full SHA for 18792bb

Commits on Jul 29, 2011

• For simple Yahoo counts use new siteexplorer scraper, and disable specific/complex Yahoo counts for now.

  

  cronuser@backup

  committed
  9ea18cd

  Copy full SHA for 9ea18cd

• New function to scrape siteexplorer, since API is mostly shut down.

  

  cronuser@backup

  committed
  60e976d

  Copy full SHA for 60e976d

Commits on Jul 15, 2011

• urlencode the license URL, especially important for the samplint+ license URLs

  

  cronuser@backup

  committed
  b5cc99a

  Copy full SHA for b5cc99a

Commits on Jul 1, 2011

• Make sanity_check() try for a TOR IP 3 times.

  

  cronuser@backup

  committed
  eb08144

  Copy full SHA for eb08144

Commits on Jun 30, 2011

• Make Bing (was MSN) searches using inbody: instead of link: keyword.

  

  cronuser@backup

  committed
  094d15d

  Copy full SHA for 094d15d

Commits on Jun 29, 2011

• Make msn_count() use Bing 2.0 REST/JSON API interface.

  

  cronuser@backup

  committed
  7704022

  Copy full SHA for 7704022

• Change API key for Google, and also add CSE id.

  

  cronuser@backup

  committed
  809ebae

  Copy full SHA for 809ebae

Pagination

Previous

Next