Find out what is in a (moving) image with perhaps the best off-the-shelf solution: clarifai.com. Clarifai provides descriptors for images along with how confident it is about each of the descriptors. It is a bit magical. (See also the 2013 ImageNet LSVR Classification Results.)

To get the current released version from CRAN:

install.packages("clarifai")

To get the current development version from GitHub:

install.packages("devtools")
devtools::install_github("soodoku/clarifai", build_vignettes = TRUE)

To learn about how to use clarifai, see using_clarifai (html version) or analyzing instagram accounts of politicians (html version). There are lots of other interesting ways you can use clarifai. For instance, you can use clarifai for inferring gender of the speaker based on the first name.

You can also launch vignettes within R:

# Using clarifai
vignette("using_clarifai", package = "clarifai")
# Analyzing politician instagram accounts
vignette("poligrams", package = "clarifai")

Scripts are released under MIT License.

The project welcomes contributions from everyone! In fact, it depends on it. To maintain this welcoming atmosphere, and to collaborate in a fun and productive way, we expect contributors to the project to abide by the Contributor Code of Conduct.