Pre-release of SLEAP v1.2.0.

This includes updates to core libraries used in SLEAP, including TensorFlow to enable support for newer NVIDIA GPUs.

Warning: This is a pre-release! Expect bugs and strange behavior when testing.

Quick install

conda (Windows/Linux/GPU):

conda create -y -n sleap -c sleap -c sleap/label/dev -c nvidia sleap=1.2.0a2

pip (any OS):

pip install sleap==1.2.0a2

Full changelog

• Update Python, TensorFlow and others (#609): enables GPU support for Ampere and newer cards, e.g., 3080, A100, etc.

  • Fixes #454
  • Version changes:
    • python=3.6 → python=3.7
    • tensorflow=2.3.1 → tensorflow=2.7.0 (2.6.2 should also work)
    • cudatoolkit=10.1 → cudatoolkit=11.3.1
    • cudnn=7.6 → cudnn=8.2.1
    • h5py=2.10.0 → h5py=3.1.0 (up to 3.6.0 should also work)
    • numpy=1.18.1 → numpy=1.19.5 (up to 1.21.2 should also work)
    • imgaug=0.3.0 → imgaug=0.4.0
    • attrs=19.3 → attrs=21.2.0
    • cattrs=1.0.0rc → cattrs=1.1.1
    • rich=9.10.0 → rich=10.16.1
    • scipy=1.4.1 → scipy=1.7.1 (1.4.1 should also work)

• Conda packages and environments now require nvidia::cuda-nvcc=11.3 to enable platform specific optimizations (#623).

  • Note: This now requires the -c nvidia channel addition to conda commands.

• Clean up CI/CD pipelines (#618):

  • Now building on release or when build version is bumped
  • environment.yml is not using sleap:: channel packages and instead relies on pip for flexibility
  • environment_no_cuda.yml is not using sleap:: packages and is now the default for CI
  • environment_build.yml DOES use sleap:: packages so we don't have to include tensorflow and pyside2 in the conda package for sleap

• GUI enhancements (#618)

  • Ensure randomly initialized points don't go beyond frame bounds (#613)
  • Add batch set button in video importer (#613)
  • Added command to return to last interacted frame (defaults to Ctrl + A) (#613)

• Labeling GUI node visibility fixes (#619)

  • Add option for toggling display of non-visible user nodes to View menu.
  • Deal with empty instances correctly. They are now not plotted at all, rather than plotted and then hidden.
    • Fixes "ValueError: min() arg is an empty sequence" error
    • Fixes "RuntimeWarning: All-NaN axis encountered" error

• Additional numpy conversion and label manipulation functionality (#621)

  • Add LabeledFrame convenience properties:
    • user_instances, n_user_instances, has_user_instances
    • predicted_instances, n_predicted_instances, has_predicted_instances
    • tracked_instances, n_tracked_instances, has_tracked_instances
  • Fix LabeledFrame.numpy() when there are no instances in the frame
  • Labels.numpy() revamp
    • Works with untracked and single instance data
    • Allow for specifying video as integer

• Training profile tweaks (#622)

  • Standardize profiles and delete old ones
    • Sigma defaults to 2.5 for all profiles
    • Learning rate scheduler and early stopping now use threshold of 1e-8
    • Rotation augmentation defaults to [-15, 15] so front facing videos work by default
  • Change default inference target behavior (selected clip → current frame → none)
  • Hardcode order for built-in profiles (Defaults are now the smaller models)
  • Auto-detect single vs multi-instance model type for default tab from data

• Fix centroid model evaluation when GT instances have NaNs (#618)

  • Fixes issues #533, #599

• Fix PAF instance assembly when skeleton is not topologically sorted (#618)

  • Thanks E. Mae Guthman for the report!

• Fix single instance model visualization during training (#620)

  • Fixes #604

Installing

We recommend using Miniconda to install and manage your Python environments. This will also make GPU support work transparently without installing additional dependencies.

See the Installation page in the docs for more info.

Using Conda (Windows/Linux)

1. Delete any existing environment and start fresh (recommended):

conda env remove -n sleap

2. Create new environment called sleap (recommended):

conda create -y -n sleap -c sleap -c sleap/label/dev -c nvidia sleap=1.2.0a2

Using PyPI (Windows/Linux/Mac)

1. Create a new conda environment called sleap (recommended):

conda create -n sleap python=3.7
conda activate sleap

2. Install from PyPI:

pip install sleap==1.2.0a2