DeepLabCut

Description

DeepLabCut is an efficient method for 2D and 3D markerless pose estimation based on transfer learning with deep neural networks. It achieves excellent results (matching human labeling accuracy) with minimal training data (typically 50-200 frames). The framework has been proven versatile in tracking various body parts in multiple species across a broad collection of behaviors.

DeepLabCut Demo

NWB Integration

DeepLabCut has developed DLC2NWB, a Python package for converting from their native output format to NWB. This library uses the NWB extension ndx-pose, which provides a standardized format for storing pose estimation data in NWB.

While ndx-pose was developed initially to store the output of DeepLabCut in NWB, it is also designed to store the output of general pose estimation tools.

Features

  • 2D and 3D markerless pose estimation
  • Transfer learning with deep neural networks
  • Excellent accuracy with minimal training data (50-200 frames)
  • Versatile tracking of body parts across species
  • NWB export support through DLC2NWB
  • Integration with ndx-pose extension for standardized data storage