Beyond Tracking: Using Deep Learning to Discover Novel Interactions in Biological Swarms

1 code implementation • 20 Aug 2021 • Taeyeong Choi, Benjamin Pyenson, Juergen Liebig, Theodore P. Pavlic

Because the resulting predictive models are not based on human-understood predictors, we use explanatory modules (e. g., Grad-CAM) that combine information hidden in the latent variables of the deep-network model with the video data itself to communicate to a human observer which aspects of observed individual behaviors are most informative in predicting group behavior.

Identification of Abnormal States in Videos of Ants Undergoing Social Phase Change

2 code implementations • 18 Sep 2020 • Taeyeong Choi, Benjamin Pyenson, Juergen Liebig, Theodore P. Pavlic

This method can be used to screen video frames for which additional human observation is needed.

One-Class Classification Time Series Analysis