DeepAction: a MATLAB toolbox for automated classification of animal behavior in video


Image Recognition

ARTICLE SOURCE

Frame extractionTo generate spatial frames, we extract raw video frames from each video file. Confidence score calculationHere, we first examine how to calculate the frame-wise confidence score ({\widehat{p}}_{j}). We refer to this confidence score as the “max softmax score,” since it is derived from the maximum softmax probability. Now that we have established the process for generating a frame-wise confidence score, we can generate the clip-wise confidence score that is used in the confidence-based review. In the best case, the first (k) clips reviewed would be the (k) clips with the lowest accuracy.