That only happens if it is not turned out enough. Basically the drums were not adjusted.
You either do not have self adjusting,(has a little cable that hits a bar that rides on the star wheel) or they were just way out.
Your brakes expand further than the starwheel can maintain contact and it falls out.
Should have had very soft brakes.