Deleteing User Defined Brush Libraries

I made a bunch of custom brushes and created a new brush library for each group in Illustrator 5.5.

A couple of libraries are basically dupes and I no longer need them.

Is there a way to delete the "whole" user defined library pallet.