If the slices to unref array was expanded after returning a pointer to a
slice, that pointer becomes invalidated. Instead, allocate and store
pointers to slices in that array to keep stability.