Can I add members to a group that were volunteers for certain past event(s)?

Yes.  After selecting the group, use the Add Members From Event(s) button and select all the events you wish to add members from.