Add a poll with a few dates and give folks a few days to respond. Most votes for the day sets that. Then you can start compiling a list of attendees; too many already saying it depends on the date.