Very good question and the answer depends largely on the type of filter you have:
- If it's a narrow band filter (the ones typically used in deep space astrophotography) then I would opt to keep it, since, those filters work really well because they only let through a very small part of the light spectrum.
- And if it's a broadband filter (the ones usually used in night photography in general) I think you're not going to get almost nothing out of the filter, since, it lets virtually all the light through (so that the photo looks natural in color).
That said, I always like to try everything, so, as you already have the filter, I would try to take the same photo with and without the filter. That way you're sure to know with which of the two options you get a better result (and if the two are the same, then you don't need to use the filter).