I don't want to specify every label, and some PRs don't need to have labels but should still be included in the release.

There doesn't seem to be a way to do that currently.