Per usual, Ken is absolutely right. It's unfortunately working as intended. If you're wanting to look at full weeks starting with the first of the year, here is a calculation that would help with that. Just replace [Date] with your date field, and use this calculation as you would use "week number"