If you don't feel vacuuming is necessary, then at much less than brush the pool walls and bottom weekly.
Pool owners tend to get stuck in a routine wherever pool supplies go. It is really a tragedy the appropriate approach .