In order to make a memorized-group private where they can be only be seen by a particular user, click the field inside the memorized group screen as shown in the image below.