The icon can be turned off from the More button in the corner ... at home regardless of whether the others you share with are with you. My time with iCloud Shared Photo Libraries has been limited ...