Please make sharing album mutually. i.e. The other person can only see your album once they share their's as well and vice versa.
So it goes like this. I (person A) share my album with person B. But to access my album, person B will also have to share his album with me.