Don't allow those only enrolled in courses (not part of member community) to see member profiles on the right hand menu

I would love to offer my courses to those outside of my member community (and hope that they'll join after going through the course) however, when someone enrolls in a course they can see the member directory on the right hand side (even with removing directory access). My membership community is not comfortable with non members being able to see their bios and information. I would love to be able to remove this side directory view from anyone who does not have access to the directory. Thanks!